Title
QoS-aware energy-efficient power control in two-tier femtocell networks based on Q-learning
Abstract
Due to the time-varying nature of wireless channels, deterministic quality of service (QoS) is hard to guarantee in wireless networks. In this paper, by integrating information theory with the principle of effective capacity, we formulate an energy efficiency optimization problem with statistical QoS guarantee in the uplink of two-tier femtocell networks. To solve the problem, we introduce a Q-learning mechanism based on Stackelberg game framework, in which macro-user acts as a leader, and knows all femto-users' transmit power strategy; while femto-users are followers, and only communicate with macrocell base station (MBS) not with other femtocell base stations (FBS). In Stackelberg game studying procedure, macro-user selects transmit power level firstly based on the best responses of femto-users, femto-users interact with environment directly, and find their best responses. At last, a distributed Q-learning algorithm is proposed. Simulation results show the proposed algorithm has a better performance in terms of convergence speed while providing delay QoS provisioning.
Year
DOI
Venue
2014
10.1109/ICT.2014.6845130
ICT
Keywords
Field
DocType
two-tier femtocell networks,energy-efficient power control,optimisation,distributed algorithms,deterministic qos,power control,q-learning mechanism,deterministic quality of service,macrocell base station,learning (artificial intelligence),quality of service,energy efficiency optimization problem,telecommunication power management,fbs,distributed q-learning algorithm,information theory,wireless channels,delay qos provisioning,game theory,mbs,stackelberg game framework,statistical qos,femtocellular radio,femtocell base stations,learning artificial intelligence,resource management,wireless communication,convergence,games
Base station,Wireless network,Femtocell,Transmitter power output,Computer science,Power control,Computer network,Quality of service,Stackelberg competition,Macrocell,Distributed computing
Conference
Citations 
PageRank 
References 
3
0.38
16
Authors
6
Name
Order
Citations
PageRank
Zhicai Zhang1304.87
Xiangming Wen261882.20
Zhengfu Li361.09
Shenghua He430.38
Wenpeng Jing55515.88
Jun Zhao61611.09