Title
Optimal power allocation policy over two identical Gilbert-Elliott channels
Abstract
We study the fundamental problem of optimal power allocation over two identical Gilbert-Elliott (Binary Markov) communication channels. Our goal is to maximize the expected discounted number of bits transmitted over an infinite time span by judiciously choosing one of the four actions for each time slot: 1) allocating power equally to both channels, 2) allocating all the power to channel 1, 3) allocating all the power to channel 2, and 4) allocating no power to any of the channels. As the channel state is unknown when power allocation decision is made, we model this problem as a partially observable Markov decision process(POMDP), and derive the optimal policy which gives the optimal action to take under different possible channel states. Two different structures of the optimal policy are derived analytically and verified by linear programming simulation. We also illustrate how to construct the optimal policy by the combination of threshold calculation and linear programming simulation once system parameters are known.
Year
DOI
Venue
2012
10.1109/ICC.2013.6655539
ICC
Keywords
DocType
Volume
power control,partially observable markov decision process,binary markov communication channels,linear programming simulation,optimal power allocation policy,adaptive power control,linear programming,pomdp,identical gilbert-elliott channels,wireless channels,adaptive control,telecommunication control,markov processes,resource management,mathematical model,wireless communication
Journal
abs/1210.3609
Issue
ISSN
Citations 
null
1550-3607
1
PageRank 
References 
Authors
0.38
8
3
Name
Order
Citations
PageRank
Wei Jiang110.38
Junhua Tang26312.59
Bhaskar Krishnamachari37051498.86