Paper Info
Title
On the Optimality of Myopic Sensing in Multi-State Channels
Abstract
We consider the channel sensing problem arising in opportunistic scheduling over fading channels, cognitive radio networks, and resource constrained jamming. The same problem arises in many other areas of science and technology as it is an instance of restless bandit problems. The communication system consists of $N$ channels. Each channel is modeled as a multi-state Markov chain. At each time instant a user selects one channel to sense and uses it to transmit information. A reward depending on the state of the selected channel is obtained for each transmission. The objective is to design a channel sensing policy that maximizes the expected total reward collected over a finite or infinite horizon. This problem can be viewed as an instance of restless bandit problems, for which the form of optimal policies is unknown in general. We discover sets of conditions sufficient to guarantee the optimality of a myopic sensing policy; we show that under one particular set of conditions the myopic policy coincides with the Gittins index rule.
Year
DOI
Venue
2013
10.1109/TIT.2013.2288636
IEEE Transactions on Information Theory
Keywords
DocType
Volume
markov processes,cognitive radio
Journal
60
Issue
ISSN
Citations 
1
0018-9448
6
PageRank 
References 
Authors
0.50
6
2
Name
Order
Citations
PageRank
Yi Ouyang14310.16
Demosthenis Teneketzis261285.73