Paper Info
Title
On Balancing Exploration Vs. Exploitation in a Cognitive Engine for Multi-Antenna Systems
Abstract
In this paper, we define the problem of balancing exploration vs. exploitation in a cognitive engine controlled multi-antenna communication system in terms of the classical multiarmed bandit framework. We then employ the ε-greedy strategy and Gittins' indices methods for addressing the problem in a system with no prior information. Results show that the Gittins' indices assuming a normal reward process had the best overall performance compared to the Gittins' indices with a Bernoulli reward process and the ε-greedy strategy. The latter was found to be more consistent albeit inefficient for most of the cases except in the case of both a low number of trials and a low SNR in which it was found to have better performance than the other methods. Nevertheless, the Gittins' indices method should be generally preferred as it is more consistent than the ε-greedy strategy across different scenarios.
Year
DOI
Venue
2009
10.1109/GLOCOM.2009.5425783
Honolulu, HI
Keywords
Field
DocType
antenna arrays,engines,Gittins indices methods,cognitive engine,e-greedy strategy,multi antenna communication systems,on balancing exploitation,on balancing exploration
Mathematical optimization,Computer science,Signal-to-noise ratio,Communications system,Real-time computing,Artificial intelligence,Cognitive engine,Multiplexing,Machine learning,Bernoulli's principle,Phase-shift keying,Encoding (memory)
Conference
ISSN
ISBN
Citations 
1930-529X
978-1-4244-4148-8
4
PageRank 
References 
Authors
0.44
6
2
Name
Order
Citations
PageRank
Haris Ioannis Volos1403.89
R. M. Buehrer21328133.42