Title
Improved UCB-based Energy-Efficient Channel Selection in Hybrid-Band Wireless Communication
Abstract
While hybrid-band wireless systems recently gained prominence to achieve high capacity, selecting the best channel in these systems in real-time is still a formidable research challenge that requires further investigations. In this paper, we address this challenge in terms of an optimization problem, which is reformulated as a stochastic multi-armed bandit (MAB). Then, we introduce online learning-based solutions to solve the MAB problem for the multi-band/channel selection (MBS). Improved variants of the upper confidence bound (UCB) scheme are investigated and modified to be energy-aware. Hence, we propose Energy-Aware Randomized UCB-MBS (EA-RUCB-MBS) and Energy-Aware Kullback-Leibler UCB-MBS (EA-KLUCB-MBS) methods, which demonstrate near-optimal results. Also, EA-KLUCB-MBS exhibits the fastest convergence, while the convergence of EARUCB-MBS is similar to that of the original UCB. Based on extensive simulation results, we evaluate the performance of our proposed algorithms against benchmark MBS schemes including UCB and Thompson sampling (TS).
Year
DOI
Venue
2021
10.1109/GLOBECOM46510.2021.9685996
2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM)
Keywords
DocType
ISSN
Hybrid-band systems, resource allocation, multi-armed bandit (MAB), upper confidence interval (UCB), randomized UCB, Kullback-Leibler UCB (KLUCB)
Conference
2334-0983
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Sherief Hashima155.54
Mostafa M. Fouda202.03
Zubair Md. Fadlullah375645.47
Ehab Mahmoud Mohamed46315.17
Hatano, Kohei58821.16