Title
Multi-Player Multi-Armed Bandits for Stable Allocation in Heterogeneous Ad-Hoc Networks
Abstract
Next generation networks are expected to be ultra-dense and aim to explore spectrum sharing paradigm that allows users to communicate in licensed, shared as well as unlicensed spectrum. Such ultra-dense networks will incur significant signaling load at base stations leading to a negative effect on spectrum and energy efficiency. To minimize signaling overhead, an ad-hoc approach is being considered for users communicating in the unlicensed and shared spectrums. For such users, decisions need to be completely decentralized as: 1) No communication between users and signaling from the base station is possible which necessitates independent channel selection at each user. A collision occurs when multiple users transmit simultaneously on the same channel, 2) Channel qualities may be heterogeneous, i.e., they are not same across all users, and moreover, are unknown, and 3) The network could be dynamic where users can enter or leave anytime. We develop a multi-armed bandit based distributed algorithm for static networks and extend it for the dynamic networks. The algorithms aim to achieve stable orthogonal allocation (SOC) in finite time and meet the above three constraints with two novel characteristics: 1) Low complexity narrowband radio compared to wideband radio in existing works, and 2) Epoch-less approach for dynamic networks. We establish convergence of our algorithms to SOC and validate via extensive simulation experiments.
Year
DOI
Venue
2019
10.1109/JSAC.2019.2934003
IEEE Journal on Selected Areas in Communications
Keywords
Field
DocType
Heuristic algorithms,Ad hoc networks,Sensors,Wideband,Base stations,Distributed algorithms,Resource management
Resource management,Base station,Next-generation network,Spectrum management,Efficient energy use,Computer science,Computer network,Communication channel,Distributed algorithm,Wireless ad hoc network
Journal
Volume
Issue
ISSN
37
10
0733-8716
Citations 
PageRank 
References 
1
0.35
0
Authors
2
Name
Order
Citations
PageRank
Sumit Jagdish Darak13616.39
Manjesh Kumar Hanawal29921.89