Title
Intelligent handover decision scheme using double deep reinforcement learning
Abstract
Handovers (HOs) have been envisioned to be more challenging in 5G networks due to the inclusion of millimetre wave (mm-wave) frequencies, resulting in more intense base station (BS) deployments. This, by its turn, increases the number of HOs taken due to smaller footprints of mm-wave BSs thereby making HO management a more crucial task as reduced quality of service (QoS) and quality of experience (QoE) along with higher signalling overhead are more likely with the growing number of HOs. In this paper, we propose an offline scheme based on double deep reinforcement learning (DDRL) to minimize the frequency of HOs in mm-wave networks, which subsequently mitigates the adverse QoS. Due to continuous and substantial state spaces arising from the inherent characteristics of the considered 5G environment, DDRL is preferred over conventional Q-learning algorithm. Furthermore, in order to alleviate the negative impacts of online learning policies in terms of computational costs, an offline learning framework is adopted in this study, a known trajectory is considered in a simulation environment while ray-tracing is used to estimate channel characteristics. The number of HO occurrence during the trajectory and the system throughput are taken as performance metrics. The results obtained reveal that the proposed method largely outperform conventional and other artificial intelligence (AI)-based models.
Year
DOI
Venue
2020
10.1016/j.phycom.2020.101133
Physical Communication
Keywords
DocType
Volume
Double deep reinforcement learning,Handover management,Millimetre-wave communication
Journal
42
ISSN
Citations 
PageRank 
1874-4907
3
0.43
References 
Authors
0
8
Name
Order
Citations
PageRank
Michael S. Mollel130.43
Attai Ibrahim Abubakar232.46
Metin Ozturk330.43
Shubi Kaijage432.46
Michael Kisangiri530.77
Ahmed Zoha61459.30
Muhammad Ali Imran72920278.27
Qammer H. Abbasi811637.12