Title | ||
---|---|---|
Distributed Heuristically Accelerated Q-Learning for Robust Cognitive Spectrum Management in LTE Cellular Systems |
Abstract | ||
---|---|---|
In this paper we propose an algorithm for dynamic spectrum access (DSA) in LTE cellular systems - distributed ICIC accelerated Q-learning (DIAQ). It combines distributed reinforcement learning (RL) and standardized inter-cell interference coordination (ICIC) signalling in the LTE downlink, using the framework of heuristically accelerated RL (HARL). Furthermore, we present a novel Bayesian network based approach to theoretical analysis of RL based DSA. It explains a predicted improvement in the convergence behaviour achieved by DIAQ, compared to classical RL. The scheme is also assessed using large scale simulations of a stadium temporary event network. Compared to a typical heuristic ICIC approach, DIAQ provides significantly better quality of service and supports considerably higher network throughput densities. In addition, DIAQ dramatically improves initial performance, speeds up convergence and improves steady state performance of a state-of-the-art distributed Q-learning algorithm, confirming the theoretical predictions. Finally, our scheme is designed to comply with the current LTE standards. Therefore, it enables easy implementation of robust distributed machine intelligence for full self-organisation in existing commercial networks. |
Year | DOI | Venue |
---|---|---|
2016 | 10.1109/TMC.2015.2442529 | IEEE Trans. Mob. Comput. |
Keywords | Field | DocType |
Interference,Acceleration,Bayes methods,Heuristic algorithms,Learning (artificial intelligence),Computer architecture,Mobile computing | Heuristic,Spectrum management,Computer science,Q-learning,Computer network,Quality of service,Bayesian network,Throughput,Reinforcement learning,Distributed computing,Telecommunications link | Journal |
Volume | Issue | ISSN |
PP | 99 | 1536-1233 |
Citations | PageRank | References |
15 | 0.74 | 16 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Nils Morozs | 1 | 55 | 7.98 |
Tim Clarke | 2 | 102 | 20.02 |
David Grace | 3 | 136 | 18.01 |