Paper Info
Title
Deep Q-Learning-Based Transmission Power Control of a High Altitude Platform Station with Spectrum Sharing
Abstract
A High Altitude Platform Station (HAPS) can facilitate high-speed data communication over wide areas using high-power line-of-sight communication; however, it can significantly interfere with existing systems. Given spectrum sharing with existing systems, the HAPS transmission power must be adjusted to satisfy the interference requirement for incumbent protection. However, excessive transmission power reduction can lead to severe degradation of the HAPS coverage. To solve this problem, we propose a multi-agent Deep Q-learning (DQL)-based transmission power control algorithm to minimize the outage probability of the HAPS downlink while satisfying the interference requirement of an interfered system. In addition, a double DQL (DDQL) is developed to prevent the potential risk of action-value overestimation from the DQL. With a proper state, reward, and training process, all agents cooperatively learn a power control policy for achieving a near-optimal solution. The proposed DQL power control algorithm performs equal or close to the optimal exhaustive search algorithm for varying positions of the interfered system. The proposed DQL and DDQL power control yields the same performance, which indicates that the actional value overestimation does not adversely affect the quality of the learned policy.
Year
DOI
Venue
2022
10.3390/s22041630
SENSORS
Keywords
DocType
Volume
Deep Q-learning (DQL), Double Deep Q-learning (DDQL), dynamic spectrum sharing, High Altitude Platform Station (HAPS), cellular communications, power control, interference management
Journal
22
Issue
ISSN
Citations 
4
1424-8220
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Seongjun Jo100.34
Wooyeol Yang200.34
Haing Kun Choi300.34
Eonsu Noh400.34
Han-Shin Jo5120575.15
Jaedon Park600.34