Title
Downlink Power Control for Cell-Free Massive MIMO With Deep Reinforcement Learning
Abstract
Recently, model-free power control approaches have been developed to achieve the near-optimal performance of cell-free (CF) massive multiple-input multiple-output (MIMO) with affordable computational complexity. In particular, deep reinforcement learning (DRL) is one of such promising techniques for realizing effective power control. In this paper, we propose a model-free method adopting the deep deterministic policy gradient algorithm (DDPG) with feedforward neural networks (NNs) to solve the downlink max-min power control problem in CF massive MIMO systems. Our result shows that compared with the conventional convex optimization algorithm, the proposed DDPG method can effectively strike a performance-complexity trade-off obtaining 1,000 times faster implementation speed and approximately the same achievable user rate as the optimal solution produced by conventional numerical convex optimization solvers, thereby offering effective power control implementations for large-scale systems. Finally, we extend the DDPG algorithm to both the max-sum and the max-product power control problems, while achieving better performance than that achieved by the conventional deep learning algorithm.
Year
DOI
Venue
2022
10.1109/TVT.2022.3162585
IEEE Transactions on Vehicular Technology
Keywords
DocType
Volume
Beyond 5-G network,cell-free massive MIMO,deep rein- forcement learning,power control,DDPG,downlink
Journal
71
Issue
ISSN
Citations 
6
0018-9545
1
PageRank 
References 
Authors
0.35
10
6
Name
Order
Citations
PageRank
Lirui Luo110.69
Jiayi Zhang291174.44
Shuaifei Chen3265.09
Xiaodan Zhang4258.37
Bo Ai51581185.94
Derrick Wing Kwan Ng63588189.08