Title
Optimization Of Resource Allocation In Multi-Cell Ofdm Systems: A Distributed Reinforcement Learning Approach
Abstract
In this paper, the problem of joint subcarrier and power allocation is studied for multi-cell orthogonal frequency-division multiplexing (OFDM) systems. This joint subcarrier and power resource allocation problem is formulated as an optimization problem whose goal is to maximize the system spectral efficiency. To solve the proposed problem, the original optimization problem is first decomposed into two subproblems: subcarrier allocation and power allocation. By solving these two subproblems, an initial subcarrier and power allocation scheme is accordingly obtained. An multi-agent reinforcement learning (MARL) algorithm is proposed to further increase the spectral efficiency. In particular, using the proposed MARL algorithm, each BS can adapt its allocation scheme according to the wireless environmental states. Numerical results show that the proposed MARL method can achieve up to 53.6% gain in terms of spectral efficiency compared to the conventional scheme. The proposed MARL scheme also converges more rapidly than the conventional single-agent Q-learning approach.
Year
DOI
Venue
2020
10.1109/PIMRC48278.2020.9217276
2020 IEEE 31ST ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC)
Keywords
DocType
ISSN
Resource allocation, multi-cell OFDM, multi-agent reinforcement learning
Conference
2166-9570
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Yuntao Hu101.01
Mingzhe Chen259544.32
Zhaohui Yang335833.48
Mingzhe Chen400.34
Guangyu Jia5153.97