Title
Deep Reinforcement Learning for D2D transmission in unlicensed bands
Abstract
In this paper, a reinforcement learning based approach is proposed to realize the distributed power and spectrum allocation for the Device-to-Device (D2D) communications in unlicensed bands, named as D2D-U. To guarantee the harmonious coexistence with the WiFi networks, the conventional duty-cycle muting (DCM) is employed by the D2D-U links. With the proposed learning approach, D2D-U links can optimally select the time fraction on unlicensed channels without knowing the accurate WiFi traffic in a dynamic WiFi working environment. To address the state space explosion during the learning process, the Deep Q-learning network (DQN) is adopted by combining a deep neural network (DNN) with the traditional Q-learning mechanism. After obtaining the available time fraction on unlicensed channels, the spectrum and power allocation on licensed and unlicensed bands can be optimized jointly via the classic convex optimization methods at each D2D-U link. Numerical results are demonstrated to verify the effectiveness of the proposed approach.
Year
DOI
Venue
2019
10.1109/ICCChinaW.2019.8849971
2019 IEEE/CIC International Conference on Communications Workshops in China (ICCC Workshops)
Keywords
Field
DocType
reinforcement learning based approach,spectrum allocation,dynamic WiFi working environment,deep neural network,power allocation,device-to-device communications,deep Q-learning network,time fraction availability,duty-cycle muting,WiFi traffic networks,deep reinforcement learning,D2D-U link transmission,D2D communications,DCM,state space explosion,DNN,convex optimization methods
Unlicensed band,Distributed power,Computer science,Computer network,Communication channel,Frequency allocation,Artificial neural network,Convex optimization,State space,Reinforcement learning
Conference
ISSN
ISBN
Citations 
2474-9133
978-1-7281-0739-4
0
PageRank 
References 
Authors
0.34
9
4
Name
Order
Citations
PageRank
Zhiqun Zou100.34
Rui Yin212911.38
Xianfu Chen350043.45
w u celimuge447949.53