Title
Delay-Aware Scheduling over mmWave/Sub-6 Dual Interfaces: A Reinforcement Learning Approach
Abstract
We consider a transmitter with mmWave/sub6 dual interfaces. Due to the intermittency of mmWave channel, the transmitter must schedule packets wisely across the interfaces to minimize the average delay by observing the system state. We use the well-known dynamic programming methods and Q-learning to find the optimal scheduling policy and investigate the influence of observing CSI on the optimal policy under different levels of knowledge of the environment. We find that only when the channel state transition model is not available, the instantaneous CSI can help in reducing system delay.
Year
DOI
Venue
2020
10.1109/ICCWorkshops49005.2020.9145135
2020 IEEE International Conference on Communications Workshops (ICC Workshops)
Keywords
DocType
ISSN
scheduling,millimeter wave,5G,sub-6 GHz
Conference
2164-7038
ISBN
Citations 
PageRank 
978-1-7281-7440-2
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Cao Ying100.34
Bo Sun2143.93
Tsang Danny H. K.300.34