Title
A Reinforcement Learning-Based QAM/PSK Symbol Synchronizer
Abstract
Machine Learning (ML) based on supervised and unsupervised learning models has been recently applied in the telecommunication field. However, such techniques rely on application-specific large datasets and the performance deteriorates if the statistics of the inference data changes over time. Reinforcement Learning (RL) is a solution to these issues because it is able to adapt its behavior to the changing statistics of the input data. In this work, we propose the design of an RL Agent able to learn the behavior of a Timing Recovery Loop (TRL) through the Q-Learning algorithm. The Agent is compatible with popular PSK and QAM formats. We validated the RL synchronizer by comparing it to the Mueller and Muller TRL in terms of Modulation Error Ratio (MER) in a noisy channel scenario. The results show a good trade-off in terms of MER performance. The RL based synchronizer loses less than 1 dB of MER with respect to the conventional one but it is able to adapt its behavior to different modulation formats without the need of any tuning for the system parameters.
Year
DOI
Venue
2019
10.1109/ACCESS.2019.2938390
IEEE ACCESS
Keywords
DocType
Volume
Artificial intelligence,machine learning,reinforcement learning,Q-learning,synchronization,timing recovery loop
Journal
7
ISSN
Citations 
PageRank 
2169-3536
0
0.34
References 
Authors
0
8
Name
Order
Citations
PageRank
Marco Matta100.68
Gian-carlo Cardarilli211020.75
Luca Di Nunzio3119.61
Rocco Fazzolari4119.36
Daniele Giardino513.39
Alberto Nannarelli619020.41
Marco Re719435.03
Sergio Spano822.45