Title
Jamming Strategy Optimization through Dual Q-Learning Model against Adaptive Radar
Abstract
Modern adaptive radars can switch work modes to perform various missions and simultaneously use pulse parameter agility in each mode to improve survivability, which leads to a multiplicative increase in the decision-making complexity and declining performance of the existing jamming methods. In this paper, a two-level jamming decision-making framework is developed, based on which a dual Q-learning (DQL) model is proposed to optimize the jamming strategy and a dynamic method for jamming effectiveness evaluation is designed to update the model. Specifically, the jamming procedure is modeled as a finite Markov decision process. On this basis, the high-dimensional jamming action space is disassembled into two low-dimensional subspaces containing jamming mode and pulse parameters respectively, then two specialized Q-learning models with interaction are built to obtain the optimal solution. Moreover, the jamming effectiveness is evaluated through indicator vector distance measuring to acquire the feedback for the DQL model, where indicators are dynamically weighted to adapt to the environment. The experiments demonstrate the advantage of the proposed method in learning radar joint strategy of mode switching and parameter agility, shown as improving the average jamming-to-signal radio (JSR) by 4.05% while reducing the convergence time by 34.94% compared with the normal Q-learning method.
Year
DOI
Venue
2022
10.3390/s22010145
SENSORS
Keywords
DocType
Volume
adaptive radar, jamming strategy optimizing, reinforcement learning, Q-learning, jamming effectiveness evaluation
Journal
22
Issue
ISSN
Citations 
1
1424-8220
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Hongdi Liu100.34
Hongtao Zhang200.34
Yuan He3101281.82
Yong Sun400.34