Title
Dynamic optimization of intersatellite link assignment based on reinforcement learning
Abstract
Intersatellite links can reduce the dependence of satellite communication systems on ground networks, reduce the number of ground gateways, and reduce the complexity and investment of ground networks, which are important future trends in satellite development. Intersatellite links are dynamic over time, and different intersatellite topologies have a great impact on satellite network performance. To improve the overall performance of satellite networks, a satellite link assignment optimization algorithm based on reinforcement learning is proposed in this article. Different from the swarm intelligence method in principle, this algorithm models the combinatorial optimization problem of links as the optimal sequence decision problem of a series of link selection actions. Realistic constraints such as intersatellite visibility, network connectivity, and number of antenna beams are regarded as fully observable environmental factors. The agent selects the link according to the decision, and the selection action utility affects the next selection decision. After a finite number of iterations, the optimal link assignment scheme with minimum link delay is achieved. The simulation results show that in 8 or 12 satellite network systems, compared with the original topology, the topology calculated by this method has better network delay and smaller delay variance.
Year
DOI
Venue
2022
10.1177/15501477211070202
INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS
Keywords
DocType
Volume
Satellite link assignment, intersatellite link, intersatellite topology, reinforcement learning, network delay
Journal
18
Issue
ISSN
Citations 
2
1550-1477
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Weiwu Ren100.34
Jialin Zhu200.34
Hui Qi311.70
Ligang Cong401.35
Xiaoqiang Di504.39