Title
A Cross-Layer Routing Protocol Based on Quasi-Cooperative Multi-Agent Learning for Multi-Hop Cognitive Radio Networks.
Abstract
Transmission latency minimization and energy efficiency improvement are two main challenges in multi-hop Cognitive Radio Networks (CRN), where the knowledge of topology and spectrum statistics are hard to obtain. For this reason, a cross-layer routing protocol based on quasi-cooperative multi-agent learning is proposed in this study. Firstly, to jointly consider the end-to-end delay and power efficiency, a comprehensive utility function is designed to form a reasonable tradeoff between the two measures. Then the joint design problem is modeled as a Stochastic Game (SG), and a quasi-cooperative multi-agent learning scheme is presented to solve the SG, which only needs information exchange with previous nodes. To further enhance performance, experience replay is applied to the update of conjecture belief to break the correlations and reduce the variance of updates. Simulation results demonstrate that the proposed scheme is superior to traditional algorithms leading to a shorter delay, lower packet loss ratio and higher energy efficiency, which is close to the performance of an optimum scheme.
Year
DOI
Venue
2019
10.3390/s19010151
SENSORS
Keywords
Field
DocType
cognitive radio,cross-layer routing protocol,experience replay,quasi-cooperative multi-agent learning,stochastic game
Electrical efficiency,Mathematical optimization,Efficient energy use,Information exchange,Packet loss,Electronic engineering,Minification,Engineering,Stochastic game,Routing protocol,Cognitive radio
Journal
Volume
Issue
ISSN
19
1.0
1424-8220
Citations 
PageRank 
References 
0
0.34
15
Authors
4
Name
Order
Citations
PageRank
Yihang Du100.34
Chun Chen200.34
Pengfei Ma303.04
Lei Xue410316.03