Name
Title | ||
|---|---|---|
Learning through Reinforcement for Repeated Power Control Game in Cognitive Radio Networks |
Abstract | ||
|---|---|---|
This paper studies the repeated power control game in cognitive radio (CR) networks through reinforcement learning without channel and power strategy information exchange among CR users. Unlike traditional game-theoretical approaches on CR power control, this research solves the incomplete information power control problems for selfish and autonomous CR users for the first time. Each CR user in the problem only knows its own channel and power strategy while the information of primary users (PUs) and other different types of CR users are unknown. The formulated power control problem is a constrained repeated stochastic game with learning automaton. The objective of this repeated game is to maximize the average utility of each CR user under the interference power constraints of PUs. At each time step, the CR user only knows its own utility and the interference functions after the play but no further information. This power control game is proved to be asymptotically equivalent to the traditional game theory approaches. The properties of existence, diagonal concavity and uniqueness for this game are illustrated in detail. A Bush-Mosteller reinforcement learning procedure is designed for the power control algorithm. Finally, the learning based power control algorithm is implemented, and the simulation results with detailed analysis are shown to enforce the effectiveness of the proposed algorithms. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1109/GLOCOM.2010.5684316 | GLOBECOM |
Keywords | Field | DocType |
cognitive radio networks,power control,learning (artificial intelligence),interference power constraints,repeated stochastic game,cognitive radio,repeated power control game,power strategy information exchange,game theory,learning automaton,telecommunication control,bush-mosteller reinforcement learning,algorithm design and analysis,games,learning artificial intelligence,information exchange,repeated game,interference,nash equilibrium,cognitive radio network,reinforcement learning,probability distribution,incomplete information | Learning automata,Computer science,Power control,Repeated game,Game theory,Artificial intelligence,Nash equilibrium,Complete information,Stochastic game,Reinforcement learning | Conference |
ISSN | ISBN | Citations |
1930-529X E-ISBN : 978-1-4244-5637-6 | 978-1-4244-5637-6 | 4 |
PageRank | References | Authors |
0.53 | 5 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Pan Zhou | 1 | 123 | 16.76 |
| Yusun Chang | 2 | 73 | 9.02 |
| John A. Copeland | 3 | 456 | 60.84 |