Name
Title | ||
|---|---|---|
Resource Allocation in Energy Harvesting Multiple Access Scenarios via Combinatorial Learning |
Abstract | ||
|---|---|---|
The allocation of K orthogonal resources aiming at maximizing the throughput in an energy harvesting (EH) multiple access scenario is considered. In this setting, the optimal resource allocation (RA) depends on the transmitters' EH and channel fading processes. However, in realistic scenarios, only causal knowledge of these processes is available. We first formulate the offline optimization problem and identify two main challenges, namely, how to exploit causal knowledge to maximize the throughput and how to handle the high dimensionality of the problem. To address these challenges, we propose a novel reinforcement learning (RL) algorithm, termed combinatorial RL (cRL). The name stands for its ability to handle the combinatorial nature of the RA solutions. Exploiting the available causal knowledge, we learn the RA policy aiming at maximizing the throughput. Furthermore, we overcome the curse of dimensionality, typical of combinatorial problems, by splitting the learning task, solving K + 1 smaller RL problems and using linear function approximation. Through numerical simulations, we show that cRL outperforms known strategies like random and greedy as well as other RL approaches. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/SPAWC.2019.8815452 | 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) |
Keywords | Field | DocType |
combinatorial learning,K orthogonal resources,energy harvesting multiple access scenario,optimal resource allocation,offline optimization problem,reinforcement learning algorithm,RA policy,combinatorial problems,learning task,linear function approximation,combinatorial RL | Mathematical optimization,Fading,Computer science,Communication channel,Exploit,Curse of dimensionality,Resource allocation,Throughput,Linear function,Reinforcement learning | Conference |
ISSN | ISBN | Citations |
1948-3244 | 978-1-5386-6529-9 | 0 |
PageRank | References | Authors |
0.34 | 8 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Andrea Ortiz | 1 | 0 | 0.34 |
| Tobias Weber | 2 | 93 | 15.46 |
| Anja Klein | 3 | 173 | 89.48 |