Name
Title | ||
|---|---|---|
Context-Aware Proactive Caching for Heterogeneous Networks with Energy Harvesting: An Online Learning Approach |
Abstract | ||
|---|---|---|
In this paper, we investigate a context-aware proactive caching problem in a heterogeneous network consisting of a single macro-cell base station (MBS) with grid power supply and multiple small-cells with energy harvesting, aiming to maximize the service ratio at the small-cell base stations (SBSs) by designing an effective context-aware proactive caching policy. We first formulate this problem as a Markov Decision Process (MDP) framework. Then, to address the incomplete stochastic information about the system dynamics and the “curse of dimensionality” issue of the formulated MDP, we propose a Post-Decision State based Approximate Reinforcement Learning (PDS-ARL) algorithm, which learns on-the-fly the optimal proactive caching policy with a high learning efficiency. The simulation results validate the efficacy of our algorithm by comparing it with baselines in terms of both the learning rate and the service ratio performance at the SBSs. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1109/Cybermatics_2018.2018.00073 | 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) |
Keywords | Field | DocType |
Batteries,Energy harvesting,Approximation algorithms,Power supplies,Heuristic algorithms,Energy consumption,Heterogeneous networks | Approximation algorithm,Computer science,Markov decision process,Curse of dimensionality,System dynamics,Heterogeneous network,Energy consumption,Grid,Reinforcement learning,Distributed computing | Conference |
ISBN | Citations | PageRank |
978-1-5386-7975-3 | 0 | 0.34 |
References | Authors | |
0 | 2 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Huijin Cao | 1 | 23 | 2.67 |
| Jun Cai | 2 | 373 | 39.29 |