Title
Edge Caching For Iot Transient Data Using Deep Reinforcement Learning
Abstract
Connected devices generate large amount of data for IoT applicatons. Assisted by edge computing, caching IoT data at the edge nodes is considered as a promising technique for its advantage in reducing network traffic and service delay of cloud platform. However, the IoT data is characterized by transient lifetime and cache capacity that is limited by the edge nodes. As a consequence, caching policy should consider both data transiency and storage capacity of edge nodes. Inspired by the success of deep reinforcement learning (DRL) in deal with Markov Decision Process (MDP) problem in unknown environment, A DRL-based algorithm for edge caching problem is proposed in this paper. The proposed Advantage Actor Critic (A2C)-based algorithm is aimed at maximizing the long-term energy saving without knowledge of the IoT data popularity profiles. Simulation results demonstrate that the proposed DRL-based algorithm can achieve higher energy saving and cache hit ratio compared with the baseline algorithms.
Year
DOI
Venue
2020
10.1109/IECON43393.2020.9255111
IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY
Keywords
DocType
ISSN
Edge caching, IoT transient data, deep reinforcement learning
Conference
1553-572X
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Shuran Sheng100.34
Peng Chen2555.99
Zhimin Chen3397.93
Lenan Wu470062.18
Hao Jiang5179.24