Title
SMig-RL: An Evolutionary Migration Framework for Cloud Services Based on Deep Reinforcement Learning
Abstract
AbstractService migration is an often-used approach in cloud computing to minimize the access cost by moving the service close to most users. Although it is effective in a certain sense, the service migration in existing research still suffers from some deficiencies in its evolutionary abilities in scalability, sensitivity, and adaptability to effectively react to the dynamically changing environments. This article proposes an evolutionary framework based on deep reinforcement learning for virtual service migration in large-scale mobile cloud centers. To enhance the spatio-temporal sensitivity of the algorithm, we design a scalable reward function for virtual service migration, redefine the input state, and add a Recurrent Neural Network (RNN) to the learning framework. Additionally, in order to enhance the adaptability of the algorithm, we also decompose the action space and exploit the network cost to adjust the number of virtual machine (VMs). The experimental results show that, compared with the existing results, the migration strategy generated by the algorithm can not only significantly reduce the total service cost and achieve the load balancing at the same time, but also address the burst situations with low cost in dynamic environments.
Year
DOI
Venue
2020
10.1145/3414840
ACM Transactions on Internet Technology
Keywords
DocType
Volume
Cloud computing, dynamic service migration, mobile access, deep rein-forcement learning, Q-learning, RNN
Journal
20
Issue
ISSN
Citations 
4
1533-5399
0
PageRank 
References 
Authors
0.34
12
4
Name
Order
Citations
PageRank
Hongshuai Ren100.34
Yang Wang24010.41
Z. Chen33443271.62
Chen Xi414.11