Title
Uav-Enabled Computation Migration For Complex Missions: A Reinforcement Learning Approach
Abstract
The implementationof computation offloading is a challenging issue in the remote areas where traditional edge infrastructures are sparsely deployed. In this study, the authors propose a unmanned aerial vehicle (UAV)-enabled edge computing framework, where a group of UAVs fly around to provide the near-users edge computing service. They study the computation migration problem for the complex missions, which can be decomposed as some typical task-flows considering the inter-dependency of tasks. Each time a task appears, it should be allocated to a proper UAV for execution, which is defined as the computation migration or task migration. Since the UAV-ground communication data rate is strongly associated with the UAV location, selecting a proper UAV to execute each task will largely benefit the missions response time. They formulate the computation migration decision making problem as a Markov decision process, in which the state contains the extracted observations from the environment. To cope with the dynamics of the environment, they propose an advantage actor-critic reinforcement learning approach to learn the near-optimal policy on-the-fly. Simulation results show that the proposed approach has a desirable convergence property, and can significantly reduce the average response time of missions compared with the benchmark greedy method.
Year
DOI
Venue
2020
10.1049/iet-com.2019.1188
IET COMMUNICATIONS
Keywords
DocType
Volume
decision making, learning (artificial intelligence), autonomous aerial vehicles, remotely operated vehicles, Markov processes, UAV-enabled computation migration, complex missions, reinforcement learning approach, computation offloading, remote areas, traditional edge infrastructures, unmanned aerial vehicle-enabled edge, near-users edge computing service, computation migration problem, typical task-flows, proper UAV, UAV-ground communication data rate, UAV location, missions response time, computation migration decision making problem, advantage actor-critic reinforcement, average response time
Journal
14
Issue
ISSN
Citations 
15
1751-8628
2
PageRank 
References 
Authors
0.36
0
6
Name
Order
Citations
PageRank
Shichao Zhu162.11
Lin Gui2505.81
Nan Cheng397081.34
Qi Zhang4931179.66
Fei Sun5237.74
Xiupu Lang681.09