Title | ||
---|---|---|
Uav-Enabled Computation Migration For Complex Missions: A Reinforcement Learning Approach |
Abstract | ||
---|---|---|
The implementationof computation offloading is a challenging issue in the remote areas where traditional edge infrastructures are sparsely deployed. In this study, the authors propose a unmanned aerial vehicle (UAV)-enabled edge computing framework, where a group of UAVs fly around to provide the near-users edge computing service. They study the computation migration problem for the complex missions, which can be decomposed as some typical task-flows considering the inter-dependency of tasks. Each time a task appears, it should be allocated to a proper UAV for execution, which is defined as the computation migration or task migration. Since the UAV-ground communication data rate is strongly associated with the UAV location, selecting a proper UAV to execute each task will largely benefit the missions response time. They formulate the computation migration decision making problem as a Markov decision process, in which the state contains the extracted observations from the environment. To cope with the dynamics of the environment, they propose an advantage actor-critic reinforcement learning approach to learn the near-optimal policy on-the-fly. Simulation results show that the proposed approach has a desirable convergence property, and can significantly reduce the average response time of missions compared with the benchmark greedy method. |
Year | DOI | Venue |
---|---|---|
2020 | 10.1049/iet-com.2019.1188 | IET COMMUNICATIONS |
Keywords | DocType | Volume |
decision making, learning (artificial intelligence), autonomous aerial vehicles, remotely operated vehicles, Markov processes, UAV-enabled computation migration, complex missions, reinforcement learning approach, computation offloading, remote areas, traditional edge infrastructures, unmanned aerial vehicle-enabled edge, near-users edge computing service, computation migration problem, typical task-flows, proper UAV, UAV-ground communication data rate, UAV location, missions response time, computation migration decision making problem, advantage actor-critic reinforcement, average response time | Journal | 14 |
Issue | ISSN | Citations |
15 | 1751-8628 | 2 |
PageRank | References | Authors |
0.36 | 0 | 6 |
Name | Order | Citations | PageRank |
---|---|---|---|
Shichao Zhu | 1 | 6 | 2.11 |
Lin Gui | 2 | 50 | 5.81 |
Nan Cheng | 3 | 970 | 81.34 |
Qi Zhang | 4 | 931 | 179.66 |
Fei Sun | 5 | 23 | 7.74 |
Xiupu Lang | 6 | 8 | 1.09 |