Title
Multi-Armed Bandit for Energy-Efficient and Delay-Sensitive Edge Computing in Dynamic Networks With Uncertainty
Abstract
In the edge computing paradigm, mobile devices offload the computational tasks to an edge server by routing the required data over the wireless network. The full potential of edge computing becomes realized only if a smart device selects the most appropriate server in terms of the latency and energy consumption, among many available ones. The server selection problem is challenging due to the randomness of the environment and lack of prior information about the same. Therefore, a smart device, which sequentially chooses a server under uncertainty, aims to improve its decision based on the historical time and energy consumption. The problem becomes more complicated in a dynamic environment, where key variables might undergo abrupt changes. To deal with the aforementioned problem, we first analyze the required time and energy to data transmission and processing. We then use the analysis to cast the problem as a budget-limited multi-armed bandit problem, where each arm is associated with a reward and cost, with time-variant statistical characteristics. We propose a policy to solve the formulated problem and prove a regret bound. The numerical results demonstrate the superiority of the proposed method compared to several online learning algorithms.
Year
DOI
Venue
2019
10.1109/TCCN.2020.3012445
IEEE Transactions on Cognitive Communications and Networking
Keywords
DocType
Volume
Computation offloading,edge computing,non-stationary decision-making,multi-armed bandits,uncertainty
Journal
7
Issue
ISSN
Citations 
1
2332-7731
3
PageRank 
References 
Authors
0.43
0
2
Name
Order
Citations
PageRank
Saeed Ghoorchian130.43
Setareh Maghsudi215416.41