Title
RLDRM: Closed Loop Dynamic Cache Allocation with Deep Reinforcement Learning for Network Function Virtualization
Abstract
Network function virtualization (NFV) technology attracts tremendous interests from telecommunication industry and data center operators, as it allows service providers to assign resource for Virtual Network Functions (VNFs) on demand, achieving better flexibility, programmability, and scalability. To improve server utilization, one popular practice is to deploy best effort (BE) workloads along with high priority (HP) VNFs when high priority VNF's resource usage is detected to be low. The key challenge of this deployment scheme is to dynamically balance the Service level objective (SLO) and the total cost of ownership (TCO) to optimize the data center efficiency under inherently fluctuating workloads. With the recent advancement in deep reinforcement learning, we conjecture that it has the potential to solve this challenge by adaptively adjusting resource allocation to reach the improved performance and higher server utilization. In this paper, we present a closed-loop automation system RLDRM <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">11</sup> RLDRM: Reinforcement Learning Dynamic Resource Management to dynamically adjust Last Level Cache allocation between HP VNFs and BE workloads using deep reinforcement learning. The results demonstrate improved server utilization while maintaining required SLO for the HP VNFs.
Year
DOI
Venue
2020
10.1109/NetSoft48620.2020.9165471
2020 6th IEEE Conference on Network Softwarization (NetSoft)
Keywords
DocType
ISBN
deep reinforcement learning,network function virtualization technology,telecommunication industry,data center operators,service providers,high priority VNF resource usage,deployment scheme,service level objective,data center efficiency,resource allocation,higher server utilization,closed-loop automation system RLDRM,reinforcement learning dynamic resource management,level cache allocation,HP VNF,virtual network functions,loop dynamic cache allocation,SLO,total cost of ownership,TCO
Conference
978-1-7281-5685-9
Citations 
PageRank 
References 
0
0.34
21
Authors
11
Name
Order
Citations
PageRank
Bin Li192494.55
Yipeng Wang221625.38
Ren Wang3868.85
Charlie Tai4282.95
Ravishankar K. Iyer5111975.72
Zhu Zhou600.34
Andrew Herdrich7494.10
Tong Zhang800.68
Ameer Haj Ali9153.29
I. Stoica10214061710.11
Krste Asanović112975226.80