Title
Co-Manage Power Delivery and Consumption for Manycore Systems Using Reinforcement Learning
Abstract
Maintaining high energy efficiency has become a critical design issue for high-performance systems. Many power management techniques have been proposed for the processor cores such as dynamic voltage and frequency scaling (DVFS). However, very few solutions consider the power losses suffered on the power delivery system (PDS), despite the fact that they have a significant impact on the system overall energy efficiency. With the explosive growth of system complexity and highly dynamic workloads variations, it is challenging to find the optimal power management policies which can effectively match the power delivery with the power consumption. To tackle the above problems, we propose a reinforcement learning-based power management scheme for manycore systems to jointly monitor and adjust both the PDS and the processor cores aiming to improve system overall energy efficiency. The learning agents distributed across power domains not only manage the power states of processor cores but also control the on/off states of on-chip VRs to proactively adapt to the workload variations. Experimental results with realistic applications show that when the proposed approach is applied to a large-scale system with a hybrid PDS, it lowers the system overall energy-delay-product (EDP) by 41% than a traditional monolithic DVFS approach with a bulky off-chip VR.
Year
DOI
Venue
2018
10.1145/3240765.3240787
2018 IEEE/ACM International Conference on Computer-Aided Design (ICCAD)
Keywords
Field
DocType
power delivery system,reinforcement learning,energy efficiency,dynamic power management,voltage regulators
Power management,Power domains,System on a chip,Efficient energy use,Computer science,Real-time computing,Frequency scaling,Multi-core processor,Voltage regulator,Reinforcement learning,Distributed computing
Conference
ISSN
ISBN
Citations 
1933-7760
978-1-5386-7502-1
1
PageRank 
References 
Authors
0.41
19
6
Name
Order
Citations
PageRank
Haoran Li1206.33
Zhongyuan Tian273.56
Rafael Kioji Vivas Maeda3247.09
Xuanqi Chen465.31
Jun Feng544.91
Jiang Xu670461.98