Title
CARTAD: Compiler-Assisted Reinforcement Learning for Thermal-Aware Task Scheduling and DVFS on Multicores
Abstract
As the power density of modern CPUs is gradually increasing, thermal management has become one of the primary concerns for multicore systems, where task scheduling and dynamic voltage/frequency scaling (DVFS) play a pivotal role in effectively managing the system temperature. In this article, we propose <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">CARTAD</i> , a new reinforcement learning (RL)-based task scheduling and DVFS method for temperature minimization and latency guarantee on multicore systems. The novelty of <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">CARTAD</i> framework is that we exploit the machine learning technique to analyze the applications’ intermediate representations (IRs) generated by a compiler and identify an important feature which is critical for predicting the application’s performance. With the newly explored feature, we construct an RL-based scheduler with the more effective state representation and reward function such that the system temperature can be minimized while guaranteeing applications’ latency. We implement and evaluate <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">CARTAD</i> on real platforms in comparison with the state-of-the-art approaches. Experimental results show <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">CARTAD</i> can reduce the maximum temperature by up to 16 °C and the average temperature by up to 10 °C.
Year
DOI
Venue
2022
10.1109/TCAD.2021.3095028
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Keywords
DocType
Volume
Compiler,dynamic voltage/frequency scaling (DVFS),reinforcement learning (RL),task scheduling
Journal
41
Issue
ISSN
Citations 
6
0278-0070
0
PageRank 
References 
Authors
0.34
17
5
Name
Order
Citations
PageRank
Di Liu111.71
Shi-Gui Yang200.34
Zhenli He321.72
Mingxiong Zhao4324.90
Weichen Liu501.35