Title
A coordinated multi-agent reinforcement learning approach to multi-level cache co-partitioning.
Abstract
The widening gap between the processor and memory performance has led to the inclusion of multiple levels of caches in the modern multi-core systems. Processors with simultaneous multithreading (SMT) support multiple hardware threads on the same physical core, which results in shared private caches. Any inefficiency in the cache hierarchy can negatively impact the system performance and motivates the need to perform a co-optimization of multiple cache levels by trading off individual application throughput for better system throughput and energy-delay-product (EDP). We propose a novel coordinated multi-agent reinforcement learning technique for performing Dynamic Cache Co-partitioning, called Machine Learned Caches (MLC). MLC has low implementation overhead and does not require any special hardware data profilers. We have validated our proposal with 15 8-core workloads created using Spec2006 benchmarks and found it to be an effective co-partitioning technique. MLC exhibited system throughput and EDP improvements of up to 14% (gmean:9.35%) and 19.2% (gmean: 13.5%) respectively. We believe this is the first attempt at addressing the problem of multi-level cache co-partitioning.
Year
Venue
Field
2017
DATE
Computer science,CPU cache,Cache,Real-time computing,Cache coloring,Multi-core processor,Cache-oblivious algorithm,Computer architecture,Cache pollution,Parallel computing,Cache algorithms,Smart Cache,Embedded system
DocType
ISSN
Citations 
Conference
1530-1591
0
PageRank 
References 
Authors
0.34
16
3
Name
Order
Citations
PageRank
Jain, Rahul111.03
Preeti Ranjan Panda278689.40
Sreenivas Subramoney312713.60