Title
DCAPS: dynamic cache allocation with partial sharing
Abstract
In a multicore system, effective management of shared last level cache (LLC), such as hardware/software cache partitioning, has attracted significant research attention. Some eminent progress is that Intel introduced Cache Allocation Technology (CAT) to its commodity processors recently. CAT implements way partitioning and provides software interface to control cache allocation. Unfortunately, CAT can only allocate at way level, which does not scale well for a large thread or program count to serve their various performance goals effectively. This paper proposes Dynamic Cache Allocation with Partial Sharing (DCAPS), a framework that dynamically monitors and predicts a multi-programmed workload's cache demand, and reallocates LLC given a performance target. Further, DCAPS explores partial sharing of a cache partition among programs and thus practically achieves cache allocation at a finer granularity. DCAPS consists of three parts: (1) Online Practical Miss Rate Curve (OPMRC), a low-overhead software technique to predict online miss rate curves (MRCs) of individual programs of a workload; (2) a prediction model that estimates the LLC occupancy of each individual program under any CAT allocation scheme; (3) a simulated annealing algorithm that searches for a near-optimal CAT scheme given a specific performance goal. Our experimental results show that DCAPS is able to optimize for a wide range of performance targets and can scale to a large core count.
Year
DOI
Venue
2018
10.1145/3190508.3190511
EuroSys '18: Thirteenth EuroSys Conference 2018 Porto Portugal April, 2018
Keywords
Field
DocType
cache partitioning,miss rate curve,multi-core architectures,cache allocation technology,cache occupancy
Simulated annealing,Software cache,Workload,Cache,Computer science,Thread (computing),Software,Granularity,Multi-core processor,Distributed computing
Conference
ISBN
Citations 
PageRank 
978-1-4503-5584-1
6
0.53
References 
Authors
31
6
Name
Order
Citations
PageRank
Yaocheng Xiang160.53
Xiaolin Wang2176.26
Zihui Huang3341.77
Zeyu Wang460.87
Yingwei Luo531541.30
Zhenlin Wang615015.89