Title
ECM: Effective Capacity Maximizer for high-performance compressed caching
Abstract
Compressed Last-Level Cache (LLC) architectures have been proposed to enhance system performance by efficiently increasing the effective capacity of the cache, without physically increasing the cache size. In a compressed cache, the cacheline size varies depending on the achieved compression ratio. We observe that this size information gives a useful hint when selecting a victim, which can lead to increased cache performance. However, no replacement policy tailored to compressed LLCs has been investigated so far. This paper introduces the notion of size-aware compressed cache management as a way to maximize the performance of compressed caches. Toward this end, the Effective Capacity Maximizer (ECM) scheme is introduced, which targets compressed LLCs. The proposed mechanism revolves around three fundamental principles: Size-Aware Insertion (SAI), a Dynamically Adjustable Threshold Scheme (DATS), and Size-Aware Replacement (SAR). By adjusting the eviction criteria, based on the compressed data size, one may increase the effective cache capacity and minimize the miss penalty. Extensive simulations with memory traces from real applications running on a full-system simulator demonstrate significant improvements compared to compressed cache schemes employing the conventional Least-Recently Used (LRU) and Dynamic Re-Reference Interval Prediction (DRRIP) [11] replacement policies. Specifically, ECM shows an average effective capacity increase of 15% over LRU and 18.8% over DRRIP, an average cache miss reduction of 9.4% over LRU and 3.9% over DRRIP, and an average system performance improvement of 6.2% over LRU and 3.3% over DRRIP.
Year
DOI
Venue
2013
10.1109/HPCA.2013.6522313
HPCA
Keywords
Field
DocType
effective cache capacity,cache management,average system performance improvement,replacement policy,cacheline size,cache scheme,cache size,data size,effective capacity maximizer,increased cache performance,average cache
Cache invalidation,Cache pollution,Computer science,CPU cache,Cache,Parallel computing,Real-time computing,Cache algorithms,Cache coloring,Smart Cache,Adaptive replacement cache
Conference
ISSN
Citations 
PageRank 
1530-0897
10
0.53
References 
Authors
14
5
Name
Order
Citations
PageRank
Seungcheol Baek1733.63
Hyung Gyu Lee257242.41
Chrysostomos Nicopoulos383550.37
Junghee Lee422627.26
Jongman Kim577037.65