Title
Elastic cooperative caching: an autonomous dynamically adaptive memory hierarchy for chip multiprocessors
Abstract
Next generation tiled microarchitectures are going to be limited by off-chip misses and by on-chip network usage. Furthermore, these platforms will run an heterogeneous mix of applications with very different memory needs, leading to significant optimization opportunities. Existing adaptive memory hierarchies use either centralized structures that limit the scalability or software based resource allocation that increases programming complexity. We propose Elastic Cooperative Caching, a dynamic and scalable memory hierarchy that adapts automatically and autonomously to application behavior for each node. Our configuration uses elastic shared/private caches with fully autonomous and distributed repartitioning units for better scalability. Furthermore, we have extended our elastic configuration with an Adaptive Spilling mechanism to use the shared cache space only when it can produce a performance improvement. Elastic caches allow both the creation of big local private caches for threads with high reuse of private data and the creation of big shared spaces from unused caches. Local data allocation in private regions allows to reduce network usage and efficient cache partitioning allows to reduce off-chip misses. The proposed scheme outperforms previous proposals by a minimum of 12% (on average across the benchmarks) and reduces the number of offchip misses by 16%. Plus, the dynamic and autonomous management of cache resources avoids the reallocation of cache blocks without reuse which results in an increase in energy efficiency of 24%.
Year
DOI
Venue
2010
10.1145/1815961.1816018
Proceedings of the 40th Annual International Symposium on Computer Architecture
Keywords
Field
DocType
energy efficient,resource allocation,chip
Memory hierarchy,Shared memory,Computer science,Cache,Adaptive memory,Parallel computing,False sharing,Real-time computing,Resource allocation,Cache coherence,Scalability,Distributed computing
Conference
Volume
Issue
ISSN
38
3
0163-5964
Citations 
PageRank 
References 
28
0.91
23
Authors
3
Name
Order
Citations
PageRank
Enric Herrero1643.43
José González2623.25
Ramon Canal375650.02