Paper Info
Title
Taming Single-Thread Program Performance on Many Distributed On-Chip L2 Caches
Abstract
This paper presents a two-part study on managing distributed NUCA (Non-Uniform Cache Architecture) L2caches in a future many core processor to obtain high single thread program performance. The first part of our study is a limit study where we determine data to cache slice mappings at the memory page granularity based on detailed inter-page conflict information derived from program's memory reference trace. By considering cache access latency and cache miss rate simultaneously when mapping data to L2 cache slices, this "oracle" scheme outperforms the conventional shared caching scheme by up to 208% with an average of 45% on a sixteen-core processor. In the second part of the study, we propose and evaluate a dynamic cache management scheme that determines the home cache slice and cache bin for memory pages without any static program information. The dynamic scheme outperforms the shared caching scheme by up to 191% with an average of 32%, achieving much of the performance we observed in the limit study. We also find that the proposed dynamic scheme adapts to multiprogrammed workloads' behavior well and performs significantly better than both the private caching scheme and the shared caching scheme.
Year
DOI
Venue
2008
10.1109/ICPP.2008.29
ICPP
Keywords
Field
DocType
dynamic scheme,dynamic cache management scheme,cache access latency,conventional shared caching scheme,l2 cache slice,single-thread program performance,private caching scheme,limit study,caching scheme,on-chip l2 caches,cache bin,proposed dynamic scheme adapts,optimization,distributed processing,performance,system on a chip,cost function,multicore,chip,art
Cache invalidation,Cache pollution,Computer science,Cache,Parallel computing,Cache algorithms,Page cache,Cache coloring,Bus sniffing,Smart Cache
Conference
Citations 
PageRank 
References 
3
0.39
16
Authors
2
Name
Order
Citations
PageRank
Lei Jin16010.34
Sangyeun Cho2129473.92