Title
Pinpointing and Exploiting Opportunities for Enhancing Data Reuse
Abstract
The potential for improving the performance of data-intensive scientific programs by enhancing data reuse in cache is substantial because CPUs are significantly faster than memory. Traditional performance tools typically collect or simulate cache miss counts or rates and attribute them at the function level. While such information identifies program scopes that exhibit a large cache miss rate, it is often insufficient to diagnose the causes for poor data locality and to identify what program transformations would improve memory hierarchy utilization. This paper describes an approach that uses memory reuse distance to identify an application's most significant memory access patterns causing cache misses and provide insight into ways of improving data reuse. Unlike previous approaches, our tool combines (1) analysis and instrumentation of fully optimized binaries, (2) online analysisof reuse patterns, (3) fine-grain attribution of measurements and models to statements, loops and variables, and (4) static analysis of access patterns to quantify spatial reuse. We demonstrate the effectiveness of our approach for understanding reuse patterns in two scientific codes: one for simulating neutron transport and a second for simulating turbulent transport in burning plasmas. Our tools pinpointed opportunities for enhancing data reuse. Using this feedback as a guide, we transformed the codes, reducing their misses at various levels of the memory hierarchy by integer factors and reducing their execution time by as much as 60% and 33%, respectively.
Year
DOI
Venue
2008
10.1109/ISPASS.2008.4510744
ISPASS
Keywords
Field
DocType
large cache,enhancing data reuse,significant memory access pattern,online analysisof reuse pattern,data reuse,memory reuse distance,reuse pattern,memory hierarchy,spatial reuse,exploiting opportunities,memory hierarchy utilization,poor data locality,computer architecture,layout,computer science,neutrons,pattern analysis,integer factorization,computational modeling,static analysis,systems analysis,memory management
Locality,Memory hierarchy,Reuse,Cache,Computer science,Parallel computing,Systems analysis,Static analysis,Real-time computing,Memory management,Data reuse
Conference
Citations 
PageRank 
References 
12
0.69
13
Authors
2
Name
Order
Citations
PageRank
Gabriel Marin169835.97
John Mellor-Crummey286876.69