Paper Info
Title
The Efficacy of Software Prefetching and Locality Optimizations on Future Memory Systems
Abstract
Software prefetching and locality optimizations are techniques for overcoming the speed gap between processor and memory. In this paper, we provide a comprehensive summary of current software prefetching and locality optimization techniques, and evaluate the impact of memory trends on the effectiveness of these techniques for three types of applications: regular scientific codes, irregular scientific codes, and pointer-chasing codes. We find that for many applications, software prefetching outperforms locality optimizations when there is sufficient memory bandwidth, but locality optimizations outperform software prefetching under bandwidth-limited conditions. The break-even point (for 1 GHz processors) occurs at roughly 2.26 GBytes/sec on today's memory systems, and will increase on future memory systems. We also study the interactions between software prefetching and locality optimizations when applied in concert. Naively combining the techniques provides robustness to changes in memory bandwidth and latency, but does not yield additional performance gains. We propose and evaluate several algorithms to better integrate software prefetching and locality optimizations, including a modified tiling algorithm, padding for prefetching, and index prefetching. Finally, we investigate the interactions of stride-based hardware prefetching with our software techniques. We find that combining hardware and software prefetching yields similar performance to software prefetching alone, and that locality optimizations enable stride-based hardware prefetching for benchmarks that do not normally exhibit striding.
Year
Venue
Keywords
2004
J. Instruction-Level Parallelism
memory bandwidth,indexation
Field
DocType
Volume
Locality,Memory bandwidth,Latency (engineering),Computer science,Parallel computing,Real-time computing,Robustness (computer science),Software,Software prefetching,Memory systems,Padding
Journal
6
Citations 
PageRank 
References 
21
0.84
47
Authors
4
Name
Order
Citations
PageRank
A. A. Badawy16716.88
Aneesh Aggarwal220216.91
Donald Yeung357951.17
Chau-Wen Tseng41812154.25