Abstract | ||
---|---|---|
Many future heterogeneous systems will integrate CPUs and GPUs physically on a single chip and logically connect them via shared memory to avoid explicit data copying. Making this shared memory coherent facilitates programming and fine-grained sharing, but throughput-oriented GPUs can overwhelm CPUs with coherence requests not well-filtered by caches. Meanwhile, region coherence has been proposed for CPU-only systems to reduce snoop bandwidth by obtaining coherence permissions for large regions. This paper develops Heterogeneous System Coherence (HSC) for CPU-GPU systems to mitigate the coherence bandwidth effects of GPU memory requests. HSC replaces a standard directory with a region directory and adds a region buffer to the L2 cache. These structures allow the system to move bandwidth from the coherence network to the high-bandwidth direct-access bus without sacrificing coherence. Evaluation results with a subset of Rodinia benchmarks and the AMD APP SDK show that HSC can improve performance compared to a conventional directory protocol by an average of more than 2x and a maximum of more than 4.5x. Additionally, HSC reduces the bandwidth to the directory by an average of 94% and by more than 99% for four of the analyzed benchmarks. |
Year | DOI | Venue |
---|---|---|
2013 | 10.1145/2540708.2540747 | MICRO |
Keywords | Field | DocType |
coherence network,heterogeneous system coherence,integrated cpu-gpu system,snoop bandwidth,standard directory,coherence bandwidth effect,shared memory,conventional directory protocol,region coherence,coherence request,coherence permission,region directory,heterogeneous computing,cache coherence | Shared memory,CPU cache,Computer science,Coherence bandwidth,Parallel computing,MESI protocol,Coherence (physics),Real-time computing,Memory coherence,Bus sniffing,Cache coherence | Conference |
ISBN | Citations | PageRank |
978-1-5090-6603-2 | 47 | 1.40 |
References | Authors | |
18 | 8 |
Name | Order | Citations | PageRank |
---|---|---|---|
Jason Power | 1 | 166 | 6.07 |
Arkaprava Basu | 2 | 1145 | 40.24 |
Junli Gu | 3 | 73 | 3.63 |
Sooraj Puthoor | 4 | 80 | 4.70 |
Bradford Beckmann | 5 | 2390 | 101.06 |
Mark D. Hill | 6 | 7371 | 582.90 |
Steven K. Reinhardt | 7 | 3885 | 226.69 |
David A. Wood | 8 | 6058 | 617.11 |