Title
Heterogeneous system coherence for integrated CPU-GPU systems
Abstract
Many future heterogeneous systems will integrate CPUs and GPUs physically on a single chip and logically connect them via shared memory to avoid explicit data copying. Making this shared memory coherent facilitates programming and fine-grained sharing, but throughput-oriented GPUs can overwhelm CPUs with coherence requests not well-filtered by caches. Meanwhile, region coherence has been proposed for CPU-only systems to reduce snoop bandwidth by obtaining coherence permissions for large regions. This paper develops Heterogeneous System Coherence (HSC) for CPU-GPU systems to mitigate the coherence bandwidth effects of GPU memory requests. HSC replaces a standard directory with a region directory and adds a region buffer to the L2 cache. These structures allow the system to move bandwidth from the coherence network to the high-bandwidth direct-access bus without sacrificing coherence. Evaluation results with a subset of Rodinia benchmarks and the AMD APP SDK show that HSC can improve performance compared to a conventional directory protocol by an average of more than 2x and a maximum of more than 4.5x. Additionally, HSC reduces the bandwidth to the directory by an average of 94% and by more than 99% for four of the analyzed benchmarks.
Year
DOI
Venue
2013
10.1145/2540708.2540747
MICRO
Keywords
Field
DocType
coherence network,heterogeneous system coherence,integrated cpu-gpu system,snoop bandwidth,standard directory,coherence bandwidth effect,shared memory,conventional directory protocol,region coherence,coherence request,coherence permission,region directory,heterogeneous computing,cache coherence
Shared memory,CPU cache,Computer science,Coherence bandwidth,Parallel computing,MESI protocol,Coherence (physics),Real-time computing,Memory coherence,Bus sniffing,Cache coherence
Conference
ISBN
Citations 
PageRank 
978-1-5090-6603-2
47
1.40
References 
Authors
18
8
Name
Order
Citations
PageRank
Jason Power11666.07
Arkaprava Basu2114540.24
Junli Gu3733.63
Sooraj Puthoor4804.70
Bradford Beckmann52390101.06
Mark D. Hill67371582.90
Steven K. Reinhardt73885226.69
David A. Wood86058617.11