Title
A Cache Hierarchy Aware Thread Mapping Methodology for GPGPUs
Abstract
The recently proposed GPGPU architecture has added a multi-level hierarchy of shared cache to better exploit the data locality of general purpose applications. The GPGPU design philosophy allocates most of the chip area to processing cores, and thus results in a relatively small cache shared by a large number of cores when compared with conventional multi-core CPUs. Applying a proper thread mapping scheme is crucial for gaining from constructive cache sharing and avoiding resource contention among thousands of threads. However, due to the significant differences on architectures and programming models, the existing thread mapping approaches for multi-core CPUs do not perform as effective on GPGPUs. This paper proposes a formal model to capture both the characteristics of threads as well as the cache sharing behavior of multi-level shared cache. With appropriate proofs, the model forms a solid theoretical foundation beneath the proposed cache hierarchy aware thread mapping methodology for multi-level shared cache GPGPUs. The experiments reveal that the three-staged thread mapping methodology can successfully improve the data reuse on each cache level of GPGPUs and achieve an average of 2.3× to 4.3× runtime enhancement when compared with existing approaches.
Year
DOI
Venue
2015
10.1109/TC.2014.2308179
Computers, IEEE Transactions  
Keywords
Field
DocType
cache storage,graphics processing units,integrated circuit design,multi-threading,performance evaluation,shared memory systems,gpgpu architecture,gpgpu design philosophy,cache hierarchy aware thread mapping methodology,chip area allocation,constructive cache sharing,data reuse improvement,multilevel shared cache hierarchy,performance analysis,processing cores,programming models,shared memory,multithreaded processors,cache memories,performance analysis and design aids,optimization,kernel,instruction sets,multi threading
Cache-oblivious algorithm,Cache invalidation,Cache pollution,Cache,Computer science,Parallel computing,Cache algorithms,Page cache,Real-time computing,Cache coloring,Smart Cache
Journal
Volume
Issue
ISSN
64
4
0018-9340
Citations 
PageRank 
References 
4
0.44
39
Authors
3
Name
Order
Citations
PageRank
Bo-Cheng Charles Lai117719.25
Hsien-Kai Kuo2215.81
Jing-Yang Jou368188.55