Paper Info
Title
Compiler assisted hybrid implicit and explicit GPU memory management under unified address space
Abstract
To improve programmability and productivity, recent GPUs adopt a virtual memory address space shared with CPUs (e.g., NVIDIA's unified memory). Unified memory migrates the data management burden from programmers to system software and hardware, and enables GPUs to address datasets that exceed their memory capacity. Our experiments show that while the implicit data transfer of unified memory may bring better data movement efficiency, page fault overhead and data thrashing can erase its benefits. In this paper, we propose several user-transparent unified memory management schemes to 1) achieve adaptive implicit and explicit data transfer and 2) prevent data thrashing. Unlike previous approaches which mostly rely on the runtime and thus suffer from large overhead, we demonstrate the benefits of exploiting key information from compiler analyses, including data locality, access density, and target reuse distance, to accomplish our goal. We implement the proposed schemes to improve OpenMP GPU offloading performance. Our evaluation shows that our schemes improve the GPU performance and memory efficiency significantly.
Year
DOI
Venue
2019
10.1145/3295500.3356141
Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
Keywords
Field
DocType
GPU, OpenMP, compiler analysis, implicit and explicit data transfer, reuse distance, runtime, unified memory management
Address space,Computer science,Parallel computing,Compiler,Memory management
Conference
ISBN
Citations 
PageRank 
978-1-4503-6229-0
1
0.35
References 
Authors
0
2
Name
Order
Citations
PageRank
Lingda Li1163.69
Barbara M. Chapman2904119.20