Title
A framework for dynamically instrumenting GPU compute applications within GPU Ocelot
Abstract
In this paper we present the design and implementation of a dynamic instrumentation infrastructure for PTX programs that procedurally transforms kernels and manages related data structures. We show how performing instrumentation within the GPU Ocelot dynamic compiler infrastructure provides unique capabilities not available to other profiling and instrumentation toolchains for GPU computing. We demonstrate the utility of this instrumentation capability with three example scenarios - (1) performing workload characterization accelerated by a GPU, (2) providing load imbalance information for use by a resource allocator, and (3) providing compute utilization feedback to be used online by a simulated process scheduler that might be found in a hypervisor. Additionally, we measure both (1) the compilation overheads of performing dynamic compilation and (2) the increases in runtimes when executing instrumented kernels. On average, compilation overheads due to instrumentation consisted of 69% of the time needed to parse a kernel module, in the case of the Parboil benchmark suite. Slowdowns for instrumenting each basic block ranged from 1.5x to 5.5x, with the largest slowdowns attributed to kernels with large numbers of short, compute-bound blocks.
Year
DOI
Venue
2011
10.1145/1964179.1964192
GPGPU
Keywords
Field
DocType
ptx program,dynamic compilation,gpu ocelot dynamic compiler,dynamic instrumentation infrastructure,instrumentation capability,gpu computing,parboil benchmark suite,compilation overhead,basic block,instrumentation toolchains,relational data,gpgpu,process scheduling,instrumentation
Dynamic compilation,Computer science,Profiling (computer programming),Scheduling (computing),CUDA,Parallel computing,Hypervisor,Compiler,Basic block,General-purpose computing on graphics processing units,Operating system
Conference
Citations 
PageRank 
References 
29
1.42
8
Authors
5
Name
Order
Citations
PageRank
Naila Farooqui1605.18
Andrew Kerr21225.46
Gregory Frederick Diamos3111751.07
S. Yalamanchili419838.07
K. Schwan5291.42