Title
The Design and Implementation of a Verification Technique for GPU Kernels
Abstract
We present a technique for the formal verification of GPU kernels, addressing two classes of correctness properties: data races and barrier divergence. Our approach is founded on a novel formal operational semantics for GPU kernels termed <i>synchronous, delayed visibility (SDV)</i> semantics, which captures the execution of a GPU kernel by multiple groups of threads. The SDV semantics provides operational definitions for barrier divergence and for both inter- and intra-group data races. We build on the semantics to develop a method for reducing the task of verifying a massively parallel GPU kernel to that of verifying a sequential program. This completely avoids the need to reason about thread interleavings, and allows existing techniques for sequential program verification to be leveraged. We describe an efficient encoding of data race detection and propose a method for automatically inferring the loop invariants that are required for verification. We have implemented these techniques as a practical verification tool, GPUVerify, that can be applied directly to OpenCL and CUDA source code. We evaluate GPUVerify with respect to a set of 162 kernels drawn from public and commercial sources. Our evaluation demonstrates that GPUVerify is capable of efficient, automatic verification of a large number of real-world kernels.
Year
DOI
Venue
2015
10.1145/2743017
ACM Transactions on Programming Languages and Systems
Keywords
Field
DocType
Theory,Verification,Verification,GPUs,concurrency,data races,barrier synchronization
Operational semantics,Model checking,Programming language,Source code,CUDA,Computer science,Concurrency,Correctness,Parallel computing,Theoretical computer science,Loop invariant,Formal verification
Journal
Volume
Issue
ISSN
37
3
0164-0925
Citations 
PageRank 
References 
20
0.70
38
Authors
7
Name
Order
Citations
PageRank
Adam Betts125113.81
Nathan Chong21857.91
Alastair F. Donaldson366152.35
Jeroen Ketema416013.52
Shaz Qadeer53257239.11
Paul Thomson61225.85
John Wickerson714210.08