Title
Moving the goalposts: coverage satisfaction is not enough
Abstract
Structural coverage criteria have been proposed to measure the adequacy of testing efforts. Indeed, in some domains—e.g., critical systems areas—structural coverage criteria must be satisfied to achieve certification. The advent of powerful search-based test generation tools has given us the ability to generate test inputs to satisfy these structural coverage criteria. While tempting, recent empirical evidence indicates these tools should be used with caution, as merely achieving high structural coverage is not necessarily indicative of high fault detection ability. In this report, we review some of these findings, and offer recommendations on how the strengths of search-based test generation methods can alleviate these issues.
Year
DOI
Venue
2014
10.1145/2593833.2593837
SBST
Keywords
Field
DocType
structural coverage,verification,software testing,testing and debugging,automated test generation
Empirical evidence,Fault detection and isolation,Engineering,Certification,Reliability engineering,Software testing
Conference
Citations 
PageRank 
References 
4
0.39
12
Authors
4
Name
Order
Citations
PageRank
Gregory Gay129915.27
Matt Staats287132.29
Michael W. Whalen3109670.54
Mats Per Erik Heimdahl453866.59