Title
Efficient observability-based test generation by dynamic symbolic execution
Abstract
Structural coverage metrics have been widely used to measure test suite adequacy as well as to generate test cases. In previous investigations, we have found that the fault-finding effectiveness of tests satisfying structural coverage criteria is highly dependent on program syntax ¿ even if the faulty code is exercised, its effect may not be observable at the output. To address these problems, observability-based coverage metrics have been defined. Specifically, Observable MC/DC (OMC/DC) is a criterion that appears to be both more effective at detecting faults and more robust to program restructuring than MC/DC. Traditional counterexample-based test generation for OMC/DC, however, can be infeasible on large systems. In this study, we propose an incremental test generation approach that combines the notion of observability with dynamic symbolic execution. We evaluated the efficiency and effectiveness of our approach using seven systems from the avionics and medical device domains. Our results show that the incremental approach requires much lower generation time, while achieving even higher fault finding effectiveness compared with regular OMC/DC generation.
Year
DOI
Venue
2015
10.1109/ISSRE.2015.7381816
International Symposium on Software Reliability Engineering
Keywords
Field
DocType
efficient observability-based test generation,dynamic symbolic execution,test suite adequacy,fault-finding effectiveness,structural coverage metrics,program syntax,observable MC-DC,OMC-DC,counterexample-based test generation,incremental test generation approach,avionics,medical device domains
Test suite,Generation time,Observability,Fault coverage,Computer science,Avionics,Real-time computing,Test case,Symbolic execution,Counterexample,Reliability engineering
Conference
Citations 
PageRank 
References 
2
0.38
27
Authors
5
Name
Order
Citations
PageRank
Dongjiang You1453.25
Sanjai Rayadurgam228429.86
Michael W. Whalen3109670.54
Mats Per Erik Heimdahl453866.59
Gregory Gay529915.27