Title
Classification of Randomly Generated Test Cases
Abstract
Random test case generation produces relatively diverse test sequences, but the validity of the test verdict is always uncertain. Because tests are generated without taking the specification and documentation into account, many tests are invalid. To understand the prevalent types of successful and invalid tests, we present a classification of 56 issues that were derived from 208 failed, randomly generated test cases. While the existing workflow successfully eliminated more than half of the tests as irrelevant, half of the remaining failed tests are false positives. We show that the new @NonNull annotation of Java 8 has the potential to eliminate most of the false positives, highlighting the importance of machine-readable documentation.
Year
DOI
Venue
2016
10.1109/SANER.2016.32
2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER)
Keywords
Field
DocType
randomly generated test case classification,test sequences,@NonNull annotation,Java 8,false positive elimination,machine-readable documentation
Programming language,Classification Tree Method,Computer science,Natural language processing,Artificial intelligence,Test case
Conference
Volume
Citations 
PageRank 
2
0
0.34
References 
Authors
12
2
Name
Order
Citations
PageRank
Cyrille Artho158844.46
Lei Ma235734.63