Title
Test oracle assessment and improvement.
Abstract
We introduce a technique for assessing and improving test oracles by reducing the incidence of both false positives and false negatives. We prove that our approach can always result in an increase in the mutual information between the actual and perfect oracles. Our technique combines test case generation to reveal false positives and mutation testing to reveal false negatives. We applied the decision support tool that implements our oracle improvement technique to five real-world subjects. The experimental results show that the fault detection rate of the oracles after improvement increases, on average, by 48.6% (86% over the implicit oracle). Three actual, exposed faults in the studied systems were subsequently confirmed and fixed by the developers.
Year
DOI
Venue
2016
10.1145/2931037.2931062
ISSTA
Field
DocType
Citations 
Data mining,Computer science,Decision support system,Oracle,Mutual information,Fault detection rate,False positives and false negatives,False positive paradox
Conference
5
PageRank 
References 
Authors
0.40
14
4
Name
Order
Citations
PageRank
Gunel Jahangirova191.83
David M. Clark215316.33
Mark Harman310264389.82
Paolo Tonella43559224.88