Title
Production Monitoring to Improve Test Suites
Abstract
In this article, we propose to use production executions to improve the quality of testing for certain methods of interest for developers. These methods can be methods that are not covered by the existing test suite or methods that are poorly tested. We devise an approach called <sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">pankti</small> which monitors applications as they execute in production and then automatically generates differential unit tests, as well as derived oracles, from the collected data. <sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">pankti</small> ’s monitoring and generation focuses on one single programming language, Java. We evaluate it on three real-world, open-source projects: a videoconferencing system, a PDF manipulation library, and an e-commerce application. We show that <sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">pankti</small> is able to generate differential unit tests by monitoring target methods in production and that the generated tests improve the quality of the test suite of the application under consideration.
Year
DOI
Venue
2022
10.1109/TR.2021.3101318
IEEE Transactions on Reliability
Keywords
DocType
Volume
Production monitoring,test generation,test improvement,test oracle,test quality
Journal
71
Issue
ISSN
Citations 
3
0018-9529
1
PageRank 
References 
Authors
0.35
47
4
Name
Order
Citations
PageRank
Deepika Tiwari110.69
Long Zhang241.43
Martin Monperrus3133070.54
Benoit Baudry42000118.08