Title
An Empirical Study on the Adequacy of Testing in Open Source Projects
Abstract
During software maintenance, testing is a crucial activity to ensure the quality of code as it evolves over time. With the increasing size and complexity of software, adequate software testing has become increasingly important. Code coverage is an important metric to gauge the effectiveness of test cases and the adequacy of testing. However, what is the coverage level exhibited by large-scale open-source projects? What is the correlation between software metrics and the code coverage of the software? In this study, we investigate the state-of-the-practice of testing by measuring code coverage in open-source software projects. We examine over 300 large open-source projects written in Java, to measure the code coverage of their associated test cases. We analyse correlations between code coverage and relevant software metrics such as lines of code, cyclomatic complexity, and number of developers. Our results show that the coverage level decreases with the increase in size and complexity of the software, whereas the number of developers has an insignificant correlation with the code coverage. However, considering individual files, coverage increases with the size and complexity, whereas the number of developers has no correlation with the code coverage. Our results highlight the strengths and weaknesses of testing in open-source projects and make recommendations for future research.
Year
DOI
Venue
2014
10.1109/APSEC.2014.42
APSEC), 2014 21st Asia-Pacific  
Keywords
Field
DocType
Java,program testing,project management,public domain software,software maintenance,software metrics,software quality,Java,code coverage,code quality,empirical study,open source software project,software complexity,software maintenance,software metrics,software size,software testing,testing adequacy,Code coverage,Software metrics,Software testing,Test adequacy
Code coverage,Static program analysis,Systems engineering,Software engineering,Computer science,Regression testing,Software reliability testing,Software construction,Software quality,Modified condition/decision coverage,Development testing,Reliability engineering
Conference
Volume
ISSN
Citations 
1
1530-1362
9
PageRank 
References 
Authors
0.60
25
4
Name
Order
Citations
PageRank
Pavneet Singh Kochhar130914.88
Ferdian Thung264133.28
David Lo35346259.67
Julia L. Lawall495860.03