Title
Experience report: An industrial experience report on test outsourcing practices
Abstract
Nowadays, many companies contract their testing functionalities out to third-party IT outsourcing companies. This process referred to as test outsourcing is common in the industry, yet it is rarely studied in the research community. In this paper, to bridge the gap, we performed an empirical study on test outsourcing with 10 interviewees and 140 survey respondents. We investigated various research questions such as the types, the process, and the challenges of test outsourcing, and the differences between test outsourcing and in-house testing. We found customer satisfaction, tight project schedule, and domain unfamiliarity are the top-3 challenges faced by the testers. We also found there are substantial differences between test outsourcing and in-house testing. For example, most of the test outsourcing projects focused on functional test, and rarely did unit test. Also, due to privacy policies of client companies, test outsourcing is performed mainly on the binary distributions of the projects, and rarely the testers can touch the source code. Our findings have implications for future research. For instance, as a starting point, researchers can create automated program comprehension tools which work on binary distributions of projects to help testers better design effective test cases.
Year
DOI
Venue
2015
10.1109/ISSRE.2015.7381830
International Symposium on Software Reliability Engineering
Keywords
Field
DocType
industrial experience report,testing functionalities,third-party IT outsourcing companies,in-house testing,customer satisfaction,project schedule,domain unfamiliarity,test outsourcing projects,functional test,privacy policies,client companies,source code,automated program comprehension tools
Customer satisfaction,Schedule (project management),Computer science,Unit testing,Outsourcing,Test case,Program comprehension,Empirical research,Reliability engineering,Knowledge process outsourcing
Conference
Citations 
PageRank 
References 
1
0.35
19
Authors
6
Name
Order
Citations
PageRank
Xin Xia197265.97
David Lo25346259.67
Pavneet Singh Kochhar330914.88
Zhenchang Xing4138787.95
xinyu559030.19
Shanping Li646646.11