Title
Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing.
Abstract
In software system development, testing can take considerable time and resources, and there are numerous examples in the literature of how to improve the testing process. In particular, methods for selection and prioritization of test cases can play a critical role in efficient use of testing resources. This paper focuses on the problem of selection and ordering of integration-level test cases. Integration testing is performed to evaluate the correctness of several units in composition. Further, for reasons of both effectiveness and safety, many embedded systems are still tested manually. To this end, we propose a process, supported by an online decision support system, for ordering and selection of test cases based on the test result of previously executed test cases. To analyze the economic efficiency of such a system, a customized return on investment (ROI) metric tailored for system integration testing is introduced. Using data collected from the development process of a large-scale safety-critical embedded system, we perform Monte Carlo simulations to evaluate the expected ROI of three variants of the proposed new process. The results show that our proposed decision support system is beneficial in terms of ROI at system integration testing and thus qualifies as an important element in improving the integration testing process.
Year
Venue
Field
2016
PROFES
Systems engineering,Test Management Approach,Integration testing,System testing,Manual testing,Non-regression testing,White-box testing,Engineering,Test strategy,Reliability engineering,Keyword-driven testing
DocType
Citations 
PageRank 
Conference
1
0.35
References 
Authors
15
6
Name
Order
Citations
PageRank
Sahar Tahvili1113.31
Markus Bohlin27714.24
Mehrdad Saadatmand34313.11
Stig Larsson434638.20
Wasif Afzal538830.92
Daniel Sundmark629933.30