Title
Test Automation Process Improvement in a DevOps Team: Experience Report
Abstract
How to successfully conduct test automation process improvement (TAPI) for continuous development, consisting of iterative software development, continuous testing, and delivery, is the challenge faced by many software organizations. In this paper, we present an experience report on TAPI in one DevOps team in F-Secure (a Finnish software company). The team builds Windows application software and exists in F-Secure's TAPI culture. The team self-reports high satisfaction and maturity in test automation for continuous development. To study their TAPI, we reviewed a collection of experience notes, team reflection reports and telemetry result reports. Then several meetings were held to discuss the details. We found that based on the understanding of the team, test automation maturity for continuous development is defined as a set of indicators, e.g., the increasing speed to release, improving the productivity of the team, high test efficiency. Second, the team indicated that a set of critical success factors have a major impact on successfully carrying out its TAPI, e.g., incremental approach, the whole team effort, test tool choice and architecture, telemetry. Third, we compare the TAPI practices in the observed team with the practices described in prior literature. The team believes that the existing test automation maturity approaches should include the identified practices like the whole team effort to build a more comprehensive test automation improvement model for the software industry.
Year
DOI
Venue
2020
10.1109/ICSTW50294.2020.00057
2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)
Keywords
DocType
ISSN
Software,test automation,success factor,process,improvement,maturity,experience report
Conference
2159-4848
ISBN
Citations 
PageRank 
978-1-7281-1076-9
0
0.34
References 
Authors
10
3
Name
Order
Citations
PageRank
Yuqing Wang163.34
Pyhäjärvi Maaret200.34
Mika V. Mäntylä339327.44