Paper Info
Title
An Orchestrated Survey of Available Algorithms and Tools for Combinatorial Testing
Abstract
For functional testing based on the input domain of a functionality, parameters and their values are identified and a test suite is generated using a criterion exercising combinations of those parameters and values. Since software systems are large, resulting in large numbers of parameters and values, a technique based on combinatorics called Combinatorial Testing (CT) is used to automate the process of creating those combinations. CT is typically performed with the help of combinatorial objects called Covering Arrays. The goal of the present work is to determine available algorithms/tools for generating a combinatorial test suite. We tried to be as complete as possible by using a precise protocol for selecting papers describing those algorithms/tools. The 75 algorithms/tools we identified are then categorized on the basis of different comparison criteria, including: the test suite generation technique, the support for selection (combination)criteria, mixed covering array, the strength of coverage, and the support for constraints between parameters. Results can be of interest to researchers or software companies who are looking for a CT algorithm/tool suitable for their needs.
Year
DOI
Venue
2014
10.1109/ISSRE.2014.15
Software Reliability Engineering
Keywords
Field
DocType
combinatorial mathematics,program testing,CT algorithm,algorithms,combinatorial objects,combinatorial test suite,combinatorial testing,combinatorics,covering arrays,functional testing,orchestrated survey,software systems,test suite generation technique,Combinatorial testing,Covering arrays,algorithms,category partition,strength of testing
Test suite,Algorithm design,Computer science,Functional testing,All-pairs testing,Algorithm,Software system,Software,Combinatorial testing,Artificial intelligence,Statistical classification,Machine learning
Conference
ISSN
Citations 
PageRank 
1071-9458
15
0.62
References 
Authors
47
2
Name
Order
Citations
PageRank
Sunint Kaur Khalsa1172.67
Yvan Labiche22874143.30