Paper Info
Title
Evolving a test oracle in black-box testing
Abstract
Software testing is an important and expensive activity to the software industry, with testing accounting for over 50% of the cost of software. To ease this problem, test automation is very critical to the process of software testing. One important issue in this automation is to automatically determine whether a program under test (PUT) responds the correct(expected) output for an arbitrary input. In this paper, we model PUTs in black-box way, i.e. processing and responding a list of numbers, and design input/output list relation language(IOLRL) to formally describe the relations between the input and output lists. Given several labelled test cases(test verdicts are set), we use genetic programming to evolve the most distinguishing relations of these test cases in IOLRL and encode the test cases into bit patterns to build a classifier with support vector machine as the constructed test oracle. This classifier can be used to automatically verify if a program output list is the expected one in processing a program input list. The main contribution of this work are the designed IOLRL and the approach to construct test oracle with evolve relations in IOLRL. The experiments show the constructed test oracle has good performance even when few labelled test cases are supplied.
Year
DOI
Venue
2011
10.1007/978-3-642-19811-3_22
FASE
Keywords
Field
DocType
black-box testing,output list,test verdict,output list relation language,test automation,software testing,labelled test case,arbitrary input,design input,test oracle,test case,black box testing,input output,support vector machine
Test suite,Test harness,Data mining,Equivalence partitioning,Programming language,Test Management Approach,Computer science,Oracle,Test script,Test case,Test data generation
Conference
Volume
ISSN
Citations 
6603
0302-9743
2
PageRank 
References 
Authors
0.39
5
4
Name
Order
Citations
PageRank
Farn Wang1706.23
Jung-hsuan Wu2102.60
Chung-Hao Huang3857.55
Kai-Hsiang Chang4111.06