Title
Test data variance as a test quality measure: exemplified for TTCN-3
Abstract
Test effectiveness is a central quality aspect of a test specification which reflects its ability to demonstrate system quality levels and to discover system faults. A well-known approach for its estimatation is to determine coverage metrics for the system code or system model. However, often these are not available as such but the system interface only, which basically define structural aspects of the stimuli and responses to the system. Therefore, this paper focuses on the idea of using test data variance analysis as another analytical approach to determine test quality. It presents a method for the quantitative evaluation of structural and semantical variance of test data. Test variance is defined as the test data distribution over the system interface data domain. It is expected that the more the test data varies, the better the system is tested by a given test suite. The paper instantiates this method for black-box test specifications written in TTCN-3 and the structural analysis of send templates. Distance metrics and similarity relations are used to determine the data variance.
Year
DOI
Venue
2007
10.1007/978-3-540-73066-8_24
TestCom/FATES
Keywords
Field
DocType
test data variance analysis,test specification,black-box test specification,test effectiveness,test quality,test data distribution,test data,test variance,test quality measure,system code,test suite,structure analysis,system modeling,black box testing,distance metric
Test suite,System under test,Data mining,Test method,Data domain,Test data,TTCN-3,System model,Reliability engineering,Mathematics,Analysis of variance
Conference
Volume
ISSN
ISBN
4581
0302-9743
3-540-73065-6
Citations 
PageRank 
References 
4
0.46
11
Authors
3
Name
Order
Citations
PageRank
Diana Vega1312.59
Ina Schieferdecker259985.81
George Din312012.74