Name
Abstract | ||
|---|---|---|
Testing is necessary for all types of systems, but becomes difficult when the tester cannot easily determine whether the system delivers the correct result or not. NASA's Data Access Toolkit allows NASA analysts to query a large database of telemetry data. Since the user is unfamiliar with the data and several data transformations can occur, it is impossible to determine whether the system behaves correctly or not in full scale production situations. Small scale testing was already conducted manually by other teams and unit testing was conducted on individual functions. However, there was still a need for full scale acceptance testing on a broad scale.
We describe how we addressed this testing problem by applying the idea of metamorphic testing [1]. Specifically, we base it on equivalence of queries and by using the system itself for testing. The approach is implemented using a model-based testing approach in combination with a test data generation and test case outcome analysis strategy. We also discuss some of the issues that were detected using this approach.
|
Year | DOI | Venue |
|---|---|---|
2015 | 10.1109/ICSE.2015.348 | ICSE |
Keywords | Field | DocType |
metamorphic model-based testing,NASA DAT,systems testing,NASA data access toolkit,query,large database,telemetry data,data transformations,small scale testing,unit testing,full scale acceptance testing,test data generation,test case outcome analysis strategy | Data mining,Integration testing,System testing,Computer science,Manual testing,White-box testing,Software performance testing,Non-regression testing,Test strategy,Keyword-driven testing | Conference |
Volume | ISSN | ISBN |
2 | 0270-5257 | 978-1-4799-1934-5 |
Citations | PageRank | References |
22 | 0.91 | 7 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Mikael Lindvall | 1 | 1203 | 95.86 |
| Dharmalingam Ganesan | 2 | 164 | 13.87 |
| Ragnar Ardal | 3 | 22 | 0.91 |
| Robert E. Wiegand | 4 | 25 | 1.31 |