Title
Robustness Inside Out Testing
Abstract
Robustness testing is an important technique to reveal defects and vulnerabilities in software, especially software for Unmanned Autonomous Systems (UAS). We present Robustness Inside Out Testing (RIOT) as a technique directed at finding failures in autonomy systems that are able to be activated from external interfaces. The technique consists of four main steps: unit-level robustness testing, generalization, permeability analysis, and activation. Each of these steps yields a valuable deliverable in the testing process, and, when applied in succession, expands a unit-level bug to an external interface. RIOT has the following advantages over traditional robustness testing: it finds faults faster, it can find faults missed by traditional approaches, it identifies faults that can be triggered from inputs at an external interface, and it produces useful artifacts to aid in fault diagnosis and repair. In this paper, we outline each step of the RIOT process and provide an example of RIOT finding a bug on a real system that would not have been discovered using existing techniques.
Year
DOI
Venue
2020
10.1109/DSN-S50200.2020.00013
2020 50th Annual IEEE-IFIP International Conference on Dependable Systems and Networks-Supplemental Volume (DSN-S)
Keywords
DocType
ISSN
robustness,autonomous systems,software quality,software testing
Conference
1530-0889
ISBN
Citations 
PageRank 
978-1-7281-7261-3
0
0.34
References 
Authors
5
9
Name
Order
Citations
PageRank
Deborah S. Katz152.16
Milda Zizyte291.65
Casidhe Hutchison391.65
David Guttendorf400.34
Patrick E. Lanigan51179.38
Eric Sample600.34
Philip Koopman796086.09
Michael D. Wagner813813.89
Claire Le Goues9176668.79