Title
A corroborative approach to verification and validation of human–robot teams
Abstract
AbstractWe present an approach for the verification and validation (V&V) of robot assistants in the context of human–robot interactions, to demonstrate their trustworthiness through corroborative evidence of their safety and functional correctness. Key challenges include the complex and unpredictable nature of the real world in which assistant and service robots operate, the limitations on available V&V techniques when used individually, and the consequent lack of confidence in the V&V results. Our approach, called corroborative V&V, addresses these challenges by combining several different V&V techniques; in this paper we use formal verification (model checking), simulation-based testing, and user validation in experiments with a real robot. This combination of approaches allows V&V of the human–robot interaction task at different levels of modeling detail and thoroughness of exploration, thus overcoming the individual limitations of each technique. We demonstrate our approach through a handover task, the most critical part of a complex cooperative manufacturing scenario, for which we propose safety and liveness requirements to verify and validate. Should the resulting V&V evidence present discrepancies, an iterative process between the different V&V techniques takes place until corroboration between the V&V techniques is gained from refining and improving the assets (i.e., system and requirement models) to represent the human–robot interaction task in a more truthful manner. Therefore, corroborative V&V affords a systematic approach to “meta-V&V,” in which different V&V techniques can be used to corroborate and check one another, increasing the level of certainty in the results of V&V.
Year
DOI
Venue
2020
10.1177/0278364919883338
Periodicals
Keywords
Field
DocType
Human-robot interaction, verification, validation, model checking, simulation, testing
Model checking,Verification and validation,Trustworthiness,Control engineering,Human–computer interaction,Robot,Mathematics,Human–robot interaction
Journal
Volume
Issue
ISSN
39
1
0278-3649
Citations 
PageRank 
References 
2
0.39
0
Authors
7
Name
Order
Citations
PageRank
Matt Webster1888.30
David G Western282.51
Dejanira Araiza-Illan3196.46
Clare Dixon455242.94
Kerstin Eder523226.56
Michael Fisher6967.91
Anthony G. Pipe725539.08