Paper Info
Title
Keep Me in the Loop: Increasing Operator Situation Awareness through a Conversational Multimodal Interface.
Abstract
Autonomous systems are designed to carry out activities in remote, hazardous environments without the need for operators to micro-manage them. It is, however, essential that operators maintain situation awareness in order to monitor vehicle status and handle unforeseen circumstances that may affect their intended behaviour, such as a change in the environment. We present MIRIAM, a multimodal interface that combines visual indicators of status with a conversational agent component. This multimodal interface offers a fluid and natural way for operators to gain information on vehicle status and faults, mission progress and to set reminders. We describe the system and an evaluation study providing evidence that such an interactive multimodal interface can assist in maintaining situation awareness for operators of autonomous systems, irrespective of cognitive styles.
Year
DOI
Venue
2018
10.1145/3242969.3242974
ICMI
Keywords
Field
DocType
Multimodal output, natural language generation, autonomous systems, situation awareness, cognitive styles
Natural language generation,Computer science,Situation awareness,Human–computer interaction,Autonomous system (Internet),Dialog system,Operator (computer programming),Cognitive style
Conference
ISBN
Citations 
PageRank 
978-1-4503-5692-3
2
0.45
References 
Authors
15
6
Name
Order
Citations
PageRank
David A. Robb1278.34
Francisco Javier Chiyah Garcia2133.61
Atanas Laskov3112.87
Xingkun Liu4336.83
Pedro Patrón5376.15
Helen F. Hastie614719.09