Title
Sensor Augmented Virtual Reality Based Teleoperation Using Mixed Autonomy
Abstract
A multimodal teleoperation interface is introduced, featuring an integrated virtual reality (VR) based simulation augmented by sensors and image processing capabilities onboard the remotely operated vehicle. The proposed virtual reality interface fuses an existing VR model with live video feed and prediction states, thereby creating a multimodal control interface. VR addresses the typical limitations of video based teleoperation caused by signal lag and limited field of view, allowing the operator to navigate in a continuous fashion. The vehicle incorporates an onboard computer and a stereo vision system to facilitate obstacle detection. A vehicle adaptation system with a priori risk maps and a real-state tracking system enable temporary autonomous operation of the vehicle for local navigation around obstacles and automatic re-establishment of the vehicles teleoperated state. The system provides real time update of the virtual environment based on anomalies encountered by the vehicle. The VR based multimodal teleoperation interface is expected to be more adaptable and intuitive when compared with other interfaces. [DOI:10.1115/1.3086030]
Year
DOI
Venue
2009
10.1115/1.3086030
JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING
Keywords
DocType
Volume
virtual reality,sensors,augmented virtuality,simulation
Journal
9
Issue
ISSN
Citations 
1
1530-9827
4
PageRank 
References 
Authors
0.51
23
2
Name
Order
Citations
PageRank
Muthukkumar S. Kadavasal1122.21
James H. Oliver213010.40