Title
Visibility Enhancement using Autonomous Multicamera Controls with Situational Role Assignment for Teleoperated Work Machines
Abstract
The aim of this study is to provide a machine operator with enhanced visibility and more adaptive visual information suited to the work situation, particularly advanced unmanned construction. Toward that end, we propose a method for autonomously controlling multiple environmental cameras. Situations in which the yaw, pitch, and zoom of cameras should be controlled are analyzed. Additionally, we define imaging objects, including the machine, manipulators, and end points; and imaging modes, including tracking, zoom, posture, and trajectory modes. To control each camera simply and effectively, four practical camera roles with different combinations of the imaging objects and modes were defined: overview machine, enlarge end point, posture-manipulator, and trajectory-manipulator. A real-time role assignment system is described for assigning the four camera roles to four out of six cameras suitable for the work situation e.g., reaching, grasping, transport, and releasing on the basis of the assignment-priority rules. To test this system, debris-removal tasks were performed in a virtual reality simulation to compare performance among fixed camera, manual control camera, and autonomous control camera systems. The results showed that the autonomous system was the best of the three at decreasing the number of grasping misses and erroneous contacts and simultaneously increasing the subjective usability and time efficiency.
Year
DOI
Venue
2016
10.1002/rob.21580
J. Field Robotics
Field
DocType
Volume
Teleoperation,Computer vision,Visibility,Virtual reality,Simulation,Usability,Zoom,Smart camera,Artificial intelligence,Autonomous system (mathematics),Engineering,Trajectory
Journal
33
Issue
ISSN
Citations 
6
1556-4959
0
PageRank 
References 
Authors
0.34
6
4
Name
Order
Citations
PageRank
Mitsuhiro Kamezaki12820.34
Junjie Yang211.83
Hiroyasu Iwata321948.86
Shigeki Sugano4689161.38