Title
Egocentric-Vision based Hand Posture Control System for Reconnaissance Robots.
Abstract
To facilitate full-loaded commandos to control reconnaissance robots, in this paper, we propose a wearable hand posture control system based on egocentric-vision by imitating the sign language interaction way among commandos. Considering the characteristics of the egocentric-vision on the battlefield, such as complicated backgrounds, large ego-motions and extreme transitions in lighting, a new hand detector based on Binary Edge HOG Block (BEHB) features is proposed to extract articulated postures from the egocentric-vision. Different from many other methods that use skin color cues, our proposed hand detector adopts contour cues and part-based voting idea. This means that our algorithm can be used on the battlefield even in dark environment, because infrared cameras can be used to get contour images rather than skin color images. The experiment result shows that the proposed hand detector can get a better posture detection result on the NUS hand posture dataset II. To improve hand recognition accuracy, a deep ensemble hybrid classifier is proposed by combing hybrid CNN-SVM classifier and ensemble technique. Compared with other state-of-art algorithms, the proposed classifier yields a recognition accuracy of 97.72 % on the NUS hand posture dataset II. At last, to reduce misjudgments during consecutive posture switches, a vote filter is proposed and applied to the sequence of the recognition results. The scout experiment shows that our wearable hand posture control system is more suitable than traditional hand-held controllers for full-loaded commandos to control reconnaissance robots.
Year
DOI
Venue
2017
https://doi.org/10.1007/s10846-016-0440-2
Journal of Intelligent and Robotic Systems
Keywords
Field
DocType
Egocentric-vision,Hand detection,Hand posture recognition,Convolutional Neural Network,Reconnaissance robot
Computer vision,Wearable computer,Convolutional neural network,Sign language,Artificial intelligence,Engineering,Control system,Robot,Classifier (linguistics),Detector,Binary number
Journal
Volume
Issue
ISSN
87
3-4
0921-0296
Citations 
PageRank 
References 
2
0.37
23
Authors
6
Name
Order
Citations
PageRank
Peng Ji142.46
Aiguo Song254686.46
Pengwen Xiong320.37
Ping Yi4496.03
Xiaonong Xu5122.00
Huijun Li67614.37