Title
Real-Time Hand Grasp Recognition Using Weakly Supervised Two-Stage Convolutional Neural Networks for Understanding Manipulation Actions
Abstract
Understanding human hand usage is one of the richest information source to recognize human manipulation actions. Since humans use various tools during actions, grasp recognition gives important cues to figure out humans' intention and tasks. Earlier studies analyzed grasps with positions of hand joints by attaching sensors, but since these types of sensors prevent humans from naturally conducting actions, visual approaches have been focused in recent years. Convolutional neural networks require a vast annotated dataset, but, to our knowledge, no human grasping dataset includes ground truth of hand regions. In this paper, we propose a grasp recognition method only with image-level labels by the weakly supervised learning framework. In addition, we split the grasp recognition process into two stages that are hand localization and grasp classification so as to speed up. Experimental results demonstrate that the proposed method outperforms existing methods and can perform in real-time.
Year
DOI
Venue
2017
10.1109/CVPRW.2017.67
2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Keywords
Field
DocType
hand localization,grasp classification,supervised learning framework,image-level labels,human grasping dataset,convolutional neural networks,hand joint positions,human manipulation action recognition,manipulation actions,weakly supervised two-stage convolutional neural networks,real-time hand grasp recognition
Computer vision,GRASP,Computer science,Convolutional neural network,Network architecture,Feature extraction,Hand grasp,Supervised learning,Ground truth,Artificial intelligence,Machine learning,Speedup
Conference
Volume
Issue
ISSN
2017
1
2160-7508
ISBN
Citations 
PageRank 
978-1-5386-0734-3
0
0.34
References 
Authors
7
4
Name
Order
Citations
PageRank
Ji Woong Kim100.34
Sujeong You201.01
Sang-Hoon Ji345.95
Hong-Seok Kim470653.55