Title
Jointly network: a network based on CNN and RBM for gesture recognition
Abstract
Hand belongs to non-rigid objects and is rich in variety, making gesture recognition more difficult. The essence of dynamic gesture recognition is the classification and recognition of single-frame still images. Therefore, this paper mainly focuses on static gesture recognition. At present, there are some problems in gesture recognition, such as accuracy, real-time or poor robustness. To solve the above problems, in this paper, the Kinect sensor is used to obtain the color and depth gesture samples, and the gesture samples are processed. On this basis, a jointly network of CNN and RBM is proposed for gesture recognition. It mainly uses superposed network of multiple RBMs to carry out unsupervised feature extraction and combined with supervised feature extraction of CNN. Finally, these two features are combined to classify them. The simulation results show that the proposed jointly network has a better performance in identifying simple background gesture samples and the recognition capability of gesture samples in complex background needs to be improved.
Year
DOI
Venue
2019
10.1007/s00521-018-3775-8
Neural Computing and Applications
Keywords
Field
DocType
Kinect sensor, Jointly network, Static gesture recognition, Simulation experiment
Pattern recognition,Gesture,Gesture recognition,Robustness (computer science),Feature extraction,Artificial intelligence,Machine learning,Mathematics
Journal
Volume
Issue
ISSN
31
SUPnan
1433-3058
Citations 
PageRank 
References 
7
0.42
34
Authors
5
Name
Order
Citations
PageRank
Wentao Cheng181.11
Ying Sun229140.03
Gongfa Li323943.45
Guozhang Jiang417227.25
Honghai Liu51974178.69