Title
Feature covariance matrix-based dynamic hand gesture recognition
Abstract
Over the past 2 decades, vision-based dynamic hand gesture recognition (HGR) has made significant progresses and been widely adopted in many practical applications. Although the advent of RGB-D cameras and deep learning-based methods provides more feasible solutions for HGR, it is still very challenging to satisfy the requirements of both high efficiency and accuracy for real-world HGR systems. In this paper, we propose a novel method using the feature covariance matrix for effective and efficient dynamic HGR. We extract a set of local feature vectors that represent local motion patterns to construct the feature covariance matrix efficiently, which also provides a compact representation of a dynamic hand gesture. By tracking hand keypoints in three successive frames and calculating their motion features, our method can be extended to both 2D dynamic HGR and 3D dynamic HGR. To evaluate the effectiveness of the proposed framework, we perform extensive experiments on three publicly available datasets (one 2D dataset and two 3D datasets). The experimental results demonstrate the effectiveness of our proposed method.
Year
DOI
Venue
2019
10.1007/s00521-018-3719-3
Neural Computing and Applications
Keywords
Field
DocType
Dynamic hand gesture recognition, Feature covariance matrix, Pyramid Lucas–Kanade tracker, Temporal hierarchical construction
Feature vector,Pattern recognition,Gesture,Gesture recognition,RGB color model,Artificial intelligence,Covariance matrix,Deep learning,Mathematics,Machine learning
Journal
Volume
Issue
ISSN
31.0
12
1433-3058
Citations 
PageRank 
References 
1
0.38
23
Authors
6
Name
Order
Citations
PageRank
Linpu Fang132.47
Guile Wu2172.39
Wenxiong Kang3386.66
Qiuxia Wu493.20
Zhiyong Wang555051.76
David Dagan Feng63329413.76