Title
Hidden States Exploration For 3d Skeleton-Based Gesture Recognition
Abstract
3D skeletal data has recently attracted wide attention in human behavior analysis for its robustness to variant scenes, while accurate gesture recognition is still challenging. The main reason lies in the high intra-class variance caused by temporal dynamics. A solution is resorting to the generative models, such as the hidden Markov model (H-MM). However, existing methods commonly assume fixed anchors for each hidden state, which is hard to depict the explicit temporal structure of gestures. Based on the observation that a gesture is a time series with distinctly defined phases, we propose a new formulation to build temporal compositions of gestures by the low-rank matrix decomposition. The only assumption is that the gesture's "hold" phases with static poses are linearly correlated among each other. As such, a gesture sequence could be segmented into temporal states with semantically meaningful and discriminative concepts. Furthermore, different to traditional HMMs which tend to use specific distance metric for clustering and ignore the temporal contextual information when estimating the emission probability, the Long Short-Term Memory (LSTM) is utilized to learn probability distributions over states of HMM. The proposed method is validated on two challenging datasets. Experiments demonstrate that our approach can effectively work on a wide range of gestures and actions, and achieve state-of-the-art performance.
Year
DOI
Venue
2019
10.1109/WACV.2019.00201
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV)
Field
DocType
ISSN
Pattern recognition,Computer science,Gesture,Gesture recognition,Metric (mathematics),Recurrent neural network,Probability distribution,Artificial intelligence,Hidden Markov model,Cluster analysis,Discriminative model
Conference
2472-6737
Citations 
PageRank 
References 
1
0.35
0
Authors
6
Name
Order
Citations
PageRank
Xin Liu128774.92
Henglin Shi261.77
Xiaopeng Hong337942.27
Hao-Yu Chen49715.08
Dacheng Tao519032747.78
Guoying Zhao63767166.92