Title
Action recognition and tracking via deep representation extraction and motion bases learning
Abstract
Action recognition and positional tracking are critical issues in many applications in Virtual Reality (VR). In this paper, a novel feature representation method is proposed to recognize actions based on sensor signals. The feature extraction is achieved by jointly learning Convolutional Auto-Encoder (CAE) and the representation of motion bases via clustering, which is called the Sequence of Cluster Centroids (SoCC). Then, the learned features are used to train the action recognition classifier. We have collected new dataset of actions of limbs by sensor signals. In addition, a novel action tracking method is proposed for the VR environment. It extends the sensor signals from three Degrees of Freedom (DoF) of rotation to 6DoF of position plus rotation. Experimental results demonstrate that CAE-SoCC feature is effective for action recognition and accurate prediction of position displacement.
Year
DOI
Venue
2022
10.1007/s11042-021-11888-8
Multimedia Tools and Applications
Keywords
DocType
Volume
Action recognition, Motion bases, Action tracking, Deep learning
Journal
81
Issue
ISSN
Citations 
9
1380-7501
0
PageRank 
References 
Authors
0.34
12
4
Name
Order
Citations
PageRank
Hao-Ting Li100.34
Yung-Pin Liu200.34
Yun-Kai Chang300.34
Chen-Kuo Chiang400.34