Title
Learning correlations for human action recognition in videos.
Abstract
Human action recognition in realistic videos is an important and challenging task. Recent studies demonstrate that multi-feature fusion can significantly improve the classification performance for human action recognition. Therefore, a number of researches utilize fusion strategies to combine multiple features and achieve promising results. Nevertheless, previous fusion strategies ignore the correlations of different action categories. To address this issue, we propose a novel multi-feature fusion framework, which utilizes the correlations of different action categories and multiple features. To describe human actions, this framework combines several classical features, which are extracted with deep convolutional neural networks and improved dense trajectories. Moreover, massive experiments are conducted on two challenging datasets to evaluate the effectiveness of our approach, and the proposed approach obtains the state-of-the-art classification accuracy of 68.1 % and 93.3 % on the HMDB51 and UCF101 datasets, respectively. Furthermore, the proposed approach achieves better performances than five classical fusion schemes, as the correlations are used to combine multiple features in this framework. To the best of our knowledge, this work is the first attempt to learn the correlations of different action categories for multi-feature fusion.
Year
DOI
Venue
2017
10.1007/s11042-017-4416-4
Multimedia Tools Appl.
Keywords
Field
DocType
Human action recognition, Late fusion, Learning correlations, Multiple features
Pattern recognition,Computer science,Convolutional neural network,Action recognition,Artificial intelligence,Machine learning
Journal
Volume
Issue
ISSN
76
18
1573-7721
Citations 
PageRank 
References 
3
0.36
36
Authors
3
Name
Order
Citations
PageRank
Yun Yi1294.48
Hanli Wang286569.10
Bowen Zhang3804.49