Title
Unsupervised Universal Attribute Modelling for Action Recognition
Abstract
A fixed dimensional representation for action clips of varying lengths has been proposed in the literature using aggregation models like bag-of-words and Fisher vector. These representations are high dimensional and require classification techniques for action recognition. In this paper, we propose a framework for unsupervised extraction of a discriminative low-dimensional representation called action-vector. To start with, local spatio-temporal features are utilized to capture the action attributes implicitly in a large Gaussian mixture model called the universal attribute model (UAM). To enhance the contribution of the significant attributes in each action clip, a maximum <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">aposteriori</italic> adaptation of the UAM means is performed for each clip. This results in a concatenated mean vector called super action vector (SAV) for each action clip. However, the SAV is still high dimensional because of the presence of redundant attributes. Hence, we employ factor analysis to represent every SAV only in terms of the few important attributes contributing to the action clip. This leads to a low-dimensional representation called action-vector. This entire procedure requires no class labels and produces action-vectors that are distinct representations of each action irrespective of the inter-actor variability encountered in unconstrained videos. An evaluation on trimmed action datasets UCF101 and HMDB51 demonstrates the efficacy of action-vectors for action classification over state-of-the-art techniques. Moreover, we also show that action-vectors can adequately represent untrimmed videos from the THUMOS14 dataset and produce classification results comparable to existing techniques.
Year
DOI
Venue
2019
10.1109/tmm.2018.2887021
IEEE Transactions on Multimedia
Keywords
Field
DocType
Feature extraction,Videos,Probability density function,Adaptation models,Manuals,Histograms,Random processes
Histogram,Pattern recognition,Computer science,Action recognition,Stochastic process,Feature extraction,Artificial intelligence,Concatenation,Discriminative model,Probability density function,Mixture model
Journal
Volume
Issue
ISSN
21
7
1520-9210
Citations 
PageRank 
References 
0
0.34
0
Authors
3
Name
Order
Citations
PageRank
Debaditya Roy1304.98
K. Sri Rama Murty217614.31
C. Krishna Mohan312417.83