Abstract | ||
---|---|---|
A fixed dimensional representation for action clips of varying lengths has been proposed in the literature using aggregation models like bag-of-words and Fisher vector. These representations are high dimensional and require classification techniques for action recognition. In this paper, we propose a framework for unsupervised extraction of a discriminative low-dimensional representation called action-vector. To start with, local spatio-temporal features are utilized to capture the action attributes implicitly in a large Gaussian mixture model called the universal attribute model (UAM). To enhance the contribution of the significant attributes in each action clip, a maximum
<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">aposteriori</italic>
adaptation of the UAM means is performed for each clip. This results in a concatenated mean vector called super action vector (SAV) for each action clip. However, the SAV is still high dimensional because of the presence of redundant attributes. Hence, we employ factor analysis to represent every SAV only in terms of the few important attributes contributing to the action clip. This leads to a low-dimensional representation called action-vector. This entire procedure requires no class labels and produces action-vectors that are distinct representations of each action irrespective of the inter-actor variability encountered in unconstrained videos. An evaluation on trimmed action datasets UCF101 and HMDB51 demonstrates the efficacy of action-vectors for action classification over state-of-the-art techniques. Moreover, we also show that action-vectors can adequately represent untrimmed videos from the THUMOS14 dataset and produce classification results comparable to existing techniques. |
Year | DOI | Venue |
---|---|---|
2019 | 10.1109/tmm.2018.2887021 | IEEE Transactions on Multimedia |
Keywords | Field | DocType |
Feature extraction,Videos,Probability density function,Adaptation models,Manuals,Histograms,Random processes | Histogram,Pattern recognition,Computer science,Action recognition,Stochastic process,Feature extraction,Artificial intelligence,Concatenation,Discriminative model,Probability density function,Mixture model | Journal |
Volume | Issue | ISSN |
21 | 7 | 1520-9210 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Debaditya Roy | 1 | 30 | 4.98 |
K. Sri Rama Murty | 2 | 176 | 14.31 |
C. Krishna Mohan | 3 | 124 | 17.83 |