Name
Abstract | ||
|---|---|---|
With emerging demand for large-scale video analysis, the Motion Picture Experts Group (MPEG) initiated the Compact Descriptor for Video Analysis (CDVA) standardization in 2014. In this work, we develop novel deep-learning features and incorporate them into the well-established CDVA evaluation framework to study its effectiveness in video analysis. In particular, we propose a Nested Invariance Pooling (NIP) method to obtain compact and robust Convolutional Neural Network (CNNs) descriptors. The CNNs descriptors are generated by applying three different pooling operations to the feature maps of CNNs in a nested way towards rotation and scale invariant feature representation. In particular, the rational, advantages and performance on the combination of CNNs and handcrafted descriptors are provided to better investigate the complementary effects of deep learnt and handcrafted features. Extensive experimental results show that the proposed CNNs descriptors outperform both state-of-the-art CNNs descriptors and canonical handcrafted descriptors adopted in CDVA Experimental Model (CXM) with significant mAP gains of 11.3% and 4.7%, respectively. Moreover, the combination of NIP derived deep invariant descriptors and handcrafted descriptors not only fulfills the lowest bitrate budget of CDVA, but also significantly advances the performance of CDVA core techniques. |
Year | DOI | Venue |
|---|---|---|
2017 | 10.1109/DCC.2017.31 | 2017 Data Compression Conference (DCC) |
Keywords | Field | DocType |
Video Retrieval,Invariant Descriptor,Nested Pooling,Deep Neural Network | Scale invariance,Convolutional neural network,Computer science,Artificial intelligence,Artificial neural network,Computer vision,Invariant (physics),Pattern recognition,Pooling,Transform coding,Feature extraction,Invariant (mathematics),Machine learning | Conference |
Volume | ISSN | ISBN |
Part F127767 | 1068-0314 | 978-1-5090-6722-0 |
Citations | PageRank | References |
5 | 0.42 | 10 |
Authors | ||
10 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Lou Yihang | 1 | 75 | 9.57 |
| yan bai | 2 | 56 | 7.60 |
| Jie Lin | 3 | 3495 | 502.80 |
| Shiqi Wang | 4 | 1281 | 120.37 |
| Jie Chen | 5 | 62 | 4.95 |
| Vijay Chandrasekhar | 6 | 191 | 22.83 |
| Ling-yu Duan | 7 | 1770 | 124.87 |
| Tiejun Huang | 8 | 1281 | 120.48 |
| Alex C. Kot | 9 | 1096 | 92.07 |
| Wen Gao | 10 | 11374 | 741.77 |