Name
Abstract | ||
|---|---|---|
The bag-of-systems (BoS) representation is a descriptor of motion in a video, where dynamic texture (DT) codewords represent the typical motion patterns in spatio-temporal patches extracted from the video. The efficacy of the BoS descriptor depends on the richness of the codebook, which depends on the number of codewords in the codebook. However, for even modest sized codebooks, mapping videos onto the codebook results in a heavy computational load. In this paper we propose the BoS Tree, which constructs a bottom-up hierarchy of codewords that enables efficient mapping of videos to the BoS codebook. By leveraging the tree structure to efficiently index the codewords, the BoS Tree allows for fast look-ups in the codebook and enables the practical use of larger, richer codebooks. We demonstrate the effectiveness of BoS Trees on classification of four video datasets, as well as on annotation of a video dataset and a music dataset. Finally, we show that, although the fast look-ups of BoS Tree result in different descriptors than BoS for the same video, the overall distance (and kernel) matrices are highly correlated resulting in similar classification performance. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1109/TPAMI.2014.2359432 | Pattern Analysis and Machine Intelligence, IEEE Transactions |
Keywords | Field | DocType |
feature extraction,image classification,image motion analysis,image representation,image texture,matrix algebra,music,trees (mathematics),video coding,bos representation,dt codewords,bag of system trees,bag-of-system representation,distance matrices,dynamic texture codewords,dynamic textures,motion patterns,music dataset annotation,spatio-temporal patch extraction,tree structure,video dataset annotation,video dataset classification,video mapping,bag of systems,dynamic texture recognition,efficient indexing,large codebooks,music annotation,video annotation,vegetation,histograms,indexing,vectors,clustering algorithms | Kernel (linear algebra),Histogram,Computer vision,Pattern recognition,Computer science,Matrix (mathematics),Search engine indexing,Tree structure,Artificial intelligence,Cluster analysis,Scalability,Codebook | Journal |
Volume | Issue | ISSN |
37 | 4 | 0162-8828 |
Citations | PageRank | References |
12 | 0.51 | 30 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Adeel Mumtaz | 1 | 47 | 2.42 |
| Emanuele Coviello | 2 | 798 | 23.59 |
| Gert R. G. Lanckriet | 3 | 4769 | 296.98 |
| Antoni B. Chan | 4 | 1658 | 88.09 |