Name
Abstract | ||
|---|---|---|
Most state-of-the-art systems for content-based video understanding tasks require video content to be represented as collections of many low-level descriptors, e.g. as histograms of the color, texture or motion in local image regions. In order to preserve as much of the information contained in the original video as possible, these representations are typically high-dimensional, which conflicts with the aim for compact descriptors that would allow better efficiency and lower storage requirements. In this paper, we address the problem of semantic compression of video, i.e. the reduction of low-level descriptors to a small number of dimensions while preserving most of the semantic information. For this, we adapt topic models - which have previously been used as compact representations of still images - to take into account the temporal structure of a video, as well as multi-modal components such as motion information. Experiments on a large-scale collection of YouTube videos show that we can achieve a compression ratio of 20 : 1 compared to ordinary histogram representations and at least 2 : 1 compared to other dimensionality reduction techniques without significant loss of prediction accuracy. Also, improvements are demonstrated for our video-specific extensions modeling temporal structure and multiple modalities. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1145/1743384.1743433 | Multimedia Information Retrieval |
Keywords | Field | DocType |
video compression,temporal structure,motion information,video content,content-based video understanding task,compact descriptors,topic model,compact representation,low-level descriptors,semantic information,original video,youtube video,topic models,compression ratio | Block-matching algorithm,Dimensionality reduction,Computer science,Motion compensation,Artificial intelligence,Video compression picture types,Semantic compression,Computer vision,Pattern recognition,Information retrieval,Video tracking,Topic model,Data compression | Conference |
Citations | PageRank | References |
3 | 0.47 | 28 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Jörn Wanke | 1 | 3 | 0.47 |
| Adrian Ulges | 2 | 328 | 26.61 |
| Christoph H. Lampert | 3 | 2718 | 125.52 |
| Thomas M. Breuel | 4 | 2362 | 219.10 |
| Thomas M. Breuel | 5 | 2362 | 219.10 |