Title
Unsupervised video categorization based on multivariate information bottleneck method
Abstract
Novel multivariate IB model is proposed for unsupervised video categorization.Effective solution is designed to integrate multiple features simultaneously.Information-theoretic optimization is constructed to alleviate the semantic gap. The integration of multiple features is important for action categorization and object recognition in videos, because single feature based representation hardly captures imaging variations and individual attributes. In this paper, a novel formulation named Multivariate video Information Bottleneck (MvIB) is defined. It is an extensional type of multivariate information bottleneck and can discover categories from a collection of unlabeled videos automatically. Differing from the original multivariate information bottleneck, the novel approach extracts the video categories from multiple features simultaneously, such as local static and dynamic feature, each type of feature is treated as a relevant variable. Specifically, by preserving the relevant information with respect to these feature variables maximally, the MvIB method is able to integrate various aspects of semantic information into the final video partitioning results, and thus captures the complementary information resided in multiple feature variables. Extensive experimental results on five challenging video data sets show that the proposed approach can consistently and significantly outperform other state-of-the-art unsupervised learning methods.
Year
DOI
Venue
2015
10.1016/j.knosys.2015.03.028
Knowledge-Based Systems
Keywords
Field
DocType
Video categorization,Unsupervised learning,Multivariate information bottleneck,Multiple features,Mutual information
Data mining,Data set,Computer science,Unsupervised learning,Artificial intelligence,Information bottleneck method,Categorization,Pattern recognition,Multivariate statistics,Semantic gap,Mutual information,Machine learning,Cognitive neuroscience of visual object recognition
Journal
Volume
Issue
ISSN
84
C
0950-7051
Citations 
PageRank 
References 
3
0.36
27
Authors
3
Name
Order
Citations
PageRank
Xiaoqiang Yan1205.35
Yangdong Ye211829.64
Zhengzheng Lou3103.53