Title
Cross-media retrieval by cluster-based correlation analysis
Abstract
Multimedia content such as images and texts with similar semantic meanings are always used together. Therefore, to utilize the information shared by multi-modal objects, cross-media retrieval is becoming increasingly crucial. This area concerns problems that query and results are of different media types. Existing methods either neglect correlations between entities of different media types, or suffer low performances when adopting correlation analysis and facing queries out of dataset. In this paper, we present cluster-based correlation analysis (CBCA) to exploit the correlation between different types of multimedia objects, and to measure heterogeneous semantic similarities. Based on a collection of multimedia documents (MMD), CBCA first perform clustering on uni-media feature spaces to produce several semantic clusters for each modality. After that, by using the co-occurrence information of semantic clusters of different modalities, CBCA constructs a cross-modal cluster graph (CMCG) to represent the similarities between clusters. Our proposed CBCA exploits semantic meanings of a finer granularity by clustering, mines semantic correlation between clusters instead of multimedia objects. Compared with state-of-art methods, experiments on Sina Weibo dataset show the effectiveness of CBCA.
Year
DOI
Venue
2013
10.1109/ICIP.2013.6738821
ICIP
Keywords
Field
DocType
correlation analysis,cbca,multimedia systems,pattern clustering,cross-modal cluster graph,multimedia objects,multimedia documents,multimedia content,semantic cluster co-occurrence information,cluster-based correlation analysis,multimedia,heterogeneous semantic similarity measurement,query,cluster analysis,multimodal objects,sina weibo dataset,cross-media retrieval,semantic correlation mining,cmcg,data mining,graph theory,mmd,document handling,query processing,uni-media feature spaces
Graph theory,Cluster (physics),Information retrieval,Computer science,Cross media,Exploit,Correlation,Granularity,Cluster analysis,Correlation analysis
Conference
ISSN
Citations 
PageRank 
1522-4880
4
0.40
References 
Authors
10
3
Name
Order
Citations
PageRank
Ding Ma140.40
Xiaohua Zhai220913.00
Yuxin Peng3112274.90