Abstract | ||
---|---|---|
Multimedia content such as images and texts with similar semantic meanings are always used together. Therefore, to utilize the information shared by multi-modal objects, cross-media retrieval is becoming increasingly crucial. This area concerns problems that query and results are of different media types. Existing methods either neglect correlations between entities of different media types, or suffer low performances when adopting correlation analysis and facing queries out of dataset. In this paper, we present cluster-based correlation analysis (CBCA) to exploit the correlation between different types of multimedia objects, and to measure heterogeneous semantic similarities. Based on a collection of multimedia documents (MMD), CBCA first perform clustering on uni-media feature spaces to produce several semantic clusters for each modality. After that, by using the co-occurrence information of semantic clusters of different modalities, CBCA constructs a cross-modal cluster graph (CMCG) to represent the similarities between clusters. Our proposed CBCA exploits semantic meanings of a finer granularity by clustering, mines semantic correlation between clusters instead of multimedia objects. Compared with state-of-art methods, experiments on Sina Weibo dataset show the effectiveness of CBCA. |
Year | DOI | Venue |
---|---|---|
2013 | 10.1109/ICIP.2013.6738821 | ICIP |
Keywords | Field | DocType |
correlation analysis,cbca,multimedia systems,pattern clustering,cross-modal cluster graph,multimedia objects,multimedia documents,multimedia content,semantic cluster co-occurrence information,cluster-based correlation analysis,multimedia,heterogeneous semantic similarity measurement,query,cluster analysis,multimodal objects,sina weibo dataset,cross-media retrieval,semantic correlation mining,cmcg,data mining,graph theory,mmd,document handling,query processing,uni-media feature spaces | Graph theory,Cluster (physics),Information retrieval,Computer science,Cross media,Exploit,Correlation,Granularity,Cluster analysis,Correlation analysis | Conference |
ISSN | Citations | PageRank |
1522-4880 | 4 | 0.40 |
References | Authors | |
10 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ding Ma | 1 | 4 | 0.40 |
Xiaohua Zhai | 2 | 209 | 13.00 |
Yuxin Peng | 3 | 1122 | 74.90 |