Title
Combinative hypergraph learning in subspace for cross-modal ranking.
Abstract
Recent years have witnessed a surge of interests in cross-modal ranking. To bridge the gap between heterogeneous modalities, many projection based methods have been studied to learn common subspace where the correlation across different modalities can be directly measured. However, these methods generally consider pair-wise relationship merely, while ignoring the high-order relationship. In this paper, a combinative hypergraph learning in subspace for cross-modal ranking (CHLS) is proposed to enhance the performance of cross-modal ranking by capturing high-order relationship. We formulate the cross-modal ranking as a hypergraph learning problem in latent subspace where the high-order relationship among ranking instances can be captured. Furthermore, we propose a combinative hypergraph based on fused similarity information to encode both the intra-similarity in each modality and the inter-similarity across different modalities into the compact subspace representation, which can further enhance the performance of cross-modal ranking. Experiments on three representative cross-modal datasets show the effectiveness of the proposed method for cross-modal ranking. Furthermore, the ranking results achieved by the proposed CHLS can recall 80% of the relevant cross-modal instances at a much earlier stage compared against state-of-the-art methods for both cross-modal ranking tasks, i.e. image query text and text query image.
Year
DOI
Venue
2018
10.1007/s11042-018-5830-y
Multimedia Tools Appl.
Keywords
Field
DocType
Cross-modal ranking, Subspace learning, Hypergraph, Similarity preserving
Modalities,ENCODE,Pattern recognition,Ranking,Subspace topology,Computer science,Hypergraph,Correlation,Artificial intelligence,Recall,Modal
Journal
Volume
Issue
ISSN
77
19
1380-7501
Citations 
PageRank 
References 
1
0.35
45
Authors
6
Name
Order
Citations
PageRank
Fangming Zhong196.57
Zhikui Chen269266.76
Geyong Min371.78
Zhaolong Ning455350.11
Hua Zhong510013.13
Yueming Hu621528.01