Title
Query Specific Rank Fusion for Image Retrieval
Abstract
Recently two lines of image retrieval algorithms demonstrate excellent scalability: 1) local features indexed by a vocabulary tree, and 2) holistic features indexed by compact hashing codes. Although both of them are able to search visually similar images effectively, their retrieval precision may vary dramatically among queries. Therefore, combining these two types of methods is expected to further enhance the retrieval precision. However, the feature characteristics and the algorithmic procedures of these methods are dramatically different, which is very challenging for the feature-level fusion. This motivates us to investigate how to fuse the ordered retrieval sets, i.e., the ranks of images, given by multiple retrieval methods, to boost the retrieval precision without sacrificing their scalability. In this paper, we model retrieval ranks as graphs of candidate images and propose a graph-based query specific fusion approach, where multiple graphs are merged and reranked by conducting a link analysis on a fused graph. The retrieval quality of an individual method is measured on-the-fly by assessing the consistency of the top candidates' nearest neighborhoods. Hence, it is capable of adaptively integrating the strengths of the retrieval methods using local or holistic features for different query images. This proposed method does not need any supervision, has few parameters, and is easy to implement. Extensive and thorough experiments have been conducted on four public datasets, i.e., the UKbench, Corel-5K, Holidays and the large-scale San Francisco Landmarks datasets. Our proposed method has achieved very competitive performance, including state-of-the-art results on several data sets, e.g., the N-S score 3.83 for UKbench.
Year
DOI
Venue
2015
10.1109/TPAMI.2014.2346201
IEEE Trans. Pattern Anal. Mach. Intell.
Keywords
Field
DocType
feature-level fusion,large-scale san francisco landmarks datasets,graph-based query specific fusion approach,image fusion,multiple retrieval methods,query specific rank fusion,trees (mathematics),link analysis,query specific fusion,holidays public datasets,compact hashing codes,ukbench public datasets,hashing,vocabulary tree,large-scale image retrieval,image retrieval,ordered retrieval set fusion,image retrieval algorithms,corel-5k public datasets,top candidate nearest neighborhoods,graph-based fusion,visualization,fuses,scalability
Data mining,Data set,Computer science,Link analysis,Image retrieval,Artificial intelligence,Pattern recognition,Query expansion,Information retrieval,Visualization,Hash function,Scalability,Visual Word
Journal
Volume
Issue
ISSN
37
4
0162-8828
Citations 
PageRank 
References 
70
1.22
40
Authors
5
Name
Order
Citations
PageRank
shaoting zhang1183192.08
Ming Yang23471162.50
Timothee Cour382134.72
Yu, Kai44799255.21
Dimitris N. Metaxas58834952.25