Title
Video instance search via spatial fusion of visual words and object proposals
Abstract
Most popular systems for object instance search are based on the bag-of-visual-word model. The inherent weaknesses of this standard model such as quantization error, unstructured representation, burstiness phenomenon are to some extent solved. However, it has a serious problem of searching small objects on a database with cluttered background. In many situations, even the irrelevant objects which share the same texture or shape with a query object get higher score than relevant ones. To overcome this problem, we propose a novel fusion method to significantly boost the accuracy of instance search systems. Firstly, we use the state-of-the-art object detector with denser feature for finding object bounding box and similarity score. Secondly, to exploit the spatial relationship of each visual word with an object proposal, a detected area that might contain a query object, we define three categories of visual word pairs, i.e., discriminative, weak relevant, and context inferred ones. Finally, we propose a new re-ranking scheme with three weighting functions corresponding to the three categories of visual word pairs to compute the final similarity score between a query topic and a video shot. To illustrate the efficiency of the proposed method, we conduct experiments on datasets which have a wide variety of types of query objects. Experimental results on TRECVID Instance Search datasets (INS2013 and INS2014) show the superiority of our proposed method over the state-of-the-art approaches.
Year
DOI
Venue
2019
10.1007/s13735-019-00172-z
International Journal of Multimedia Information Retrieval
Keywords
Field
DocType
Video instance search, Bag-of-visual-word model, Object proposal, Spatial fusion
Weighting,Pattern recognition,TRECVID,Computer science,Exploit,Burstiness,Artificial intelligence,Quantization (signal processing),Discriminative model,Visual Word,Minimum bounding box
Journal
Volume
Issue
ISSN
8
3
2192-6611
Citations 
PageRank 
References 
0
0.34
0
Authors
7
Name
Order
Citations
PageRank
Vinh-Tiep Nguyen12522.31
Duy-dinh Le221338.89
Minh-Triet Tran314359.60
Tam Van Nguyen420618.38
Thanh Duc Ngo58222.24
Shin'ichi Satoh62093277.41
Duc Anh Duong711219.65