Abstract | ||
---|---|---|
Most popular systems for object instance search are based on the bag-of-visual-word model. The inherent weaknesses of this standard model such as quantization error, unstructured representation, burstiness phenomenon are to some extent solved. However, it has a serious problem of searching small objects on a database with cluttered background. In many situations, even the irrelevant objects which share the same texture or shape with a query object get higher score than relevant ones. To overcome this problem, we propose a novel fusion method to significantly boost the accuracy of instance search systems. Firstly, we use the state-of-the-art object detector with denser feature for finding object bounding box and similarity score. Secondly, to exploit the spatial relationship of each visual word with an object proposal, a detected area that might contain a query object, we define three categories of visual word pairs, i.e., discriminative, weak relevant, and context inferred ones. Finally, we propose a new re-ranking scheme with three weighting functions corresponding to the three categories of visual word pairs to compute the final similarity score between a query topic and a video shot. To illustrate the efficiency of the proposed method, we conduct experiments on datasets which have a wide variety of types of query objects. Experimental results on TRECVID Instance Search datasets (INS2013 and INS2014) show the superiority of our proposed method over the state-of-the-art approaches. |
Year | DOI | Venue |
---|---|---|
2019 | 10.1007/s13735-019-00172-z | International Journal of Multimedia Information Retrieval |
Keywords | Field | DocType |
Video instance search, Bag-of-visual-word model, Object proposal, Spatial fusion | Weighting,Pattern recognition,TRECVID,Computer science,Exploit,Burstiness,Artificial intelligence,Quantization (signal processing),Discriminative model,Visual Word,Minimum bounding box | Journal |
Volume | Issue | ISSN |
8 | 3 | 2192-6611 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
7 |
Name | Order | Citations | PageRank |
---|---|---|---|
Vinh-Tiep Nguyen | 1 | 25 | 22.31 |
Duy-dinh Le | 2 | 213 | 38.89 |
Minh-Triet Tran | 3 | 143 | 59.60 |
Tam Van Nguyen | 4 | 206 | 18.38 |
Thanh Duc Ngo | 5 | 82 | 22.24 |
Shin'ichi Satoh | 6 | 2093 | 277.41 |
Duc Anh Duong | 7 | 112 | 19.65 |