Name
Title | ||
|---|---|---|
Toward bridging the annotation-retrieval gap in image search by a generative modeling approach |
Abstract | ||
|---|---|---|
While automatic image annotation remains an actively pursued research topic, enhancement of image search through its use has not been extensively explored. We propose an annotation-driven image retrieval approach and argue that under a number of different scenarios, this is very effective for semantically meaningful image search. In particular, our system is demonstrated to effectively handle cases of partially tagged and completely untagged image databases, multiple keyword queries, and example based queries with or without tags, all in near-realtime. Because our approach utilizes extra knowledge from a training dataset, it outperforms state-of-the-art visual similarity based retrieval techniques. For this purpose, a novel structure-composition model constructed from Beta distributions is developed to capture the spatial relationship among segmented regions of images. This model combined with the Gaussian mixture model produces scalable categorization of generic images. The categorization results are found to surpass previously reported results in speed and accuracy. Our novel annotation framework utilizes the categorization results to select tags based on term frequency, term saliency, and a WordNet-based measure of congruity, to boost salient tags while penalizing potentially unrelated ones. A bag of words distance measure based on WordNet is used to compute semantic similarity. The effectiveness of our approach is shown through extensive experiments. |
Year | DOI | Venue |
|---|---|---|
2006 | 10.1145/1180639.1180856 | ACM Multimedia 2001 |
Keywords | Field | DocType |
annotation-retrieval gap,novel structure-composition model,gaussian mixture model,annotation-driven image retrieval approach,semantically meaningful image search,image search,categorization result,scalable categorization,untagged image databases,automatic image annotation,generative modeling approach,generic image,computational semantics,spatial relationships,image retrieval,beta distribution,bag of words,term frequency | Bag-of-words model,Computer science,Image retrieval,Artificial intelligence,WordNet,Semantic similarity,Categorization,Computer vision,Automatic image annotation,Annotation,Information retrieval,Pattern recognition,Mixture model | Conference |
ISBN | Citations | PageRank |
1-59593-447-2 | 30 | 1.31 |
References | Authors | |
24 | 4 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Ritendra Datta | 1 | 2526 | 104.69 |
| Weina Ge | 2 | 639 | 25.29 |
| Jia Li | 3 | 12743 | 658.57 |
| James Z. Wang | 4 | 7526 | 403.00 |