Abstract | ||
---|---|---|
Automatic annotation of digital pictures is a key technology for managing and retrieving images from large image collections. Typical algorithms only deal with the problem of monolingual image annotation. In this paper, we propose a framework to deal with the problem of multilingual image annotation, which can annotate images in multiple languages. The framework can not only benefit users with different native languages, but also provide more accurate annotations. In this framework, image annotation is performed in two stages, including parallel monolingual image annotation and the fusion of annotation results in multiple languages. In the first stage, candidate annotations for each language are extracted by leveraging multilingual large scale web image database. Due to the incompleteness and inaccuracy problem of candidate annotations, we proposed a multilingual annotation fusion algorithm (MAF). By modeling candidate annotations for each language as an n-partite graph, MAF algorithm can improve and re-rank multilingual annotations. Finally, annotations with the highest ranking values in each language are selected and translated as the result. Experimental results for English-Chinese image annotations demonstrate the effectiveness of the proposed framework. |
Year | DOI | Venue |
---|---|---|
2009 | 10.1109/ICME.2009.5202826 | ICME |
Keywords | Field | DocType |
image database,accurate annotation,monolingual image annotation,multiple language,large image collection,image annotation,automatic annotation,cross-language image annotation,english-chinese image annotation,annotation result,candidate annotation,feature extraction,image retrieval,data mining,natural languages,graph theory,dictionaries,training data,native language | Graph theory,Annotation,Automatic image annotation,Ranking,Information retrieval,Computer science,Image retrieval,Feature extraction,Natural language,Natural language processing,Artificial intelligence,Digital pictures | Conference |
ISSN | Citations | PageRank |
1945-7871 | 0 | 0.34 |
References | Authors | |
11 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Xiaoguang Rui | 1 | 87 | 7.59 |
Nenghai Yu | 2 | 2238 | 183.33 |
Mingjing Li | 3 | 3076 | 192.39 |
Lei Wu | 4 | 669 | 40.02 |