Title
On cross-language image annotations
Abstract
Automatic annotation of digital pictures is a key technology for managing and retrieving images from large image collections. Typical algorithms only deal with the problem of monolingual image annotation. In this paper, we propose a framework to deal with the problem of multilingual image annotation, which can annotate images in multiple languages. The framework can not only benefit users with different native languages, but also provide more accurate annotations. In this framework, image annotation is performed in two stages, including parallel monolingual image annotation and the fusion of annotation results in multiple languages. In the first stage, candidate annotations for each language are extracted by leveraging multilingual large scale web image database. Due to the incompleteness and inaccuracy problem of candidate annotations, we proposed a multilingual annotation fusion algorithm (MAF). By modeling candidate annotations for each language as an n-partite graph, MAF algorithm can improve and re-rank multilingual annotations. Finally, annotations with the highest ranking values in each language are selected and translated as the result. Experimental results for English-Chinese image annotations demonstrate the effectiveness of the proposed framework.
Year
DOI
Venue
2009
10.1109/ICME.2009.5202826
ICME
Keywords
Field
DocType
image database,accurate annotation,monolingual image annotation,multiple language,large image collection,image annotation,automatic annotation,cross-language image annotation,english-chinese image annotation,annotation result,candidate annotation,feature extraction,image retrieval,data mining,natural languages,graph theory,dictionaries,training data,native language
Graph theory,Annotation,Automatic image annotation,Ranking,Information retrieval,Computer science,Image retrieval,Feature extraction,Natural language,Natural language processing,Artificial intelligence,Digital pictures
Conference
ISSN
Citations 
PageRank 
1945-7871
0
0.34
References 
Authors
11
4
Name
Order
Citations
PageRank
Xiaoguang Rui1877.59
Nenghai Yu22238183.33
Mingjing Li33076192.39
Lei Wu466940.02