Title
A Flexible Framework for the Evaluation of Unsupervised Image Annotation.
Abstract
Automatic Image Annotation (AIA) consists in assigning keywords to images describing their visual content. A prevalent way to address the AIA task is based on supervised learning. However, the unsupervised approach is a new alternative that makes a lot of sense when there are not manually labeled images to train supervised techniques. AIA methods are typically evaluated using supervised learning performance measures, however applying these kind of measures to unsupervised methods is difficult and unfair. The main restriction has to do with the fact that unsupervised methods use an unrestricted annotation vocabulary while supervised methods use a restricted one. With the aim to alleviate the unfair evaluation, in this paper we propose a flexible evaluation framework that allows us to compare coverage and relevance of the assigned words by unsupervised automatic image annotation (UAIA) methods. We show the robustness of our framework through a set of experiments where we evaluated the output of both, unsupervised and supervised methods.
Year
Venue
Field
2017
CIARP
Annotation,Automatic image annotation,Pattern recognition,Computer science,Supervised learning,Robustness (computer science),Artificial intelligence,Vocabulary,Machine learning
DocType
Citations 
PageRank 
Conference
1
0.35
References 
Authors
6
5
Name
Order
Citations
PageRank
Luis Pellegrin110.68
Hugo Jair Escalante293973.89
Manuel Montes-Y-Gómez363883.97
Mauricio Villegas421919.25
Fabio A. González556655.03