Title
Scalable, accurate image annotation with joint SVMs and output kernels.
Abstract
This paper studies how joint training of multiple support vector machines (SVMs) can improve the effectiveness and efficiency of automatic image annotation. We cast image annotation as an output-related multi-task learning framework, with the prediction of each tag׳s presence as one individual task. Evidently, these tasks are related via dependencies between tags. The proposed joint learning framework, which we call joint SVM, is superior to other related models in its impressive and flexible mechanisms in exploiting the dependencies between tags: first, a linear output kernel can be implicitly learned when we train a joint SVM; or, a pre-designed kernel can be explicitly applied by users when prior knowledge is available. Also, a practical merit of joint SVM is that it shares the same computational complexity as one single conventional SVM, although multiple tasks are solved simultaneously. Although derived from the perspective of multi-task learning, the proposed joint SVM is highly related to structured-output learning techniques, e.g. max-margin regression (Szedmak and Shawe-taylor [1]), structural SVM (Tsochantaridis [2]). According to our empirical results on several image-annotation benchmark databases, our joint training strategy of SVMs can yield substantial improvements, in terms of both accuracy and efficiency, over training them independently. In particular, it compares favorably with many other state-of-the-art algorithms. We also develop a “perceptron-like” online learning scheme for joint SVM to enable it to scale up better to huge data in real-world practice.
Year
DOI
Venue
2015
10.1016/j.neucom.2014.11.096
Neurocomputing
Keywords
Field
DocType
Image annotation,Multi-label learning,Output kernels,Maximum margin
Data mining,Computer science,Artificial intelligence,Flexible Mechanisms,Kernel (linear algebra),Online learning,Automatic image annotation,Regression,Pattern recognition,Support vector machine,Machine learning,Computational complexity theory,Scalability
Journal
Volume
ISSN
Citations 
169
0925-2312
1
PageRank 
References 
Authors
0.39
23
3
Name
Order
Citations
PageRank
Hanchen Xiong1144.40
Sándor Szedmák221519.09
Justus H. Piater354361.56