Title
A Simple Label Switching Algorithm for Semisupervised Structural SVMs
Abstract
In structured output learning, obtaining labeled data for real-world applications is usually costly, while unlabeled examples are available in abundance. Semisupervised structured classification deals with a small number of labeled examples and a large number of unlabeled structured data. In this work, we consider semisupervised structural support vector machines with domain constraints. The optimization problem, which in general is not convex, contains the loss terms associated with the labeled and unlabeled examples, along with the domain constraints. We propose a simple optimization approach that alternates between solving a supervised learning problem and a constraint matching problem. Solving the constraint matching problem is difficult for structured prediction, and we propose an efficient and effective label switching method to solve it. The alternating optimization is carried out within a deterministic annealing framework, which helps in effective constraint matching and avoiding poor local minima, which are not very useful. The algorithm is simple and easy to implement. Further, it is suitable for any structured output learning problem where exact inference is available. Experiments on benchmark sequence labeling data sets and a natural language parsing data set show that the proposed approach, though simple, achieves comparable generalization performance.
Year
DOI
Venue
2015
10.1162/NECO_a_00773
Neural Computation
Field
DocType
Volume
Semi-supervised learning,Sequence labeling,Structured prediction,Artificial intelligence,Optimization problem,Mathematical optimization,Support vector machine,Algorithm,Supervised learning,Label switching,Data model,Mathematics,Machine learning
Journal
27
Issue
ISSN
Citations 
10
0899-7667
1
PageRank 
References 
Authors
0.35
16
3
Name
Order
Citations
PageRank
Balamurugan P.1212.58
Shirish Krishnaj Shevade228528.53
Sundararajan Sellamanickam312714.07