Title
Discriminative Learning of Max-Sum Classifiers
Abstract
The max-sum classifier predicts n-tuple of labels from n-tuple of observable variables by maximizing a sum of quality functions defined over neighbouring pairs of labels and observable variables. Predicting labels as MAP assignments of a Random Markov Field is a particular example of the max-sum classifier. Learning parameters of the max-sum classifier is a challenging problem because even computing the response of such classifier is NP-complete in general. Estimating parameters using the Maximum Likelihood approach is feasible only for a subclass of max-sum classifiers with an acyclic structure of neighbouring pairs. Recently, the discriminative methods represented by the perceptron and the Support Vector Machines, originally designed for binary linear classifiers, have been extended for learning some subclasses of the max-sum classifier. Besides the max-sum classifiers with the acyclic neighbouring structure, it has been shown that the discriminative learning is possible even with arbitrary neighbouring structure provided the quality functions fulfill some additional constraints. In this article, we extend the discriminative approach to other three classes of max-sum classifiers with an arbitrary neighbourhood structure. We derive learning algorithms for two subclasses of max-sum classifiers whose response can be computed in polynomial time: (i) the max-sum classifiers with supermodular quality functions and (ii) the max-sum classifiers whose response can be computed exactly by a linear programming relaxation. Moreover, we show that the learning problem can be approximately solved even for a general max-sum classifier.
Year
DOI
Venue
2008
10.1145/1390681.1390685
Journal of Machine Learning Research
Keywords
Field
DocType
acyclic neighbouring structure,discriminative learning,general max-sum classifier,neighbouring pair,acyclic structure,observable variable,max-sum classifier,max-sum classifiers,arbitrary neighbourhood structure,binary linear classifier,quality function,discrimination learning
Pattern recognition,Random subspace method,Support vector machine,Cascading classifiers,Artificial intelligence,Linear classifier,Margin classifier,Classifier (linguistics),Discriminative model,Perceptron,Machine learning,Mathematics
Journal
Volume
ISSN
Citations 
9,
1532-4435
16
PageRank 
References 
Authors
0.90
22
3
Name
Order
Citations
PageRank
Vojtěch Franc158455.78
Bogdan Savchynskyy217511.05
FrancVojtěch3160.90