Title
Minimum class spread constrained support vector machine.
Abstract
While classical classification methods such as support vector machine and its extensions (SVMs) obtain strong generalization capability by maximizing the separation margin between binary classes, they are usually sensitive to affine (or scaling) transformation of data. The optimal solutions of SVMs may be misled by the spread of data and preferentially separate classes along large margin directions. To this end, in this paper, we propose a novel minimum class spread constrained support vector machine (MCSSVM) for pattern classification problems by simultaneously considering the maximization of inter-class separation margin and the minimization of within-class spread of data, which corresponds to a distribution-dependent regularization on the classification function by constraining the within-class spread of input data. The basic idea of MCSSVM is to find a class distribution constrained hyperplane such that one class (or normal class) can be enclosed in a minimum q-spread tube, while the other class (or abnormal class) is farthest from this tube. MCSSVM can simultaneously achieve both maximum inter-class margin and minimum within-class spread so as to enhance the generalization capability of the proposed classifier. Moreover, the proposed method only requires simple extensions to existing maximum margin formulations such as SVMs and still preserves their computational efficiency. Generalization bound for MCSSVM is theoretically derived and the validity of MCSSVM is examined by classification of toy and real-world classification problems, which demonstrate the superiority of our method in comparison to other related state-of-the-art algorithms.
Year
DOI
Venue
2015
10.1016/j.neucom.2014.09.017
Neurocomputing
Keywords
Field
DocType
Pattern classification,Novelty detection,Within-class spread,Support vector machines (SVMs),Kernel trick
Affine transformation,Novelty detection,Regularization (mathematics),Artificial intelligence,Hyperplane,Mathematical optimization,Pattern recognition,Support vector machine,Margin classifier,Kernel method,Mathematics,Maximization,Machine learning
Journal
Volume
ISSN
Citations 
151
0925-2312
2
PageRank 
References 
Authors
0.38
22
3
Name
Order
Citations
PageRank
Jianwen Tao1583.34
Shitong Wang21485109.13
Wenjun Hu3161.56