Title
Sparse semi-supervised support vector machines by DC programming and DCA.
Abstract
This paper studies the problem of feature selection in the context of Semi-Supervised Support Vector Machine (S3VM). The zero norm, a natural concept dealing with sparsity, is used for feature selection purpose. Due to two nonconvex terms (the loss function of unlabeled data and the ℓ0 term), we are faced with a NP hard optimization problem. Two continuous approaches based on DC (Difference of Convex functions) programming and DCA (DC Algorithms) are developed. The first is DC approximation approach that approximates the ℓ0-norm by a DC function. The second is an exact reformulation approach based on exact penalty techniques in DC programming. All the resulting optimization problems are DC programs for which DCA are investigated. Several usual sparse inducing functions are considered, and six versions of DCA are developed. Empirical numerical experiments on several Benchmark datasets show the efficiency of the proposed algorithms, in both feature selection and classification.
Year
DOI
Venue
2015
10.1016/j.neucom.2014.11.051
Neurocomputing
Keywords
Field
DocType
Semi-supervised SVM,Feature selection,Non-convex optimization,DC approximation,Exact penalty,DC programming and DCA
Non convex optimization,Mathematical optimization,Feature selection,Pattern recognition,Support vector machine,Convex function,Artificial intelligence,Dc programming,Optimization problem,Machine learning,Mathematics
Journal
Volume
ISSN
Citations 
153
0925-2312
9
PageRank 
References 
Authors
0.47
34
3
Name
Order
Citations
PageRank
Le Hoai Minh11317.91
Le An Thi239444.90
Manh Cuong Nguyen3434.03