Title
Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes
Abstract
Support vector machines (SVM) are an emerging data classification technique with many diverse applications. The feature subset selection, along with the parameter setting in the SVM training procedure significantly influences the classification accuracy. In this paper, the asymptotic behaviors of support vector machines are fused with genetic algorithm (GA) and the feature chromosomes are generated, which thereby directs the search of genetic algorithm to the straight line of optimal generalization error in the superparameter space. On this basis, a new approach based on genetic algorithm with feature chromosomes, termed GA with feature chromosomes, is proposed to simultaneously optimize the feature subset and the parameters for SVM. To evaluate the proposed approach, the experiment adopts several real world datasets from the UCI database and from the Benchmark database. Compared with the GA without feature chromosomes, the grid search, and other approaches, the proposed approach not only has higher classification accuracy and smaller feature subsets, but also has fewer processing time.
Year
DOI
Venue
2011
10.1016/j.eswa.2010.10.041
Expert Syst. Appl.
Keywords
Field
DocType
feature selection,support vector machine,parameters optimization,genetic algorithm,feature subset,classification accuracy,support vector machines,new approach,smaller feature subsets,parameter optimization,feature subset selection,data classification technique,svm training procedure,feature chromosomes,feature chromosome,generalization error
Data mining,Line (geometry),Feature selection,Computer science,Artificial intelligence,Data classification,Genetic algorithm,Hyperparameter optimization,Feature vector,Pattern recognition,Feature (computer vision),Support vector machine,Machine learning
Journal
Volume
Issue
ISSN
38
5
Expert Systems With Applications
Citations 
PageRank 
References 
30
0.93
20
Authors
5
Name
Order
Citations
PageRank
MingYuan Zhao1442.03
Chong Fu2300.93
Luping Ji314910.31
Tang Ke42798139.09
Mingtian Zhou520029.46