Name
Title | ||
|---|---|---|
A Practical Approach to Model Selection for Support Vector Machines With a Gaussian Kernel |
Abstract | ||
|---|---|---|
When learning a support vector machine (SVM) from a set of labeled development patterns, the ultimate goal is to get a classifier attaining a low error rate on new patterns. This so-called generalization ability obviously depends on the choices of the learning parameters that control the learning process. Model selection is the method for identifying appropriate values for these parameters. In this paper, a novel model selection method for SVMs with a Gaussian kernel is proposed. Its aim is to find suitable values for the kernel parameter γ and the cost parameter C with a minimum amount of central processing unit time. The determination of the kernel parameter is based on the argument that, for most patterns, the decision function of the SVM should consist of a sufficiently large number of significant contributions. A unique property of the proposed method is that it retrieves the kernel parameter as a simple analytical function of the dimensionality of the feature space and the dispersion of the classes in that space. An experimental evaluation on a test bed of 17 classification problems has shown that the new method favorably competes with two recently published methods: the classification of new patterns is equally good, but the computational effort to identify the learning parameters is substantially lower. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1109/TSMCB.2010.2053026 | Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions |
Keywords | Field | DocType |
Gaussian processes,generalisation (artificial intelligence),pattern classification,support vector machines,Gaussian kernel,central processing unit time,cost parameter,generalization ability,kernel parameter,labeled development patterns,learning process,model selection method,support vector machine,Data mining,model selection,pattern classification,support vector machine (SVM) | Radial basis function kernel,Pattern recognition,Least squares support vector machine,Kernel embedding of distributions,Computer science,Polynomial kernel,Artificial intelligence,String kernel,Kernel method,Variable kernel density estimation,Machine learning,Kernel (statistics) | Journal |
Volume | Issue | ISSN |
41 | 2 | 1083-4419 |
Citations | PageRank | References |
13 | 0.65 | 13 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Matthias Varewyck | 1 | 13 | 0.65 |
| Martens, J.P. | 2 | 78 | 8.20 |