Name
Abstract | ||
|---|---|---|
This paper introduces a novel regularization strategy to address the generalization issues for large-margin classifiers from the Empirical Risk Minimization (ERM) perspective. First, the ERM principle is argued to be more flexible than the Structural Risk Minimization (SRM) principle by reviewing the difference between the two strategies as the fundamental principles for large-margin classifier design. Second, after studying the large-margin classifier design based on the SRM principle, a realization of the ERM principle is proposed in the form of a bias-variance criterion instead of the conventional expected error criterion. The bias-variance criterion is shown to have the regularization capability needed by a large-margin classifier designed according to the ERM principle. Finally, a mathematical programming procedure is used to efficiently achieve the best regularization policy. The new regularization strategy based on the ERM principle is evaluated on a set of machine learning experiments. Experimental results clearly demonstrate the strength of the proposed regularization strategy to achieve the minimum error rate performance measure. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1109/ICASSP.2011.5946892 | Acoustics, Speech and Signal Processing |
Keywords | Field | DocType |
mathematical programming,minimisation,pattern classification,ERM perspective,SRM principle,bias-variance criterion,empirical risk minimization perspective,expected error criterion,large-margin classifier design,machine learning experiment,mathematical programming,minimum error rate performance measurement,structural risk minimization principle,variability regularization,empirical risk minimization,large-margin classification,model regularization,model selection,structural risk minimization | Mathematical optimization,Pattern recognition,Computer science,Empirical risk minimization,Word error rate,Model selection,Minification,Regularization (mathematics),Artificial intelligence,Structural risk minimization,Classifier (linguistics),Regularization perspectives on support vector machines | Conference |
ISSN | ISBN | Citations |
1520-6149 E-ISBN : 978-1-4577-0537-3 | 978-1-4577-0537-3 | 0 |
PageRank | References | Authors |
0.34 | 3 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Dwi Sianto Mansjur | 1 | 7 | 2.28 |
| Ted S. Wada | 2 | 37 | 6.37 |
| Biing-Hwang Juang | 3 | 3388 | 699.72 |