Title
SLIT: designing complexity penalty for classification and regression trees using the SRM principle
Abstract
The statistical learning theory has formulated the Structural Risk Minimization (SRM) principle, based upon the functional form of risk bound on the generalization performance of a learning machine. This paper addresses the application of this formula, which is equivalent to a complexity penalty, to model selection tasks for decision trees, whereas the quantization of the machine capacity for decision trees is estimated using an empirical approach. Experimental results show that, for either classification or regression problems, this novel strategy of decision tree pruning performs better than alternative methods. We name classification and regression trees pruned by virtue of this methodology as Statistical Learning Intelligent Trees (SLIT).
Year
DOI
Venue
2006
10.1007/11759966_131
ISNN (1)
Keywords
Field
DocType
machine capacity,structural risk minimization,decision tree pruning,alternative method,decision tree,statistical learning intelligent trees,regression problem,srm principle,statistical learning theory,regression tree,complexity penalty,functional form,model selection
Statistical learning theory,Decision tree,Pattern recognition,Regression analysis,Computer science,Model selection,Artificial intelligence,Pruning (decision trees),Structural risk minimization,Artificial neural network,Quantization (signal processing),Machine learning
Conference
Volume
ISSN
ISBN
3971
0302-9743
3-540-34439-X
Citations 
PageRank 
References 
1
0.44
8
Authors
3
Name
Order
Citations
PageRank
Yang Zhou196.73
Wenjie Zhu2147.79
Liang Ji310.44