Title
A Novel Hyperparameter-Free Approach to Decision Tree Construction That Avoids Overfitting by Design.
Abstract
Decision trees are an extremely popular machine learning technique. Unfortunately, overfitting in decision trees still remains an open issue that sometimes prevents achieving good performance. In this paper, we present a novel approach for the construction of decision trees that avoids the overfitting by design, without losing accuracy. A distinctive feature of our algorithm is that it requires neither the optimization of any hyperparameters, nor the use of regularization techniques, thus significantly reducing the decision tree training time. Moreover, our algorithm produces much smaller and shallower trees than traditional algorithms, facilitating the interpretability of the resulting models. For reproducibility, we provide an open source version of the algorithm.
Year
DOI
Venue
2019
10.1109/ACCESS.2019.2930235
IEEE ACCESS
Keywords
DocType
Volume
Decision trees,regularization,interpretability,Kolmogorov complexity
Journal
7
ISSN
Citations 
PageRank 
2169-3536
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Rafael A. García Leiva100.34
antonio fernandez anta222017.71
Vincenzo Mancuso3124976.65
Paolo Casari433432.89