Title
Normalized L1 Regularization For Axis-Oblique Tree Construction Algorithms
Abstract
Axis-oblique decision trees have been proposed to effectively deal with high-dimensional input spaces, weakening the effects of the curse of dimensionality. Usually the axis-oblique partitioning is obtained by nonlinear optimization techniques, introducing additional flexibility together with an increase in variance error. In this paper a normalized L1 regularization for optimization based axis-oblique partitioning strategies is proposed, which only penalizes the amount of obliqueness incorporated in the partitioning. It is exemplarily applied to the hierarchical local model tree (HILOMOT) algorithm, building local model networks (LMNs) for system identification tasks. It is shown that the proposed normalized L1 regularization keeps the number of variables used for the partitioning low and decreases the variance error.
Year
Venue
Field
2017
2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI)
Approximation algorithm,Decision tree,Oblique case,Normalization (statistics),Computer science,Nonlinear programming,Algorithm,Curse of dimensionality,Regularization (mathematics),System identification
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
julian belz111.71
Oliver Nelles29917.27