Title
InfiniteBoost: building infinite ensembles with gradient descent.
Abstract
In machine learning ensemble methods have demonstrated high accuracy for the variety of problems in different areas. Two notable ensemble methods widely used in practice are gradient boosting and random forests. In this paper we present InfiniteBoost - a novel algorithm, which combines important properties of these two approaches. The algorithm constructs the ensemble of trees for which two properties hold: trees of the ensemble incorporate the mistakes done by others; at the same time the ensemble could contain the infinite number of trees without the over-fitting effect. The proposed algorithm is evaluated on the regression, classification, and ranking tasks using large scale, publicly available datasets.
Year
Venue
Field
2017
arXiv: Machine Learning
Gradient descent,Ranking,Regression,Artificial intelligence,Random forest,Ensemble learning,Machine learning,Mathematics,Gradient boosting
DocType
Volume
Citations 
Journal
abs/1706.01109
0
PageRank 
References 
Authors
0.34
0
2
Name
Order
Citations
PageRank
Alex Rogozhnikov100.34
Tatiana Likhomanenko2245.47