Abstract | ||
---|---|---|
This paper presents an approach to regularization of inductive genetic programming tuned for learning polynomials. The objective is to achieve optimal evolutionary performance when searching high-order multivariate polynomials represented as tree structures. We show how to improve the genetic programming of polynomials by balancing its statistical bias with its variance. Bias reduction is achieved by employing a set of basis polynomials in the tree nodes for better agreement with the examples. Since this often leads to over-fitting, such tendencies are counteracted by decreasing the variance through regularization of the fitness function. We demonstrate that this balance facilitates the search as well as enables discovery of parsimonious, accurate, and predictive polynomials. The experimental results given show that this regularization approach outperforms traditional genetic programming on benchmark data mining and practical time-series prediction tasks |
Year | DOI | Venue |
---|---|---|
2001 | 10.1109/4235.942530 | IEEE Trans. Evolutionary Computation |
Keywords | Field | DocType |
tree structures,learning artificial intelligence,genetic algorithms,tree data structures,time series prediction,indexing terms,data mining,genetic programming,fitness function,tree structure,data engineering,local search,image processing,pattern recognition,polynomials | Evolutionary algorithm,Genetic programming,Regularization (mathematics),Artificial intelligence,Tree structure,Genetic algorithm,Mathematical optimization,Tree (data structure),Algorithm,Fitness function,Local search (optimization),Mathematics,Machine learning | Journal |
Volume | Issue | ISSN |
5 | 4 | 1089-778X |
Citations | PageRank | References |
40 | 3.70 | 16 |
Authors | ||
2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Nikolay I. Nikolaev | 1 | 113 | 13.68 |
Hitoshi Iba | 2 | 1541 | 138.51 |