Genetic Programming, Ensemble Methods and the Bias/Variance Tradeoff - Introductory Investigations

The decomposition of regression error into bias and variance terms provides insight into the generalization capability of modeling methods. The paper offers an introduction to bias/variance decomposition of mean squared error, as well as a presentation of experimental results of the application of genetic programming. Finally ensemble methods such as bagging and boosting are discussed that can reduce the generalization error in genetic programming.

[1]  Peter A. Whigham,et al.  Grammatical bias for evolutionary learning , 1996 .

[2]  Riccardo Poli,et al.  The evolution of size and shape , 1999 .

[3]  J. K. Kinnear,et al.  Advances in Genetic Programming , 1994 .

[4]  Michael O'Neill,et al.  Grammatical Evolution: Evolving Programs for an Arbitrary Language , 1998, EuroGP.

[5]  Tina Yu,et al.  Performance-Enhanced Genetic Programming , 1997, Evolutionary Programming.

[6]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[7]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[8]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[9]  H. Iba Bagging, Boosting, and bloating in Genetic Programming , 1999 .

[10]  M. Keijzer,et al.  Dimensionally aware genetic programming , 1999 .

[11]  C. L. Nikias,et al.  Signal processing with alpha-stable distributions and applications , 1995 .

[12]  Nicholas Freitag McPhee,et al.  Accurate Replication in Genetic Programming , 1995, ICGA.

[13]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[14]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[15]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[16]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[17]  Peter Nordin,et al.  Complexity Compression and Evolution , 1995, ICGA.

[18]  Robert G. Reynolds,et al.  Evolutionary Programming VI , 1997, Lecture Notes in Computer Science.