Learning General Solutions through Multiple Evaluations during Development

In this paper, we investigate whether performing multiple evaluations during development --- a technique we call Evolutionary Developmental Evaluation (EDE) --- could help developmental Genetic Programming (GP) evolve general solutions, solving not only the original (training) problem, but also unseen similar problems (with higher degrees of complexity). The hypothesis is tested on two families of regression problems, and the experimental results support the hypothesis.

[1]  Craig W. Reynolds.  Evolution of corridor following behavior in a noisy world , 1994 .

[2]  Nguyen Xuan Hoai,et al.  Building on Success in Genetic Programming: Adaptive Variation and Developmental Evaluation , 2007, ISICA.

[3]  Juan Julián Merelo Guervós,et al.  Parallel Problem Solving from Nature - PPSN IX: 9th International Conference, Reykjavik, Iceland, September 9-13, 2006, Proceedings , 2006, PPSN.

[4]  Sanyou Zeng,et al.  Advances in Computation and Intelligence, Second International Symposium, ISICA 2007, Wuhan, China, September 21-23, 2007, Proceedings , 2007, ISICA.

[5]  H. Terashima-Marín,et al.  Evolution of Constraint Satisfaction strategies in examination timetabling , 1999 .

[6]  Justinian P. Rosca,et al.  Hierarchical Self-Organization in Genetic programming , 1994, ICML.

[7]  L. Darrell Whitley,et al.  Adding Learning to the Cellular Development of Neural Networks: Evolution and the Baldwin Effect , 1993, Evolutionary Computation.

[8]  Lukás Sekanina,et al.  Evolutionary Design of Arbitrarily Large Sorting Networks Using Development , 2005, Genetic Programming and Evolvable Machines.

[9]  Sanyou Zeng,et al.  Evolvable Systems: From Biology to Hardware, 7th International Conference, ICES 2007, Wuhan, China, September 21-23, 2007, Proceedings , 2007, ICES.

[10]  Graham Kendall,et al.  Hyper-Heuristics: An Emerging Direction in Modern Search Technology , 2003, Handbook of Metaheuristics.

[11]  Sean Luke,et al.  Fighting Bloat with Nonparametric Parsimony Pressure , 2002, PPSN.

[12]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[13]  Lothar Thiele,et al.  Multiobjective genetic programming: reducing bloat using SPEA2 , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[14]  Nguyen Xuan Hoai,et al.  Developmental evaluation in Genetic Programming: The TAG-based frame work , 2008, Int. J. Knowl. Based Intell. Eng. Syst..

[15]  Nguyen Xuan Hoai,et al.  Using compression to understand the distribution of building blocks in genetic programming populations , 2007, 2007 IEEE Congress on Evolutionary Computation.

[16]  Gunnar Tufte,et al.  Shrinking the Genotype: L-systems for EHW? , 2001, ICES.

[17]  Julian Francis Miller,et al.  A Developmental Method for Growing Graphs and Circuits , 2003, ICES.

[18]  Cyril Fonlupt,et al.  Exploring Overfitting in Genetic Programming , 2003, Artificial Evolution.

[19]  Gunnar Tufte,et al.  Towards Development on a Silicon-based Cellular Computing Machine , 2005, Natural Computing.

[20]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[21]  Peter Ross,et al.  Solving a Real-World Problem Using an Evolving Heuristically Driven Schedule Builder , 1998, Evolutionary Computation.

[22]  Lee Spector,et al.  Ontogenetic programming , 1996 .

[23]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[24]  Nguyen Xuan Hoai,et al.  Solving Symbolic Regression Problems Using Incremental Evaluation In Genetic Programming , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[25]  Jianzhi Zhang.  Evolution by gene duplication: an update , 2003 .

[26]  Ibrahim Kushchu,et al.  Genetic programming and evolutionary generalization , 2002, IEEE Trans. Evol. Comput..

[27]  Nguyen Xuan Hoai,et al.  Representation and structural difficulty in genetic programming , 2006, IEEE Transactions on Evolutionary Computation.

[28]  Noam Chomsky,et al.  Three models for the description of language , 1956, IRE Trans. Inf. Theory.

[29]  Jordan B. Pollack,et al.  Evolving L-systems to generate virtual creatures , 2001, Comput. Graph..

[30]  Aravind K. Joshi,et al.  Tree Adjunct Grammars , 1975, J. Comput. Syst. Sci..

[31]  Gunnar Tufte,et al.  Achieving environmental tolerance through the initiation and exploitation of external information , 2007, 2007 IEEE Congress on Evolutionary Computation.

[32]  Jordan B. Pollack,et al.  How artificial ontogenies can retard evolution , 2005, GECCO '05.

[33]  Nguyen Xuan Hoai,et al.  Developmental Evaluation in Genetic Programming: The Preliminary Results , 2006, EuroGP.