Heterogeneous cooperative coevolution: strategies of integration between GP and GA

Cooperative coevolution has proven to be a promising technique for solving complex combinatorial optimization problems. In this paper, we present four different strategies which involve cooperative coevolution of a genetic program and of a population of constants evolved by a genetic algorithm. The genetic program evolves expressions that solve a problem, while the genetic algorithm provides "good" values for the numeric terminal symbols used by those expressions. Experiments have been performed on three symbolic regression problems and on a "real-world" biomedical application. Results are encouraging and confirm that our coevolutionary algorithms can be used effectively in different domains.

[1]  Risto Miikkulainen,et al.  Hierarchical evolution of neural networks , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[2]  Mark E. Roberts,et al.  Cooperative Coevolution of Image Feature Construction and Object Detection , 2004, PPSN.

[3]  Leonardo Vanneschi,et al.  Theory and practice for efficient genetic programming , 2004 .

[4]  Risto Miikkulainen,et al.  A neuro-evolution method for dynamic resource allocation on a chip multiprocessor , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[5]  Mark E. Roberts,et al.  A Multistage Approach to Cooperatively Coevolving Feature Construction and Object Detection , 2005, EvoWorkshops.

[6]  Sean Luke,et al.  Is The Perfect The Enemy Of The Good? , 2002, GECCO.

[7]  Jan Paredis,et al.  Coevolutionary computation , 1995 .

[8]  A. Topchy,et al.  Faster genetic programming based on local gradient search of numeric leaf values , 2001 .

[9]  Roger Sauter,et al.  Introduction to Probability and Statistics for Engineers and Scientists , 2005, Technometrics.

[10]  Richard K. Belew,et al.  Evolving networks: using the genetic algorithm with connectionist learning , 1990 .

[11]  Jason M. Daida,et al.  What Makes a Problem GP-Hard? Analysis of a Tunably Difficult Problem in Genetic Programming , 1999, Genetic Programming and Evolvable Machines.

[12]  Rudolf Paul Wiegand,et al.  An analysis of cooperative coevolutionary algorithms , 2004 .

[13]  Leonardo Vanneschi,et al.  An Empirical Study of Multipopulation Genetic Programming , 2003, Genetic Programming and Evolvable Machines.

[14]  Conor Ryan,et al.  An Analysis of Diversity of Constants of Genetic Programming , 2003, EuroGP.

[15]  Maarten Keijzer,et al.  Improving Symbolic Regression with Interval Arithmetic and Linear Scaling , 2003, EuroGP.

[16]  Byoung-Tak Zhang,et al.  Evolving Optimal Neural Networks Using Genetic Algorithms with Occam's Razor , 1993, Complex Syst..

[17]  A. E. Eiben,et al.  A critical note on experimental research methodology in EC , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[18]  Elena Papaleo,et al.  Three-dimensional structure of the catalytic domain of the yeast β-(1,3)-glucan transferase Gas1: a molecular modeling investigation , 2006, Journal of molecular modeling.

[19]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[20]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[23]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[24]  John R. Koza,et al.  Genetic evolution and co-evolution of computer programs , 1991 .

[25]  David B. Fogel,et al.  Evolutionary algorithms in theory and practice , 1997, Complex.

[26]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[27]  Leonardo Vanneschi,et al.  A purely evolutionary memetic algorithm as a first step towards symbiotic coevolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[28]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[29]  John R. Koza,et al.  Genetic programming (videotape): the movie , 1992 .