Modularity and position independence in EDA-GP

There has been growing interest in Estimation of Distribution Algorithms (EDA). Conventional EDA mainly use a linear string representation, resembling an individual of Genetic Algorithms (GA). Because of the flexibility of GP style tree encoding, a limited number of researchers have started addressing estimation of distribution of GP-style tree form solutions. For simplicity, we refer to this kind of research as EDA-GP, As in conventional EDA, the focus of EDA-GP at this stage has to be finding an appropriate model. In (Shan et al., 2004), we proposed a number of criteria for an appropriate model for EDA-GP. While our focus is on EDA-GP, we note that these criteria are important not only for EDA-GP research, but may provide clues for general problem solving with tree form solutions. In this research, we empirically examine two criteria, namely modularity and position dependence. In this research, we empirically confirm their importance. Furthermore, we also validate that PRODIGY (Shan et al., 2004), the framework we propose for EDA-GP, is capable of handling it.

[1]  Ivan Tanev,et al.  Implications of Incorporating Learning Probabilistic Context-sensitive Grammar in Genetic Programming on Evolvability of Adaptive Locomotion Gaits of Snakebot , 2004 .

[2]  Peter A. N. Bosman,et al.  Grammar Transformations in an EDA for Genetic Programming , 2004 .

[3]  D. Goldberg,et al.  Probabilistic Model Building and Competent Genetic Programming , 2003 .

[4]  Hussein A. Abbass,et al.  Program Evolution with Explicit Learning: a New Framework for Program Automatic Synthesis , 2003 .

[5]  Rafal Salustowicz,et al.  Probabilistic Incremental Program Evolution , 1997, Evolutionary Computation.

[6]  Riccardo Poli,et al.  Schema Theory for Genetic Programming with One-Point Crossover and Point Mutation , 1997, Evolutionary Computation.

[7]  Una-May O'Reilly,et al.  The Troubling Aspects of a Building Block Hypothesis for Genetic Programming , 1994, FOGA.

[8]  Dana H. Ballard,et al.  Genetic Programming with Adaptive Representations , 1994 .

[9]  P. Bosman,et al.  An algorithmic framework for density estimation based evolutionary algorithms , 1999 .

[10]  David E. Goldberg,et al.  Bayesian Optimization Algorithm: From Single Level to Hierarchy , 2002 .

[11]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[12]  Hussein A. Abbass,et al.  AntTAG: a new method to compose computer programs using colonies of ants , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[13]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[14]  Peter J. Angeline,et al.  Genetic programming and emergent intelligence , 1994 .

[15]  H. Iba,et al.  Estimation of distribution programming based on Bayesian network , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[16]  Yin Shan Program distribution estimation with grammar models , 2004 .

[17]  J. Pollack,et al.  Coevolving High-Level Representations , 1993 .

[18]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[19]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[20]  Nichael Lynn Cramer,et al.  A Representation for the Adaptive Generation of Simple Sequential Programs , 1985, ICGA.