Constituent Grammatical Evolution

We present Constituent Grammatical Evolution (CGE), a new evolutionary automatic programming algorithm that extends the standard Grammatical Evolution algorithm by incorporating the concepts of constituent genes and conditional behaviour-switching. CGE builds from elementary and more complex building blocks a control program which dictates the behaviour of an agent and it is applicable to the class of problems where the subject of search is the behaviour of an agent in a given environment. It takes advantage of the powerful Grammatical Evolution feature of using a BNF grammar definition as a plug-in component to describe the output language to be produced by the system. The main benchmark problem in which CGE is evaluated is the Santa Fe Trail problem using a BNF grammar definition which defines a search space semantically equivalent with that of the original definition of the problem by Koza. Furthermore, CGE is evaluated on two additional problems, the Loss Altos Hills and the Hampton Court Maze. The experimental results demonstrate that Constituent Grammatical Evolution outperforms the standard Grammatical Evolution algorithm in these problems, in terms of both efficiency (percent of solutions found) and effectiveness (number of required steps of solutions found).

[1]  Anthony Brabazon,et al.  Meta-grammar constant creation with grammatical evolution by grammatical evolution , 2005, GECCO '05.

[2]  William John Teahan.  ARTIFICIAL INTELLIGENCE-AGEN BEHAVIOUR I , 2010 .

[3]  Conor Ryan,et al.  Adaptive logic programming , 2001 .

[4]  Gary William Flake,et al.  The Computational Beauty of Nature: Computer Explorations of Fractals, Chaos, Complex Systems and Adaptation , 1998 .

[5]  Nichael Lynn Cramer,et al.  A Representation for the Adaptive Generation of Simple Sequential Programs , 1985, ICGA.

[6]  Anthony Brabazon,et al.  Genotype representations in grammatical evolution , 2010, Appl. Soft Comput..

[7]  Anthony Brabazon,et al.  An investigation into automatically defined function representations in Grammatical Evolution , 2009 .

[8]  Anthony Brabazon,et al.  Exploring Grammatical Modification with Modules in Grammatical Evolution , 2011, EuroGP.

[9]  Conor Ryan,et al.  Run Transferable Libraries - Learning Functional Bias in Problem Domains , 2004, GECCO.

[10]  Aravind K. Joshi,et al.  Natural language parsing: Tree adjoining grammars: How much context-sensitivity is required to provide reasonable structural descriptions? , 1985 .

[11]  Richard M. Friedberg,et al.  A Learning Machine: Part I , 1958, IBM J. Res. Dev..

[12]  Conor Ryan,et al.  Crossover in Grammatical Evolution: The Search Continues , 2001, EuroGP.

[13]  Nguyen Xuan Hoai,et al.  Developmental Evaluation in Genetic Programming: The Preliminary Results , 2006, EuroGP.

[14]  Peter J. Angeline,et al.  Evolutionary Module Acquisition , 1993 .

[15]  Cyril Fonlupt,et al.  Santa Fe Trail Hazards , 2005, Artificial Evolution.

[16]  Anthony Brabazon,et al.  Evolving Behaviour Trees for the Mario AI Competition Using Grammatical Evolution , 2011, EvoApplications.

[17]  Alan Blair,et al.  Dynamically Defined Functions In Grammatical Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[18]  Anthony Brabazon,et al.  The syntax of stock selection: Grammatical Evolution of a stock picking model , 2010, IEEE Congress on Evolutionary Computation.

[19]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[20]  Michael O'Neill,et al.  Grammatical evolution - evolutionary automatic programming in an arbitrary language , 2003, Genetic programming.

[21]  Peter Gärdenfors,et al.  Conceptual spaces - the geometry of thought , 2000 .

[22]  Anthony Brabazon,et al.  Adaptive Trading With Grammatical Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[23]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[24]  Michael O'Neill,et al.  Evolving Multi-line Compilable C Programs , 1999, EuroGP.

[25]  Robin Harper,et al.  Co-evolving robocode tanks , 2011, GECCO '11.

[26]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[27]  Anthony Brabazon,et al.  Structural and nodal mutation in grammatical evolution , 2009, GECCO '09.

[28]  Alfonso Ortega,et al.  Christiansen Grammar Evolution: Grammatical Evolution With Semantics , 2007, IEEE Transactions on Evolutionary Computation.

[29]  William J. Teahan,et al.  jGE: a Java implementation of grammatical evolution , 2006 .

[30]  Anthony Brabazon,et al.  Grammatical Swarm: The generation of programs by social programming , 2006, Natural Computing.

[31]  Robert Ghanea-Hercock,et al.  Applied Evolutionary Algorithms in Java , 2003, Springer New York.

[32]  Enrique Alba,et al.  Gaining New Fields of Application for OOP : the Parallel Evolutionary Algorithm Case , 2001 .

[33]  Anthony Brabazon,et al.  Jive: A Generative, Interactive, Virtual, Evolutionary Music System , 2010, EvoApplications.

[34]  Michael O'Neill,et al.  Animating Horse Gaits and Transitions , 2010, TPCG.

[35]  John R. Koza,et al.  Genetic Programming IV: Routine Human-Competitive Machine Intelligence , 2003 .

[36]  Michael O'Neill,et al.  Under the hood of grammatical evolution , 1999 .

[37]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[38]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[39]  Alan Blair,et al.  A Self-Selecting Crossover Operator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[40]  Conor Ryan,et al.  Grammatical Evolution by Grammatical Evolution: The Evolution of Grammar and Genetic Code , 2004, EuroGP.

[41]  Saoirse Amarteifio,et al.  Interpreting a Genotype-Phenotype Map with Rich Representations in XMLGE , 2005 .

[42]  Ozlem O. Garibay,et al.  Analyzing the effects of modularity on search spaces , 2008 .

[43]  Erick Cantú-Paz,et al.  A Survey of Parallel Genetic Algorithms , 2000 .

[44]  Wolfgang Banzhaf,et al.  Genotype-Phenotype-Mapping and Neutral Variation - A Case Study in Genetic Programming , 1994, PPSN.

[45]  Peter A. Whigham,et al.  Grammatical bias for evolutionary learning , 1996 .

[46]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[47]  Conor Ryan,et al.  An Investigation into the Use of Different Search Strategies with Grammatical Evolution , 2002, EuroGP.

[48]  Michael O'Neill,et al.  Coevolving antibodies with a rich representation of grammatical evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[49]  Anthony Brabazon,et al.  Recent Adventures in Grammatical Evolution , 2005 .

[50]  Jason H. Moore,et al.  A statistical comparison of grammatical evolution strategies in the domain of human genetics , 2005, 2005 IEEE Congress on Evolutionary Computation.

[51]  Miguel Nicolau,et al.  Using Grammatical Evolution to Parameterise Interactive 3D Image Generation , 2011, EvoApplications.

[52]  Conor Ryan,et al.  Grammatical Evolution: A Steady State approach , 2008 .

[53]  Conor Ryan,et al.  Incorporating gene expression models into evolutionary algorithms , 2000 .

[54]  Riccardo Poli,et al.  Why Ants are Hard , 1998 .

[55]  Dana H. Ballard,et al.  Genetic Programming with Adaptive Representations , 1994 .

[56]  M. O'Neill,et al.  Grammatical evolution , 2001, GECCO '09.

[57]  Aravind K. Joshi,et al.  Tree-Adjoining Grammars , 1997, Handbook of Formal Languages.

[58]  John R. Koza,et al.  Genetic Programming III: Darwinian Invention & Problem Solving , 1999 .

[59]  Anthony Brabazon,et al.  Evolving Dynamic Trade Execution Strategies Using Grammatical Evolution , 2010, EvoApplications.

[60]  Alan Blair,et al.  A structure preserving crossover in grammatical evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[61]  J. Pollack,et al.  Coevolving High-Level Representations , 1993 .

[62]  Pavel Osmera,et al.  Parallel Grammatical Evolution with Backward Processing , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[63]  Anthony Brabazon,et al.  Grammatical bias and building blocks in meta-grammar Grammatical Evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[64]  Peter A. Whigham,et al.  Grammatically-based Genetic Programming , 1995 .

[65]  S. Luke,et al.  When Coevolutionary Algorithms Exhibit Evolutionary Dyna mics , 2002 .

[66]  Peter A. Whigham.  Inductive bias and genetic programming , 1995 .

[67]  Miguel Nicolau,et al.  Introducing Grammar Based Extensions for Grammatical Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[68]  Anthony Brabazon,et al.  Grammatical Differential Evolution , 2006, IC-AI.

[69]  Michael O'Neill,et al.  Combining Structural Analysis and Multi-Objective Criteria for Evolutionary Architectural Design , 2011, EvoApplications.

[70]  Michael O'Neill,et al.  Grammar defined introns: an investigation into grammars, introns, and bias in Grammatical Evolution , 2001 .

[71]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[72]  Michael O'Neill,et al.  Exploring Grammatical Evolution for Horse Gait Optimisation , 2009, EuroGP.

[73]  Phil Husbands,et al.  An Evolutionary Approach to Complex System Regulation Using Grammatical Evolution , 2004 .

[74]  Manuel Blum,et al.  On the power of the compass (or, why mazes are easier to search than graphs) , 1978, 19th Annual Symposium on Foundations of Computer Science (sfcs 1978).

[75]  Franz Rothlauf,et al.  On the Locality of Grammatical Evolution , 2006, EuroGP.

[76]  Michael O'Neill,et al.  Grammatical Evolution: Solving Trigonometric Identities , 1998 .

[77]  Maarten Keijzer,et al.  Crossover in Grammatical Evolution , 2003, Genetic Programming and Evolvable Machines.

[78]  William J. Teahan,et al.  Experiments with Grammatical Evolution in Java , 2008 .

[79]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[80]  William John Teahan,et al.  Grammatical Evolution and the Santa Fe Trail Problem , 2010, IJCCI.

[81]  Riccardo Poli,et al.  Better Trained Ants for Genetic Programming , 1998 .

[82]  E. Glavas,et al.  Neural network construction using grammatical evolution , 2005, Proceedings of the Fifth IEEE International Symposium on Signal Processing and Information Technology, 2005..

[83]  Anthony Brabazon,et al.  Evolving a Ms. PacMan Controller Using Grammatical Evolution , 2010, EvoApplications.

[84]  Conor Ryan,et al.  How Functional Dependency Adapts to Salience Hierarchy in the GAuGE System , 2003, EuroGP.

[85]  Anthony Brabazon,et al.  Shape grammars and grammatical evolution for evolutionary design , 2009, GECCO.

[86]  Robin Harper,et al.  GE, explosive grammars and the lasting legacy of bad initialisation , 2010, IEEE Congress on Evolutionary Computation.

[87]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[88]  Peter J. Angeline,et al.  Genetic programming: On the programming of computers by means of natural selection,: John R. Koza, A Bradford Book, MIT Press, Cambridge MA, 1992, ISBN 0-262-11170-5, xiv + 819pp., US$55.00 , 1994 .

[89]  Conor Ryan,et al.  Favourable Biasing of Function Sets Using Run Transferable Libraries , 2005 .

[90]  Michael O'Neill,et al.  Grammatical Evolution: Evolving Programs for an Arbitrary Language , 1998, EuroGP.

[91]  Robert Cleary,et al.  Extending Grammatical Evolution with Attribute Grammars: An Application to Knapsack Problems , 2005 .

[92]  Holger Claussen,et al.  A symbolic regression approach to manage femtocell coverage using grammatical genetic programming , 2011, GECCO '11.

[93]  Anthony Brabazon,et al.  mGGA: The meta-Grammar Genetic Algorithm , 2005, EuroGP.

[94]  Conor Ryan,et al.  Context-aware mutation: a modular, context aware mutation operator for genetic programming , 2007, GECCO '07.

[95]  Anthony Brabazon,et al.  Recent Patents on Genetic Programming , 2009 .

[96]  Thomas Kilroy.  The O'Neill , 1995 .

[97]  Kenneth de Jong,et al.  Evolutionary computation: a unified approach , 2007, GECCO.

[98]  M. O'Neill,et al.  Automatic Programming with Grammatical Evolution , 2007 .

[99]  Michael O’Neill,et al.  Solving Knapsack Problems with Attribute Grammars , 2004 .

[100]  Anthony Brabazon,et al.  Foundations in Grammatical Evolution for Dynamic Environments , 2009, Studies in Computational Intelligence.

[101]  Conor Ryan,et al.  A Re-examination Of The Cart Centering Problem Using The Chorus System , 2002, GECCO.

[102]  Eric B. Baum,et al.  What is thought? , 2003 .

[103]  Erik Anders,et al.  An Exploration of Grammars in Grammatical Evolution , 2010 .

[104]  Conor RyanDept,et al.  Automatic Generation of Programs with Grammatical Evolution , 2007 .

[105]  Michael O'Neill,et al.  No Coercion and No Prohibition, a Position Independent Encoding Scheme for Evolutionary Algorithms - The Chorus System , 2001, EuroGP.

[106]  Peter A. Whigham,et al.  Grammar-based Genetic Programming: a survey , 2010, Genetic Programming and Evolvable Machines.

[107]  Anthony Brabazon,et al.  Higher-order functions in aesthetic EC encodings , 2010, IEEE Congress on Evolutionary Computation.

[108]  Michael O'Neill,et al.  Crossover in Grammatical Evolution: A Smooth Operator? , 2000, EuroGP.

[109]  Julian F. Miller,et al.  Proceedings of the 5th European Conference on Genetic Programming , 2001 .

[110]  Anthony Brabazon,et al.  A non-destructive grammar modification approach to modularity in grammatical evolution , 2011, GECCO '11.

[111]  John H. Holland,et al.  Outline for a Logical Theory of Adaptive Systems , 1962, JACM.

[112]  Anthony Brabazon,et al.  The automatic generation of programs for classification problems with grammatical swarm , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[113]  Marc Parizeau,et al.  Genetic Programming, Validation Sets, and Parsimony Pressure , 2006, EuroGP.

[114]  Anthony Brabazon,et al.  Evolving Market Index Trading Rules Using Grammatical Evolution , 2001, EvoWorkshops.

[115]  Anthony Brabazon,et al.  Evolving a logo design using Lindenmayer systems, Postscript & Grammatical Evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[116]  Anthony Brabazon,et al.  Tree-adjunct grammatical evolution , 2010, IEEE Congress on Evolutionary Computation.

[117]  John R. Koza.  Genetic Programming III - Darwinian Invention and Problem Solving , 1999, Evolutionary Computation.

[118]  Leonardo Vanneschi,et al.  Open issues in genetic programming , 2010, Genetic Programming and Evolvable Machines.

[119]  E. Mayr.  What Evolution Is , 2001 .

[120]  Eoin Murphy.  Examining grammars and grammatical evolution in dynamic environments , 2011, GECCO '11.

[121]  Michael O'Neill,et al.  Grammar based function definition in Grammatical Evolution , 2000, GECCO.

[122]  David B. Fogel,et al.  Evolutionary computation - toward a new philosophy of machine intelligence (3. ed.) , 1995 .

[123]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[124]  George E. P. Box,et al.  Evolutionary Operation: a Method for Increasing Industrial Productivity , 1957 .

[125]  Michael O'Neill,et al.  An Attribute Grammar Decoder for the 01 MultiConstrained Knapsack Problem , 2005, EvoCOP.

[126]  Riccardo Poli,et al.  Foundations of Genetic Programming , 1999, Springer Berlin Heidelberg.

[127]  Michael O'Neill,et al.  Developing a market timing system using Grammatical Evolution , 2001 .

[128]  D. Gavrilis,et al.  Classification of fetal heart rate using grammatical evolution , 2005, IEEE Workshop on Signal Processing Systems Design and Implementation, 2005..

[129]  Michael O’Neill,et al.  An Evolutionary Approach to Complex System Regulation Using Grammatical Evolution , 2004 .

[130]  Anthony Brabazon,et al.  Biologically inspired algorithms for financial modelling , 2006, Natural computing series.

[131]  Michael O'Neill,et al.  An examination on the modularity of grammars in grammatical evolutionary design , 2010, IEEE Congress on Evolutionary Computation.