Subtree semantic geometric crossover for genetic programming

The semantic geometric crossover (SGX) proposed by Moraglio et al. has achieved very promising results and received great attention from researchers, but has a significant disadvantage in the exponential growth in size of the solutions. We propose a crossover operator named subtree semantic geometric crossover (SSGX), with the aim of addressing this issue. It is similar to SGX but uses subtree semantic similarity to approximate the geometric property. We compare SSGX to standard crossover (SC), to SGX, and to other recent semantic-based crossover operators, testing on several symbolic regression problems. Overall our new operator out-performs the other operators on test data performance, and reduces computational time relative to most of them. Further analysis shows that while SGX is rather exploitative, and SC rather explorative, SSGX achieves a balance between the two. A simple method of further enhancing SSGX performance is also demonstrated.

[1]  Krzysztof Krawiec,et al.  Quantitative Analysis of Locally Geometric Semantic Crossover , 2012, PPSN.

[2]  P. Grünwald.  The Minimum Description Length Principle (Adaptive Computation and Machine Learning) , 2007 .

[3]  Luca Manzoni,et al.  A comparison between geometric semantic GP and cartesian GP for boolean functions learning , 2014, GECCO.

[4]  Colin G. Johnson,et al.  Semantically driven crossover in genetic programming , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[5]  Azzedine Boukerche,et al.  Algorithms and Protocols for Wireless Sensor Networks , 2008, Wiley series on parallel and distributed computing.

[6]  Krzysztof Krawiec,et al.  Approximating geometric crossover in semantic space , 2009, GECCO.

[7]  Krzysztof Krawiec,et al.  Review and comparative analysis of geometric semantic crossovers , 2014, Genetic Programming and Evolvable Machines.

[8]  Colin G. Johnson.  Deriving Genetic Programming Fitness Properties by Static Analysis , 2002, EuroGP.

[9]  Constance Schultsz,et al.  Hypertension in Sub-Saharan Africa: Cross-Sectional Surveys in Four Rural and Urban Communities , 2012, PloS one.

[10]  Leonardo Vanneschi,et al.  A survey of semantic methods in genetic programming , 2014, Genetic Programming and Evolvable Machines.

[11]  Lishan Kang,et al.  Hoare logic-based genetic programming , 2011, Science China Information Sciences.

[12]  Colin G. Johnson,et al.  Genetic Programming with Fitness Based on Model Checking , 2007, EuroGP.

[13]  Jonathan M. Garibaldi,et al.  Using Rule-Based Machine Learning for Candidate Disease Gene Prioritization and Sample Classification of Cancer Gene Expression Data , 2012, PloS one.

[14]  Wojciech Jaskowski,et al.  Better GP benchmarks: community survey results and proposals , 2012, Genetic Programming and Evolvable Machines.

[15]  Krzysztof Krawiec,et al.  Semantic Backpropagation for Designing Search Operators in Genetic Programming , 2015, IEEE Transactions on Evolutionary Computation.

[16]  Nicholas Freitag McPhee,et al.  Semantic Building Blocks in Genetic Programming , 2008, EuroGP.

[17]  Alfonso Ortega,et al.  Attribute Grammar Evolution , 2005, IWINAC.

[18]  Krzysztof Krawiec,et al.  Approximating geometric crossover by semantic backpropagation , 2013, GECCO '13.

[19]  Leonardo Vanneschi,et al.  An efficient implementation of geometric semantic genetic programming for anticoagulation level prediction in pharmacogenetics , 2013, GECCO.

[20]  Michael O'Neill,et al.  Semantic Aware Crossover for Genetic Programming: The Case for Real-Valued Function Regression , 2009, EuroGP.

[21]  Colin G. Johnson.  What can automatic programming learn from theoretical computer science , 2002 .

[22]  Krzysztof Krawiec,et al.  Locally geometric semantic crossover: a study on the roles of semantics and homology in recombination operators , 2012, Genetic Programming and Evolvable Machines.

[23]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[24]  Kwong-Sak Leung,et al.  An induction system that learns programs in different programming languages using genetic programming and logic grammars , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[25]  Doron A. Peled,et al.  Genetic Programming and Model Checking: Synthesizing New Mutual Exclusion Algorithms , 2008, ATVA.

[26]  Leonardo Vanneschi,et al.  Genetic programming needs better benchmarks , 2012, GECCO '12.

[27]  Colin G. Johnson,et al.  Semantic analysis of program initialisation in genetic programming , 2009, Genetic Programming and Evolvable Machines.

[28]  Alberto Moraglio.  Geometric Unification of Evolutionary Algorithms , 2006 .

[29]  P. Grünwald.  The Minimum Description Length Principle (Adaptive Computation and Machine Learning) , 2007 .

[30]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[31]  Michael O'Neill,et al.  Genetic Programming and Evolvable Machines Manuscript No. Semantically-based Crossover in Genetic Programming: Application to Real-valued Symbolic Regression , 2022 .

[32]  Krzysztof Krawiec,et al.  Medial Crossovers for Genetic Programming , 2012, EuroGP.

[33]  Alberto Moraglio,et al.  Runtime analysis of mutation-based geometric semantic genetic programming for basis functions regression , 2013, GECCO '13.

[34]  Michael O'Neill,et al.  On the roles of semantic locality of crossover in genetic programming , 2013, Inf. Sci..

[35]  L. Altenberg.  The evolution of evolvability in genetic programming , 1994 .

[36]  Michael O'Neill,et al.  An Attribute Grammar Decoder for the 01 MultiConstrained Knapsack Problem , 2005, EvoCOP.

[37]  Maarten Keijzer,et al.  Improving Symbolic Regression with Interval Arithmetic and Linear Scaling , 2003, EuroGP.

[38]  Colin G. Johnson,et al.  Semantically driven mutation in genetic programming , 2009, 2009 IEEE Congress on Evolutionary Computation.

[39]  Krzysztof Krawiec,et al.  Geometric Semantic Genetic Programming , 2012, PPSN.

[40]  Julian Togelius,et al.  Geometric Differential Evolution for Combinatorial and Programs Spaces , 2013, Evolutionary Computation.

[41]  Leonardo Vanneschi,et al.  A New Implementation of Geometric Semantic GP and Its Application to Problems in Pharmacokinetics , 2013, EuroGP.