An initialization technique for geometric semantic GP based on demes evolution and despeciation

Initializing the population is a crucial step for genetic programming, and several strategies have been proposed so far. The issue is particularly important for geometric semantic genetic programming, where initialization is known to play a very important role. In this paper, we propose an initialization technique inspired by the biological phenomenon of demes despeciation, i.e. the combination of demes of previously distinct species into a new population. In synthesis, the initial population of geometric semantic genetic programming is created using the best individuals of a set of separate subpopulations, or demes, some of which run standard genetic programming and the others geometric semantic genetic programming for few generations. Geometric semantic genetic programming with this novel initialization technique is shown to outperform geometric semantic genetic programming using the traditional ramped half-and-half algorithm on six complex symbolic regression applications. More specifically, on the studied problems, the proposed initialization technique allows us to generate solutions with comparable or even better generalization ability, and of significantly smaller size than the ramped half-and-half algorithm.

[1]  Lawrence Beadle,et al.  Semantic and structural analysis of genetic programming , 2009 .

[2]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[3]  Leonardo Vanneschi,et al.  A Study of Fitness Distance Correlation as a Difficulty Measure in Genetic Programming , 2005, Evolutionary Computation.

[4]  Jen-Yuan Yeh,et al.  Applying layered multi-population genetic programming on learning to rank for information retrieval , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[5]  Krzysztof Krawiec,et al.  Geometric Semantic Genetic Programming , 2012, PPSN.

[6]  Leonardo Vanneschi,et al.  Geometric Semantic Genetic Programming for Real Life Applications , 2013, GPTP.

[7]  Graham Kendall,et al.  Sampling of Unique Structures and Behaviours in Genetic Programming , 2004, EuroGP.

[8]  Jason M. Daida,et al.  What Makes a Problem GP-Hard? Validating a Hypothesis of Structural Causes , 2003, GECCO.

[9]  D. Wilson Structured Demes and the Evolution of Group-Advantageous Traits , 1977, The American Naturalist.

[10]  Leonardo Vanneschi,et al.  A C++ framework for geometric semantic genetic programming , 2014, Genetic Programming and Evolvable Machines.

[11]  Leonardo Vanneschi,et al.  An Introduction to Geometric Semantic Genetic Programming , 2015, NEO.

[12]  D. Schluter,et al.  Speciation in reverse: morphological and genetic evidence of the collapse of a three‐spined stickleback (Gasterosteus aculeatus) species pair , 2005, Molecular ecology.

[13]  Gisele L. Pappa,et al.  A Dispersion Operator for Geometric Semantic Genetic Programming , 2016, GECCO.

[14]  Edmund K. Burke,et al.  The Tree-String Problem: An Artificial Domain for Structure and Content Search , 2005, EuroGP.

[15]  Peter J. Angeline,et al.  The Royal Tree Problem, a Benchmark for Single and Multiple Population Genetic Programming , 1996 .

[16]  Leonardo Vanneschi,et al.  The K landscapes: a tunably difficult benchmark for genetic programming , 2011, GECCO '11.

[17]  Colin G. Johnson,et al.  Semantic analysis of program initialisation in genetic programming , 2009, Genetic Programming and Evolvable Machines.

[18]  Leonardo Vanneschi,et al.  An Analysis of Geometric Semantic Crossover: A Computational Geometry Approach , 2016, IJCCI.

[19]  Leonardo Vanneschi,et al.  Prediction of high performance concrete strength using Genetic Programming with geometric semantic genetic operators , 2013, Expert Syst. Appl..

[20]  Oguz Akbilgic,et al.  A novel Hybrid RBF Neural Networks model as a forecaster , 2013, Statistics and Computing.

[21]  Leonardo Vanneschi,et al.  Genetic programming for computational pharmacokinetics in drug discovery and development , 2007, Genetic Programming and Evolvable Machines.

[22]  Leonardo Vanneschi,et al.  Prediction of energy performance of residential buildings: a genetic programming approach , 2015 .

[23]  Leonardo Vanneschi,et al.  A survey of semantic methods in genetic programming , 2014, Genetic Programming and Evolvable Machines.

[24]  Wei-Pang Yang,et al.  Designing a classifier by a layered multi-population genetic programming approach , 2007, Pattern Recognit..