Learning an evolvable genotype-phenotype mapping

We present AutoMap, a pair of methods for automatic generation of evolvable genotype-phenotype mappings. Both use an artificial neural network autoencoder trained on phenotypes harvested from fitness peaks as the basis for a genotype-phenotype mapping. In the first, the decoder segment of a bottlenecked autoencoder serves as the genotype-phenotype mapping. In the second, a denoising autoencoder serves as the genotype-phenotype mapping. Automatic generation of evolvable genotype-phenotype mappings are demonstrated on the n-legged table problem, a toy problem that defines a simple rugged fitness landscape, and the Scrabble string problem, a more complicated problem that serves as a rough model for linear genetic programming. For both problems, the automatically generated genotype-phenotype mappings are found to enhance evolvability.

[1]  Jason Yosinski,et al.  Innovation Engines: Automated Creativity and Improved Stochastic Optimization via Deep Learning , 2015, GECCO.

[2]  Holly C. Beale,et al.  Derived variants at six genes explain nearly half of size reduction in dog breeds , 2013, Genome research.

[3]  J A Coyne Lack of response to selection for directional asymmetry in Drosophila melanogaster. , 1987, The Journal of heredity.

[4]  M. Pigliucci Is evolvability evolvable? , 2008, Nature Reviews Genetics.

[5]  Charles Ofria,et al.  HybrID: A Hybridization of Indirect and Direct Encodings for Evolutionary Computation , 2009, ECAL.

[6]  Kenneth O. Stanley,et al.  Evolving a Single Scalable Controller for an Octopus Arm with a Variable Number of Segments , 2010, PPSN.

[7]  Risto Miikkulainen,et al.  Acquiring evolvability through adaptive representations , 2007, GECCO '07.

[8]  W. Banzhaf,et al.  Evolvability and Speed of Evolutionary Algorithms in Light of Recent Developments in Biology , 2010, Journal of Artificial Evolution and Applications.

[9]  Jeffrey K. Bassett,et al.  Learning Genetic Representations for Classes of Real-Valued Optimization Problems , 2015, GECCO.

[10]  Jeff Clune,et al.  Evolvability Search: Directly Selecting for Evolvability in order to Study and Produce It , 2016, GECCO.

[11]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[12]  P. Alberch From genes to phenotype: dynamical systems and evolvability , 2004, Genetica.

[13]  Charles Ofria,et al.  How a Generative Encoding Fares as Problem-Regularity Decreases , 2008, PPSN.

[14]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[15]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[16]  G. de Jong,et al.  Lack of response to family selection for directional asymmetry in Drosophila melanogaster: left and right are not distinguished in development , 1990, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[17]  Jean-Baptiste Mouret,et al.  Evolvability signatures of generative encodings: Beyond standard performance benchmarks , 2014, Inf. Sci..

[18]  U. Alon,et al.  Spontaneous evolution of modularity and network motifs. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Peter J. Bentley,et al.  Three Ways to Grow Designs: A Comparison of Embryogenies for an Evolutionary Design Problem , 1999, GECCO.

[20]  Jesús Devesa,et al.  Multiple Effects of Growth Hormone in the Body: Is it Really the Hormone for Growth? , 2016, Clinical medicine insights. Endocrinology and diabetes.

[21]  Eörs Szathmáry,et al.  How Can Evolution Learn? - A Reply to Responses. , 2016, Trends in ecology & evolution.

[22]  Kenneth O. Stanley,et al.  Evolvability Is Inevitable: Increasing Evolvability without the Pressure to Adapt , 2013, PloS one.

[23]  Hod Lipson,et al.  Unshackling evolution: evolving soft robots with multiple materials and a powerful generative encoding , 2013, GECCO '13.

[24]  Dario Izzo,et al.  Self-Adaptive Genotype-Phenotype Maps: Neural Networks as a Meta-Representation , 2014, PPSN.

[25]  L. Altenberg,et al.  PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY , 1996, Evolution; international journal of organic evolution.

[26]  Markus Brede,et al.  How evolution learns to generalise: Using the principles of learning theory to understand the evolution of developmental organisation , 2017, PLoS Comput. Biol..

[27]  Keith L. Downing Intelligence Emerging: Adaptivity and Search in Evolving Neural Systems , 2015 .

[28]  Cheng-Yuan Liou,et al.  Autoencoder for words , 2014, Neurocomputing.

[29]  M. Pigliucci Genotype–phenotype mapping and the end of the ‘genes as blueprint’ metaphor , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  Kenneth O. Stanley,et al.  On the Performance of Indirect Encoding Across the Continuum of Regularity , 2011, IEEE Transactions on Evolutionary Computation.

[31]  Risto Miikkulainen,et al.  Towards an empirical measure of evolvability , 2005, GECCO '05.

[32]  Eörs Szathmáry,et al.  How Can Evolution Learn? , 2016, Trends in ecology & evolution.