Gene Regulatory Network Evolution Through Augmenting Topologies

Artificial gene regulatory networks (GRNs) are biologically inspired dynamical systems used to control various kinds of agents, from the cells in developmental models to embodied robot swarms. Most recent work uses a genetic algorithm (GA) or an evolution strategy in order to optimize the network for a specific task. However, the empirical performances of these algorithms are unsatisfactory. This paper presents an algorithm that primarily exploits a network distance metric, which allows genetic similarity to be used for speciation and variation of GRNs. This algorithm, inspired by the successful neuroevolution of augmenting topologies algorithm's use in evolving neural networks and compositional pattern-producing networks, is based on a specific initialization method, a crossover operator based on gene alignment, and speciation based upon GRN structures. We demonstrate the effectiveness of this new algorithm by comparing our approach both to a standard GA and to evolutionary programming on four different experiments from three distinct problem domains, where the proposed algorithm excels on all experiments.

[1]  Joshua Evan Auerbach,et al.  Dynamic Resolution in the Co-Evolution of Morphology and Control , 2010, ALIFE.

[2]  John R. Koza,et al.  A genetic approach to the truck backer upper problem and the inter-twined spiral problem , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[3]  Julian Francis Miller,et al.  Evolving Developmental Programs for Adaptation, Morphogenesis, and Self-Repair , 2003, ECAL.

[4]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[5]  Hitoshi Iba,et al.  Inference of gene regulatory model by genetic algorithms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[6]  Risto Miikkulainen,et al.  Evolving a Roving Eye for Go , 2004, GECCO.

[7]  Borys Wróbel,et al.  Processing Signals with Evolving Artificial Gene Regulatory Networks , 2010, ALIFE.

[8]  Marc Schoenauer,et al.  Evolving Genes to Balance a Pole , 2010, EuroGP.

[9]  N. Saitou,et al.  The neighbor-joining method: a new method for reconstructing phylogenetic trees. , 1987, Molecular biology and evolution.

[10]  W. Banzhaf Artificial Regulatory Networks and Genetic Programming , 2003 .

[11]  Hervé Luga,et al.  A Synthesis of the Cell2Organ Developmental Model , 2012, Morphogenetic Engineering, Toward Programmable Complex Systems.

[12]  Yaochu Jin,et al.  A cellular mechanism for multi-robot construction via evolutionary multi-objective optimization of a gene regulatory network , 2009, Biosyst..

[13]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[14]  Yan Meng,et al.  A Hierarchical Gene Regulatory Network for Adaptive Multirobot Pattern Formation , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  J. A. Studier,et al.  A note on the neighbor-joining algorithm of Saitou and Nei. , 1988, Molecular biology and evolution.

[16]  Jordan B. Pollack,et al.  Co-Evolving Intertwined Spirals , 1996, Evolutionary Programming.

[17]  P. Bentley,et al.  Evolving beyond perfection: an investigation of the effects of long-term evolution on fractal gene regulatory networks. , 2004, Bio Systems.

[18]  Leslie G. Valiant,et al.  Evolvability , 2009, JACM.

[19]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[20]  E. Davidson The Regulatory Genome: Gene Regulatory Networks In Development And Evolution , 2006 .

[21]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[22]  Yves Duthen,et al.  Controlling cooperative and conflicting continuous actions with a Gene Regulatory Network , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[23]  Hava T. Siegelmann,et al.  The Self-Construction and -Repair of a Foraging Organism by Explicitly Specified Development from a Single Cell , 2007, Artificial Life.

[24]  René Doursat,et al.  Facilitating evolutionary innovation by developmental modularity and variability , 2009, GECCO.

[25]  Lewis Wolpert,et al.  The French Flag Problems A Contribution to the Discussion on Pattern Development and Regulation , 2017 .

[26]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[27]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[28]  A. E. Eiben,et al.  HyperNEAT for Locomotion Control in Modular Robots , 2010, ICES.

[29]  Chris P. Bowers Simulating Evolution with a Computational Model of Embryogeny: Obtaining Robustness from Evolved Individuals , 2005, ECAL.

[30]  A. Lindenmayer Developmental systems without cellular interactions, their languages and grammars. , 1971, Journal of theoretical biology.

[31]  Una-May O'Reilly,et al.  Genetic Programming II: Automatic Discovery of Reusable Programs. , 1994, Artificial Life.

[32]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[33]  Chrystopher L. Nehaniv,et al.  Genetic Regulatory Network Models of Biological Clocks: Evolutionary History Matters , 2008, Artificial Life.

[34]  C. Coello,et al.  Improving PSO-based Multi-Objective Optimization using Crowding , Mutation and �-Dominance , 2005 .

[35]  R. Pfeifer,et al.  Repeated structure and dissociation of genotypic and phenotypic complexity in artificial ontogeny , 2001 .

[36]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[37]  Yves Duthen,et al.  Simultaneous cooperative and conflicting behaviors handled by a gene regulatory network , 2012, 2012 IEEE Congress on Evolutionary Computation.

[38]  Carlos A. Coello Coello,et al.  Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance , 2005, EMO.

[39]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[40]  S Forrest,et al.  Genetic algorithms , 1996, CSUR.

[41]  Sewall Wright,et al.  Breeding Structure of Populations in Relation to Speciation , 1940, The American Naturalist.

[42]  Torsten Reil,et al.  Dynamics of Gene Expression in an Artificial Genome - Implications for Biological and Artificial Ontogeny , 1999, ECAL.

[43]  Jordan B. Pollack,et al.  Robot coverage control by evolved neuromodulation , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[44]  D. Hogness,et al.  The organization of the histone genes in Drosophila melanogaster: functional and evolutionary implications. , 1978, Cold Spring Harbor symposia on quantitative biology.

[45]  Simei Gomes Wysoski,et al.  Computational Neurogenetic Modelling: a Pathway to New Discoveries in Genetic Neuroscience , 2006, Int. J. Neural Syst..

[46]  Borys Wróbel,et al.  Evo-devo in silico - a Model of a Gene Network Regulating Multicellular Development in 3D Space with Artificial Physics , 2008, ALIFE.

[47]  Borys Wróbel,et al.  Evolving Gene Regulatory Networks for Real Time Control of Foraging Behaviours , 2010, ALIFE.

[48]  Wolfgang Banzhaf,et al.  Evolving Control Metabolisms for a Robot , 2001, Artificial Life.

[49]  R. Pfeifer,et al.  Evolving Complete Agents using Artificial Ontogeny , 2003 .

[50]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[51]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[52]  Hervé Luga,et al.  Artificial gene regulatory networks and spatial computation: A case study , 2011, ECAL.

[53]  Jordan B. Pollack,et al.  Using Pictures to Visualize the Complexity of Gene Regulatory Networks , 2012, ALIFE.

[54]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[55]  S. Kauffman Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.