Improving the Adaptability of Simulated Evolutionary Swarm Robots in Dynamically Changing Environments

One of the important challenges in the field of evolutionary robotics is the development of systems that can adapt to a changing environment. However, the ability to adapt to unknown and fluctuating environments is not straightforward. Here, we explore the adaptive potential of simulated swarm robots that contain a genomic encoding of a bio-inspired gene regulatory network (GRN). An artificial genome is combined with a flexible agent-based system, representing the activated part of the regulatory network that transduces environmental cues into phenotypic behaviour. Using an artificial life simulation framework that mimics a dynamically changing environment, we show that separating the static from the conditionally active part of the network contributes to a better adaptive behaviour. Furthermore, in contrast with most hitherto developed ANN-based systems that need to re-optimize their complete controller network from scratch each time they are subjected to novel conditions, our system uses its genome to store GRNs whose performance was optimized under a particular environmental condition for a sufficiently long time. When subjected to a new environment, the previous condition-specific GRN might become inactivated, but remains present. This ability to store ‘good behaviour’ and to disconnect it from the novel rewiring that is essential under a new condition allows faster re-adaptation if any of the previously observed environmental conditions is reencountered. As we show here, applying these evolutionary-based principles leads to accelerated and improved adaptive evolution in a non-stable environment.

[1]  J. Monod,et al.  Genetic regulatory mechanisms in the synthesis of proteins. , 1961, Journal of molecular biology.

[2]  D. Hawthorne,et al.  Regulation of genes controlling synthesis of the galactose pathway enzymes in yeast. , 1966, Genetics.

[3]  Michael Conrad,et al.  The price of programmability , 1988 .

[4]  S. Kauffman The Sciences of Complexity and "Origins of Order" , 1990, PSA Proceedings of the Biennial Meeting of the Philosophy of Science Association.

[5]  L. Altenberg,et al.  PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY , 1996, Evolution; international journal of organic evolution.

[6]  John J. Grefenstette,et al.  Methods for Competitive and Cooperative Co-evolution , 1996 .

[7]  Xin Yao,et al.  Towards designing artificial neural networks by evolution , 1998 .

[8]  Peter J. Bentley,et al.  Three Ways to Grow Designs: A Comparison of Embryogenies for an Evolutionary Design Problem , 1999, GECCO.

[9]  G Tononi,et al.  Measures of degeneracy and redundancy in biological networks. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Torsten Reil,et al.  Dynamics of Gene Expression in an Artificial Genome - Implications for Biological and Artificial Ontogeny , 1999, ECAL.

[11]  S. Rosenberg Evolving responsively: adaptive mutation , 2001, Nature Reviews Genetics.

[12]  Dario Floreano,et al.  Evolution of Plastic Control Networks , 2001, Auton. Robots.

[13]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[14]  A. Pentland,et al.  Artificial intelligence. Autonomous mental development by robots and animals. , 2001, Science.

[15]  Jordan B. Pollack,et al.  Creating High-Level Components with a Generative Representation for Body-Brain Evolution , 2002, Artificial Life.

[16]  Josh Bongard,et al.  Evolving modular genetic regulatory networks , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[17]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[18]  M. Bedau Artificial life: organization, adaptation and complexity from the bottom up , 2003, Trends in Cognitive Sciences.

[19]  Robert T. Pennock,et al.  The evolutionary origin of complex features , 2003, Nature.

[20]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[21]  Ken A. Hawick,et al.  A framework and simulation engine for studying artificial life , 2004 .

[22]  Günter P. Wagner,et al.  Complex Adaptations and the Evolution of Evolvability , 2005 .

[23]  A. S. Elgazzar,et al.  An Overview of Complex Adaptive Systems , 2005, nlin/0506059.

[24]  Dario Floreano,et al.  Neuroevolution with Analog Genetic Encoding , 2006, PPSN.

[25]  M. Bennett,et al.  Metabolic gene regulation in a dynamically changing environment , 2008, Nature.

[26]  Lifeng Xi,et al.  Evolving artificial neural networks using an improved PSO and DPSO , 2008, Neurocomputing.

[27]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[28]  Yaochu Jin,et al.  A cellular mechanism for multi-robot construction via evolutionary multi-objective optimization of a gene regulatory network , 2009, Biosyst..

[29]  Alexei Kurakin,et al.  Scale-free Flow of Life: On the Biology, Economics, and Physics of the Cell , 2009 .

[30]  Ah-Hwee Tan,et al.  A self-organizing neural network architecture for intentional planning agents , 2009, AAMAS.

[31]  Y. Pilpel,et al.  Adaptive prediction of environmental changes by microorganisms , 2009, Nature.

[32]  A. E. Eiben,et al.  On-Line, On-Board Evolution of Robot Controllers , 2009, Artificial Evolution.

[33]  D. Floreano,et al.  Evolution of Adaptive Behaviour in Robots by Means of Darwinian Selection , 2010, PLoS biology.

[34]  M. Lynch,et al.  The rate of establishment of complex adaptations. , 2010, Molecular biology and evolution.

[35]  Jumpol Polvichai,et al.  The survival robots: An artificial life , 2011, 2011 Eighth International Joint Conference on Computer Science and Software Engineering (JCSSE).

[36]  Dario Floreano,et al.  Beyond graphs: A new synthesis , 2011, J. Comput. Sci..

[37]  J. Draghi,et al.  Molecular evolution: Hidden diversity sparks adaptation , 2011, Nature.

[38]  M. Laubichler,et al.  Developmental evolution in social insects: regulatory networks from genes to societies. , 2012, Journal of experimental zoology. Part B, Molecular and developmental evolution.

[39]  A. Jackson,et al.  Social structure emerges via the interaction between local ecology and individual behaviour. , 2012, The Journal of animal ecology.

[40]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.