Morphological Modularity Can Enable the Evolution of Robot Behavior to Scale Linearly with the Number of Environmental Features

In evolutionary robotics, populations of robots are typically trained in simulation before one or more of them are instantiated as physical robots. However, in order to evolve robust behavior, each robot must be evaluated in multiple environments. If an environment is characterized by $f$ free parameters, each of which can take one of $n_p$ features, each robot must be evaluated in all $n_p^f$ environments to ensure robustness. Here we show that, if the robots are constrained to have modular morphologies and controllers, they only need to be evaluated in $n_p$ environments to reach the same level of robustness. This becomes possible because the robots evolve such that each module of the morphology allows the controller to independently recognize a familiar percept in the environment, and each percept corresponds to one of the environmental free parameters. When exposed to a new environment, the robot perceives it as a novel combination of familiar percepts which it can solve without requiring further training. A non-modular morphology and controller however perceives the same environment as a completely novel environment, requiring further training. This acceleration in evolvability -- the rate of the evolution of adaptive and robust behavior -- suggests that evolutionary robotics may become a scalable approach for automatically creating complex autonomous machines, if the evolution of neural and morphological modularity is taken into account.

[1]  R. French Catastrophic Forgetting in Connectionist Networks , 2006 .

[2]  Josh C. Bongard,et al.  Exploiting the Relationship Between Structural Modularity and Sparsity for Faster Network Evolution , 2015, GECCO.

[3]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[5]  Hod Lipson,et al.  Age-fitness pareto optimization , 2010, GECCO '10.

[6]  Dave Cliff,et al.  Challenges in evolving controllers for physical robots , 1996, Robotics Auton. Syst..

[7]  Josh C. Bongard,et al.  Evolving Robot Morphology Facilitates the Evolution of Neural Modularity and Evolvability , 2015, GECCO.

[8]  G. Wagner HOMOLOGUES, NATURAL KINDS AND THE EVOLUTION OF MODULARITY , 1996 .

[9]  Serge Kernbach,et al.  Reconfigurable modular robotics , 2014, Robotics Auton. Syst..

[10]  U. Alon,et al.  Spontaneous evolution of modularity and network motifs. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[11]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[12]  Stéphane Doncieux,et al.  How to promote generalisation in evolutionary robotics: the ProGAb approach , 2011, GECCO '11.

[13]  Gregory S. Chirikjian,et al.  Modular Self-Reconfigurable Robot Systems [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[14]  Hod Lipson,et al.  Age-fitness pareto optimization , 2010, Annual Conference on Genetic and Evolutionary Computation.

[15]  Andreas Wagner,et al.  Specialization Can Drive the Evolution of Modularity , 2010, PLoS Comput. Biol..

[16]  Josh C. Bongard Spontaneous evolution of structural modularity in robot neural network controllers: artificial life/robotics/evolvable hardware , 2011, GECCO '11.

[17]  Jean-Baptiste Mouret,et al.  Neural Modularity Helps Organisms Evolve to Learn New Skills without Forgetting Old Skills , 2015, PLoS Comput. Biol..

[18]  J. Clune,et al.  How Evolution Learns to Generalise: Principles of under-fitting, over-fitting and induction in the evolution of developmental organisation , 2015, 1508.06854.

[19]  Hod Lipson,et al.  ON THE ORIGIN OF MODULAR VARIATION , 2002, Evolution; international journal of organic evolution.

[20]  Hod Lipson,et al.  The evolutionary origins of modularity , 2012, Proceedings of the Royal Society B: Biological Sciences.