Overcoming Initial Convergence in Multi-objective Evolution of Robot Control and Morphology Using a Two-Phase Approach

Co-evolution of robot morphologies and control systems is a new and interesting approach for robotic design. However, the increased size and ruggedness of the search space becomes a challenge, often leading to early convergence with sub-optimal morphology-controller combinations. Further, mutations in the robot morphologies tend to cause large perturbations in the search, effectively changing the environment, from the controller’s perspective. In this paper, we present a two-stage approach to tackle the early convergence in morphology-controller co-evolution. In the first phase, we allow free evolution of morphologies and controllers simultaneously, while in the second phase we re-evolve the controllers while locking the morphology. The feasibility of the approach is demonstrated in physics simulations, and later verified on three different real-world instances of the robot morphologies. The results demonstrate that by introducing the two-phase approach, the search produces solutions which outperform the single co-evolutionary run by over 10%.

[1]  Stéphane Doncieux,et al.  Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study , 2012, Evolutionary Computation.

[2]  Xiaobo Tan,et al.  Evolutionary Design and Experimental Validation of a Flexible Caudal Fin for Robotic Fish , 2012, ALIFE.

[3]  Hod Lipson,et al.  On the Difficulty of Co-Optimizing Morphology and Control in Evolved Virtual Creatures , 2016, ALIFE.

[4]  A. E. Eiben,et al.  Evolutionary Robotics: What, Why, and Where to , 2015, Front. Robot. AI.

[5]  W. Oechel,et al.  Automatic design and manufacture of robotic lifeforms , 2022 .

[6]  Kyrre Glette,et al.  Some distance measures for morphological diversification in generative evolutionary robotics , 2014, GECCO.

[7]  Josh C. Bongard,et al.  Evolutionary robotics , 2013, CACM.

[8]  Kyrre Glette,et al.  Real-World Reproduction of Evolved Robot Morphologies: Automated Categorization and Evaluation , 2015, EvoApplications.

[9]  Sebastian Risi,et al.  Soft-Body Muscles for Evolved Virtual Creatures: The Next Step on a Bio-Mimetic Path to Meaningful Morphological Complexity , 2015, ECAL.

[10]  Antoine Cully,et al.  Abstract of: "Fast Damage Recovery in Robotics with the T-Resilience Algorithm" , 2018, ALIFE.

[11]  Henrik Hautop Lund,et al.  Co-evolving Control and Morphology with LEGO Robots , 2003 .

[12]  Joshua Evan Auerbach,et al.  Environmental Influence on the Evolution of Morphological Complexity in Machines , 2014, PLoS Comput. Biol..

[13]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[14]  Jordan B. Pollack,et al.  TITLE : Generative Representations for the Automated Design of Modular Physical Robots , 2003 .

[15]  Kenneth O. Stanley,et al.  Evolving a diversity of virtual creatures through novelty search and local competition , 2011, GECCO '11.

[16]  Aravind Srinivasan,et al.  Innovization: Discovery of Innovative Design Principles Through Multiobjective Evolutionary Optimization , 2008, Multiobjective Problem Solving from Nature.

[17]  Olivier Ly,et al.  Optimizing Morphology and Locomotion on a Corpus of Parametric Legged Robots , 2016, Living Machines.

[18]  Kyrre Glette,et al.  Memetic robot control evolution and adaption to reality , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[19]  M. Maertens,et al.  Female Employment Reduces Fertility in Rural Senegal , 2015, PloS one.

[20]  Kenneth O. Stanley,et al.  Abandoning Objectives: Evolution Through the Search for Novelty Alone , 2011, Evolutionary Computation.

[21]  John Bares,et al.  Automated synthesis and optimization of robot configurations: an evolutionary approach , 1999 .

[22]  F. Iida,et al.  Morphological Evolution of Physical Robots through Model-Free Phenotype Development , 2015, PloS one.

[23]  Helmut Hauser,et al.  Novelty-Based Evolutionary Design of Morphing Underwater Robots , 2015, GECCO.

[24]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[25]  Hod Lipson,et al.  Unshackling evolution , 2014 .