Some distance measures for morphological diversification in generative evolutionary robotics

Evolutionary robotics often involves optimization in large, complex search spaces, requiring good population diversity. Recently, measures to actively increase diversity or novelty have been employed in order to get sufficient exploration of the search space either as the sole optimization objective or in combination with some performance measurement. When evolving morphology in addition to the control system, it can be difficult to construct a measure that sufficiently captures the qualitative differences between individuals. In this paper we investigate four diversity measures, applied in a set of evolutionary robotics experiments using an indirect encoding for evolving robot morphology. In the experiments we optimize forward locomotion capabilities of symmetrical legged robots in a physics simulation. Two distance measures in Cartesian phenotype feature spaces are compared with two methods operating in the space of possible morphology graphs. These measures are used for computing a diversity objective in a multi-objective evolutionary algorithm, and compared to a control case with no diversity objective. For the given task one of the distance measures shows a clear improvement over the control case in improving the main objectives, while others display better ability to diversify, underlining the difficulty of designing good, general measures of morphological diversity.

[1]  John Bares,et al.  Automated synthesis and optimization of robot configurations: an evolutionary approach , 1999 .

[2]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[3]  Maciej Komosinski,et al.  Comparison of Different Genotype Encodings for Simulated Three-Dimensional Agents , 2002, Artificial Life.

[4]  Jean-Baptiste Mouret.  Novelty-Based Multiobjectivization , 2011 .

[5]  Kenneth O. Stanley,et al.  Exploiting Open-Endedness to Solve Problems Through the Search for Novelty , 2008, ALIFE.

[6]  Kenneth O. Stanley,et al.  Evolving a diversity of virtual creatures through novelty search and local competition , 2011, GECCO '11.

[7]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[8]  Masahiro Fujita,et al.  Evolving robust gaits with AIBO , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  Josh Bongard,et al.  Evolving modular genetic regulatory networks , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[10]  Antoine Cully,et al.  Abstract of: "Fast Damage Recovery in Robotics with the T-Resilience Algorithm" , 2018, ALIFE.

[11]  Stéphane Doncieux,et al.  Using behavioral exploration objectives to solve deceptive problems in neuro-evolution , 2009, GECCO.

[12]  Kyrre Glette,et al.  A hox gene inspired generative approach to evolving robot morphology , 2013, GECCO '13.

[13]  Jordan B. Pollack,et al.  TITLE : Generative Representations for the Automated Design of Modular Physical Robots , 2003 .

[14]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[15]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[16]  Joshua Evan Auerbach,et al.  Evolving CPPNs to grow three-dimensional physical structures , 2010, GECCO '10.

[17]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[18]  Mark Yim,et al.  Structure synthesis on-the-fly in a modular robot , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Anders Lyhne Christensen,et al.  Generic behaviour similarity measures for evolutionary swarm robotics , 2013, GECCO '13.

[20]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[21]  Edwin D. de Jong,et al.  Reducing bloat and promoting diversity using multi-objective methods , 2001 .

[22]  Xuelong Li,et al.  A survey of graph edit distance , 2010, Pattern Analysis and Applications.

[23]  Stéphane Doncieux,et al.  Behavioral diversity measures for Evolutionary Robotics , 2010, IEEE Congress on Evolutionary Computation.

[24]  Stéphane Doncieux,et al.  Overcoming the bootstrap problem in evolutionary robotics using behavioral diversity , 2009, 2009 IEEE Congress on Evolutionary Computation.

[25]  Kaizhong Zhang,et al.  On the Editing Distance Between Undirected Acyclic Graphs , 1996, Int. J. Found. Comput. Sci..

[26]  W. Oechel,et al.  Automatic design and manufacture of robotic lifeforms , 2022 .

[27]  Joshua Evan Auerbach,et al.  On the relationship between environmental and morphological complexity in evolved robots , 2012, GECCO '12.