Advantages of multi-objective optimisation in evolutionary robotics: survey and case

The application of multi-objective optimisation to evolutionary robotics has been so far relatively limited. Despite a few examples exist, the benefits of multi-objective optimisation when applied to the design of autonomous robotic systems have not been clearly spelled out and experimentally demonstrated. A survey of the literature on evolutionary robotics shows the lack of systematic studies confronting singleand multi-objective approaches. This paper fills this gap: starting from well-known results in multi-objective optimisation, we discuss how to tackle commonly recognised problems in evolutionary robotics. In particular, we show that multi-objective optimisation (i) allows evolving a more varied set of behaviours by exploring multiple trade-offs of the objectives to optimise, (ii) supports the evolution of the desired behaviour through the introduction of objectives as proxies, (iii) avoids the premature convergence to local optima possibly introduced by multi-component fitness functions, and (iv) solves the bootstrap problem exploiting ancillary objectives to guide evolution in the early phases. We present an experimental demonstration of these benefits in the context of standard case studies in robotics: maze navigation in a single robot domain, flocking in a swarm robotics context, and a strictly collaborative task in collective robotics.

[1]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[2]  Thomas Bartz-Beielstein,et al.  Experimental Methods for the Analysis of Optimization Algorithms , 2010 .

[3]  Stéphane Doncieux,et al.  Beyond black-box optimization: a review of selective pressures for evolutionary robotics , 2014, Evol. Intell..

[4]  Frédéric Gruau,et al.  Cellular Encoding for interactive evolutionary robotics , 1996 .

[5]  Jean-Arcady Meyer,et al.  Proceedings of the 10th international conference on Simulation of Adaptive Behavior: From Animals to Animats , 2008 .

[6]  Carlos M. Fonseca,et al.  Inferential Performance Assessment of Stochastic Optimisers and the Attainment Function , 2001, EMO.

[7]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[8]  Julian Togelius,et al.  Multiobjective techniques for the use of state in genetic programming applied to simulated car racing , 2007, 2007 IEEE Congress on Evolutionary Computation.

[9]  Gregory J. Barlow,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Fitness Functions in Evolutionary Robotics: a Survey and Analysis , 2022 .

[10]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[11]  Kalyanmoy Deb,et al.  Multiobjective optimization , 1997 .

[12]  Kalyanmoy Deb,et al.  Multi-objective Optimization , 2014 .

[13]  L. Altenberg,et al.  PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY , 1996, Evolution; international journal of organic evolution.

[14]  Stéphane Doncieux,et al.  Incremental Evolution of Animats' Behaviors as a Multi-objective Optimization , 2008, SAB.

[15]  Carlos M. Fonseca,et al.  The Attainment-Function Approach to Stochastic Multiobjective Optimizer Assessment and Comparison , 2010, Experimental Methods for the Analysis of Optimization Algorithms.

[16]  Francesco Mondada,et al.  Automatic creation of an autonomous agent: genetic evolution of a neural-network driven robot , 1994 .

[17]  J. Dennis,et al.  A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems , 1997 .

[18]  Dario Floreano,et al.  Evolutionary robots with on-line self-organization and behavioral fitness , 2000, Neural Networks.

[19]  Amiram Moshaiov,et al.  Multi-objective evolution of robot neuro-controllers , 2009, 2009 IEEE Congress on Evolutionary Computation.

[20]  Josh C. Bongard Innocent Until Proven Guilty: Reducing Robot Shaping From Polynomial to Linear Time , 2011, IEEE Transactions on Evolutionary Computation.

[21]  G.J. Barlow,et al.  Incremental evolution of autonomous controllers for unmanned aerial vehicles using multi-objective genetic programming , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[22]  Eliseo Ferrante,et al.  ARGoS: a modular, parallel, multi-engine simulator for multi-robot systems , 2012, Swarm Intelligence.

[23]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[24]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[25]  Amiram Moshaiov,et al.  Bootstrapping Aggregate Fitness Selection with Evolutionary Multi-Objective Optimization , 2012, PPSN.

[26]  Genci Capi,et al.  Multiobjective Evolution of Neural Controllers and Task Complexity , 2007, IEEE Transactions on Robotics.

[27]  Joshua D. Knowles,et al.  Modes of Problem Solving with Multiple Objectives: Implications for Interpreting the Pareto Set and for Decision Making , 2008, Multiobjective Problem Solving from Nature.

[28]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.

[29]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[30]  Thomas Stützle,et al.  Exploratory Analysis of Stochastic Local Search Algorithms in Biobjective Optimization , 2010, Experimental Methods for the Analysis of Optimization Algorithms.

[31]  D. Floreano,et al.  Evolution of Adaptive Behaviour in Robots by Means of Darwinian Selection , 2010, PLoS biology.

[32]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[33]  Luca Maria Gambardella,et al.  Collaboration Through the Exploitation of Local Interactions in Autonomous Collective Robotics: The Stick Pulling Experiment , 2001, Auton. Robots.

[34]  A. Czirók,et al.  Collective Motion , 1999, physics/9902023.

[35]  Jürgen Branke,et al.  Interactive Multiobjective Evolutionary Algorithms , 2008, Multiobjective Optimization.

[36]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[37]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[38]  Wilfried Elmenreich,et al.  On the effects of the robot configuration on evolving coordinated motion behaviors , 2013, 2013 IEEE Congress on Evolutionary Computation.

[39]  Vincenzo Cutello,et al.  Parallel Problem Solving from Nature - PPSN XII , 2012, Lecture Notes in Computer Science.

[40]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[41]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[42]  Stéphane Doncieux,et al.  Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study , 2012, Evolutionary Computation.

[43]  Stefano Nolfi,et al.  Evolving Mobile Robots Able to Display Collective Behaviors , 2003, Artificial Life.

[44]  Francesco Mondada,et al.  The marXbot, a miniature mobile robot opening new perspectives for the collective-robotic research , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Hussein A. Abbass,et al.  Multiobjectivity and complexity in embodied cognition , 2005, IEEE Transactions on Evolutionary Computation.

[46]  Stefano Nolfi,et al.  Engineering the Evolution of Self-Organizing Behaviors in Swarm Robotics: A Case Study , 2011, Artificial Life.

[47]  Lincoln Smith,et al.  Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[48]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[49]  Onofrio Gigliotta,et al.  Human breeders for evolving robots , 2008, Artificial Life and Robotics.

[50]  Hussein A. Abbass,et al.  Automatic Generation of Controllers for Embodied Legged Organisms: A Pareto Evolutionary Multi-Objective Approach , 2004, Evolutionary Computation.