Evolution of Collective Behaviors by Minimizing Surprise

Similarly to evolving controllers for single robots also controllers for groups of robots can be generated by applying evolutionary algorithms. Usually a fitness function rewards desired behavioral features. Here we investigate an alternative method that generates collective behaviors almost only as a by-product. We roughly follow the idea of Helmholtz that perception is a process based on probabilistic inference and evolve an internal model that is supposed to predict the agent’s future perceptions. Separated from this prediction model the agent also evolves a regular controller. Direct selective pressure, however, is only effective on the prediction model by minimizing prediction error (surprise). Our results show that a number of basic collective behaviors emerge by this approach, such as dispersion, aggregation, and flocking. The probability that a certain behavior emerges and also the difficulty of making correct predictions depends on the swarm density. The reported method has potential to be another simple approach to open-ended evolution analogical to the search for novelty.

[1]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[2]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[3]  Heiko Hamann,et al.  Space-Time Continuous Models of Swarm Robotic Systems - Supporting Global-to-Local Programming , 2010, Cognitive Systems Monographs.

[4]  Anders Lyhne Christensen,et al.  Evolution of swarm robotics systems with novelty search , 2013, Swarm Intelligence.

[5]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[6]  M Mitchell,et al.  The evolution of emergent computation. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Thomas Schmickl,et al.  Bubbleworld.Evo: Artificial Evolution of Behavioral Decisions in a Simulated Predator-Prey Ecosystem , 2006, SAB.

[8]  Philippe Capdepuy,et al.  Maximization of Potential Information Flow as a Universal Utility for Collective Behaviour , 2007, 2007 IEEE Symposium on Artificial Life.

[9]  Heiko Hamann Towards Swarm Calculus: Universal Properties of Swarm Performance and Collective Decisions , 2012, ANTS.

[10]  Eliseo Ferrante,et al.  Swarm robotics: a review from the swarm engineering perspective , 2013, Swarm Intelligence.

[11]  Alcherio Martinoli,et al.  Modeling Swarm Robotic Systems: a Case Study in Collaborative Distributed Manipulation , 2004, Int. J. Robotics Res..

[12]  Gregory J. Barlow,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Fitness Functions in Evolutionary Robotics: a Survey and Analysis , 2022 .

[13]  James P. Crutchfield,et al.  Computation at the Onset of Chaos , 1991 .

[14]  P. Cz. Handbuch der physiologischen Optik , 1896 .

[15]  Kenneth O. Stanley,et al.  Exploiting Open-Endedness to Solve Problems Through the Search for Novelty , 2008, ALIFE.

[16]  Stéphane Doncieux,et al.  Using behavioral exploration objectives to solve deceptive problems in neuro-evolution , 2009, GECCO.

[17]  Marco Dorigo,et al.  Evolution of Direct Communication for a Swarm-bot Performing Hole Avoidance , 2004, ANTS Workshop.

[18]  Fernando Silva,et al.  Online Extreme Evolutionary Learning Machines , 2014, ALIFE.

[19]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[20]  Graham Kendall,et al.  Evolving Collective Behavior in an Artificial Ecology , 2001, Artificial Life.

[21]  Joseph J. Hale,et al.  From Disorder to Order in Marching Locusts , 2006, Science.

[22]  Petr Sosík,et al.  Advances in Artificial Life , 2001, Lecture Notes in Computer Science.

[23]  Heiko Hamann,et al.  Evolving prediction machines: collective behaviors based on minimal surprisal , 2014, GECCO.

[24]  Vito Trianni,et al.  Evolutionary Swarm Robotics - Evolving Self-Organising Behaviours in Groups of Autonomous Robots , 2008, Studies in Computational Intelligence.

[25]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[26]  Heiko Hamann Towards swarm calculus: urn models of collective decisions and universal properties of swarm performance , 2013, Swarm Intelligence.

[27]  Marco Dorigo,et al.  Evolving Aggregation Behaviors in a Swarm of Robots , 2003, ECAL.

[28]  James A. R. Marshall,et al.  Swarm Cognition: an interdisciplinary approach to the study of self-organising biological collectives , 2011, Swarm Intelligence.

[29]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[30]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.