Coevolutionary learning of swarm behaviors without metrics

We propose a coevolutionary approach for learning the behavior of animals, or agents, in collective groups. The approach requires a replica that resembles the animal under investigation in terms of appearance and behavioral capabilities. It is able to identify the rules that govern the animals in an autonomous manner. A population of candidate models, to be executed on the replica, compete against a population of classifiers. The replica is mixed into the group of animals and all individuals are observed. The fitness of the classifiers depends solely on their ability to discriminate between the replica and the animals based on their motion over time. Conversely, the fitness of the models depends solely on their ability to 'trick' the classifiers into categorizing them as an animal. Our approach is metric-free in that it autonomously learns how to judge the resemblance of the models to the animals. It is shown in computer simulation that the system successfully learns the collective behaviors of aggregation and of object clustering. A quantitative analysis reveals that the evolved rules approximate those of the animals with a good precision.

[1]  D. H. Janzen,et al.  Ecology of Foraging by Ants , 1973 .

[2]  Jean-Arcady Meyer,et al.  Biologically Inspired Robots , 2008, Springer Handbook of Robotics.

[3]  Ken E. Whelan,et al.  The Automation of Science , 2009, Science.

[4]  Hod Lipson,et al.  Optimal Experiment Design for Coevolutionary Active Learning , 2014, IEEE Transactions on Evolutionary Computation.

[5]  Hod Lipson,et al.  Automated robot function recovery after unanticipated failure or environmental change using a minimum of hardware trials , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[6]  Hod Lipson,et al.  Nonlinear system identification using coevolution of models and tests , 2005, IEEE Transactions on Evolutionary Computation.

[7]  V. Isaeva Self-organization in biological systems , 2012, Biology Bulletin.

[8]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[9]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[10]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[11]  Francesco Mondada,et al.  Towards mixed societies of chickens and robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  W. Sutherland,et al.  The importance of behavioural studies in conservation biology , 1998, Animal Behaviour.

[13]  J. Deneubourg,et al.  Self-organized aggregation in cockroaches , 2005, Animal Behaviour.

[14]  Stephen Cameron,et al.  Experiments in automatic flock control , 2000, Robotics Auton. Syst..

[15]  Wei Li,et al.  Clustering objects with robots that do not compute , 2014, AAMAS.

[16]  Francesco Mondada,et al.  The e-puck, a Robot Designed for Education in Engineering , 2009 .

[17]  Bennett G. Galef The Behavior of Animals: Mechanisms, Function and Evolution Johan J. Bol , 2005, Animal Behaviour.

[18]  Wei Li,et al.  A coevolutionary approach to learn animal behavior through controlled interaction , 2013, GECCO '13.

[19]  J. Bongard,et al.  Co‐evolutionary algorithm for structural damage identification using minimal physical testing , 2007 .

[20]  Serge Kernbach,et al.  ASSISI: Mixing Animals with Robots in a Hybrid Society , 2013, Living Machines.

[21]  J. Deneubourg,et al.  Interactive robots in experimental biology. , 2011, Trends in ecology & evolution.

[22]  Serge Kernbach,et al.  Towards Bio-hybrid Systems Made of Social Animals and Robots , 2013, Living Machines.

[23]  Stéphane Doncieux,et al.  Automatic system identification based on coevolution of models and tests , 2009, 2009 IEEE Congress on Evolutionary Computation.

[24]  F Mondada,et al.  Social Integration of Robots into Groups of Cockroaches to Control Self-Organized Choices , 2007, Science.

[25]  Anthony Kulis,et al.  Bio-Inspired Artificial Intelligence: Theories, Methods, and Technologies , 2009, Scalable Comput. Pract. Exp..

[26]  Tony J. Dodd,et al.  Self-organized aggregation without computation , 2014, Int. J. Robotics Res..