Autonomous detection of collective behaviours in swarms

Abstract Collective behaviours such as swarm formations of autonomous agents offer the advantages of efficient movement, redundancy, and potential for human guidance of a single swarm organism. This paper proposes a developmental approach to evolving collective behaviours whereby the evolutionary process is guided by a novel value system. A self-organising map is used at the core of this value system and motion properties of the swarm entities are used as input. Unlike traditional approaches, this value system does not need in advance the precise characteristics of the intended behaviours. We examine the performance of this value system in a series of controlled experiments. Our results demonstrate that the value system can recognise multiple “interesting” structured collective behaviours and distinguish them from random movement patterns. Results show that our value system is most effective distinguishing structured behaviours from random behaviours when using motion properties of individual agents as input. Further variations and modifications to input data such as normalisation and aggregation were also investigated, and it was shown that certain configurations provide better results in distinguishing collective behaviours from random ones.

[1]  Jürgen Leitner,et al.  Curiosity driven reinforcement learning for motion planning on humanoids , 2014, Front. Neurorobot..

[2]  Kevin N. Gurney,et al.  A biologically plausible embodied model of action discovery , 2012, Front. Neurorobot..

[3]  Arie Croitoru,et al.  Deriving Low-Level Steering Behaviors from Trajectory Data , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[4]  J. Toner,et al.  Flocks, herds, and schools: A quantitative theory of flocking , 1998, cond-mat/9804180.

[5]  Kathryn Kasmarik,et al.  Automatic synthesis of swarm behavioural rules from their atomic components , 2018, GECCO.

[6]  Swagatam Das,et al.  Chaotic Dynamics in Social Foraging Swarms—An Analysis , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  F. Karray,et al.  Computational Intelligence Techniques in Bio-inspired Robotics , 2009 .

[8]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[9]  Ralf Der,et al.  Information Driven Self-Organization of Complex Robotic Behaviors , 2013, PloS one.

[10]  David R. Jacques,et al.  Flight test results for UAVs using boid guidance algorithms , 2012, CSER.

[11]  Umut Asan,et al.  An Introduction to Self-Organizing Maps , 2012 .

[12]  Karl J. Friston,et al.  What is value—accumulated reward or evidence? , 2012, Front. Neurorobot..

[13]  David B. Fogel What is evolutionary computation , 1995 .

[14]  Jürgen Schmidhuber,et al.  Learning tactile skills through curious exploration , 2012, Front. Neurorobot..

[15]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[16]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[17]  Zachary Ball,et al.  Distributed operation of collaborating unmanned aerial vehicles for time-sensitive oil spill mapping , 2019, Swarm Evol. Comput..

[18]  John S. Gero,et al.  Curious agents and situated design evaluations , 2004, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[19]  Kathryn E. Merrick,et al.  Value systems for developmental cognitive robotics: A survey , 2017, Cognitive Systems Research.

[20]  Gerardo Beni,et al.  From Swarm Intelligence to Swarm Robotics , 2004, Swarm Robotics.

[21]  Pierre-Yves Oudeyer,et al.  What is Intrinsic Motivation? A Typology of Computational Approaches , 2007, Frontiers Neurorobotics.

[22]  Anders Lyhne Christensen,et al.  Evolution of swarm robotics systems with novelty search , 2013, Swarm Intelligence.

[23]  A. Czirók,et al.  Collective Motion , 1999, physics/9902023.

[24]  Abraham Prieto,et al.  Embodied Evolution in Collective Robotics: A Review , 2017, Front. Robot. AI.

[25]  Martin Cenek,et al.  Towards Emergent Design: Analysis, Fitness and Heterogeneity of Agent Based Models Using Geometry of Behavioral Spaces Framework , 2016, ALIFE.

[26]  Esa Alhoniemi,et al.  Self-organizing map in Matlab: the SOM Toolbox , 1999 .

[27]  Xin-She Yang,et al.  Bio-inspired computation: Where we stand and what's next , 2019, Swarm Evol. Comput..

[28]  Marijn F. Stollenga,et al.  Continual curiosity-driven skill acquisition from high-dimensional video inputs for humanoid robots , 2017, Artif. Intell..

[29]  Matt Duckham,et al.  Decentralized Movement Pattern Detection amongst Mobile Geosensor Nodes , 2008, GIScience.

[30]  Stephen J. Simpson,et al.  Biological Foundations of Swarm Intelligence , 2008, Swarm Intelligence.

[31]  Kathryn E. Merrick,et al.  A Comparative Study of Value Systems for Self-Motivated Exploration and Learning by Robots , 2010, IEEE Transactions on Autonomous Mental Development.

[32]  Mauro Innocente,et al.  Self-organising swarms of firefighting drones: Harnessing the power of collective intelligence in decentralised multi-robot systems , 2019, J. Comput. Sci..

[33]  Mark D. Humphries,et al.  A robot model of the basal ganglia: Behavior and intrinsic processing , 2006, Neural Networks.

[34]  Raymond J. Dolan,et al.  Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot , 2014, Front. Psychol..

[35]  Jing Wang,et al.  Swarm Intelligence in Cellular Robotic Systems , 1993 .

[36]  Hussein A. Abbass,et al.  Assessing Human Judgment of Computationally Generated Swarming Behavior , 2018, Front. Robot. AI.

[37]  Marie desJardins,et al.  Predicting and Controlling System-Level Parameters of Multi-Agent Systems , 2009, AAAI Fall Symposium: Complex Adaptive Systems and the Threshold Effect.

[38]  Olaf Sporns,et al.  Plasticity in Value Systems and its Role in Adaptive Behavior , 2000, Adapt. Behav..

[39]  Kenneth O. Stanley,et al.  Abandoning Objectives: Evolution Through the Search for Novelty Alone , 2011, Evolutionary Computation.

[40]  Michael Barlow,et al.  What cost teamwork: Quantifying situational awareness and computational requirements in a proto-team via multi-objective evolution , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[41]  Yi Sun,et al.  On quantization error of self-organizing map network , 2000, Neurocomputing.

[42]  Silvia Rossi,et al.  The role of intrinsic motivations in attention allocation and shifting , 2014, Front. Psychol..

[43]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[44]  Teuvo Kohonen,et al.  Essentials of the self-organizing map , 2013, Neural Networks.

[45]  Juyang Weng,et al.  Inherent Value Systems for Autonomous Mental Development , 2007, Int. J. Humanoid Robotics.

[46]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[47]  Heiko Hamann,et al.  Evolution of Collective Behaviors by Minimizing Surprisal and by Micro-Macro Links , 2015, GECCO.

[48]  Larissa Albantakis,et al.  How swarm size during evolution impacts the behavior, generalizability, and brain complexity of animats performing a spatial navigation task , 2018, GECCO.

[49]  Katia P. Sycara,et al.  Human Interaction With Robot Swarms: A Survey , 2016, IEEE Transactions on Human-Machine Systems.

[50]  Martijn C. Schut,et al.  Evolving behavioral specialization in robot teams to solve a collective construction task , 2012, Swarm Evol. Comput..

[51]  Yves Rémond,et al.  Detection of small changes in medical and random-dot images comparing self-organizing map performance to human detection , 2019, ArXiv.

[52]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[53]  Marco Mirolli,et al.  Functions and Mechanisms of Intrinsic Motivations , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.

[54]  Kenji Doya,et al.  The Cyber Rodent Project: Exploration of Adaptive Mechanisms for Self-Preservation and Self-Reproduction , 2005, Adapt. Behav..

[55]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[56]  Matej Oresic,et al.  Self-organization and missing values in SOM and GTM , 2015, Neurocomputing.

[57]  Hussein A. Abbass,et al.  Application of chaos measures to a simplified boids flocking model , 2015, Swarm Intelligence.