Emergent communication enhances foraging behaviour in evolved swarms controlled by Spiking Neural Networks

Social insects such as ants communicate via pheromones which allows them to coordinate their activity and solve complex tasks as a swarm, e.g. foraging for food. This behavior was shaped through evolutionary processes. In computational models, self-coordination in swarms has been implemented using probabilistic or simple action rules to shape the decision of each agent and the collective behavior. However, manual tuned decision rules may limit the behavior of the swarm. In this work we investigate the emergence of self-coordination and communication in evolved swarms without defining any explicit rule. We evolve a swarm of agents representing an ant colony. We use an evolutionary algorithm to optimize a spiking neural network (SNN) which serves as an artificial brain to control the behavior of each agent. The goal of the evolved colony is to find optimal ways to forage for food and return it to the nest in the shortest amount of time. In the evolutionary phase, the ants are able to learn to collaborate by depositing pheromone near food piles and near the nest to guide other ants. The pheromone usage is not manually encoded into the network; instead, this behavior is established through the optimization procedure. We observe that pheromone-based communication enables the ants to perform better in comparison to colonies where communication via pheromone did not emerge. We assess the foraging performance by comparing the SNN based model to a rule based system. Our results show that the SNN based model can efficiently complete the foraging task in a short amount of time. Our approach illustrates self coordination via pheromone emerges as a result of the network optimization. This work serves as a proof of concept for the possibility of creating complex applications utilizing SNNs as underlying architectures for multi-agent interactions where communication and self-coordination is desired.

[1]  L. Lavagno,et al.  To Spike or Not To Spike: A Digital Hardware Perspective on Deep Learning Acceleration , 2023, ArXiv.

[2]  Rachmad Vidya Wicaksana Putra,et al.  TopSpark: A Timestep Optimization Methodology for Energy-Efficient Spiking Neural Networks on Autonomous Mobile Agents , 2023, arXiv.org.

[3]  Ngan T. H. Le,et al.  Spiking Neural Networks and Their Applications: A Review , 2022, Brain sciences.

[4]  Lei Deng,et al.  Spiking Neural Network Integrated Circuits: A Review of Trends and Future Directions , 2022, 2022 IEEE Custom Integrated Circuits Conference (CICC).

[5]  M. Herty,et al.  Exploring Parameter and Hyper-Parameter Spaces of Neuroscience Models on High Performance Computers With Learning to Learn , 2022, Frontiers in Computational Neuroscience.

[6]  Guy Theraulaz,et al.  Reflections on the future of swarm robotics , 2020, Science Robotics.

[7]  Mitsuhisa Sato,et al.  Extremely Scalable Spiking Neuronal Network Simulation Code: From Laptops to Exascale Computers , 2018, Front. Neuroinform..

[8]  Stephanie Forrest,et al.  Automatically evolving a general controller for robot swarms , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[9]  Mauro Birattari,et al.  Automatic Design of Robot Swarms: Achievements and Challenges , 2016, Front. Robot. AI.

[10]  Nikil D. Dutt,et al.  A GPU-accelerated cortical neural network model for visually guided robot navigation , 2015, Neural Networks.

[11]  Brent Doiron,et al.  Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses , 2015, PLoS Comput. Biol..

[12]  Melanie E. Moses,et al.  Beyond pheromones: evolving error-tolerant, flexible, and scalable ant-inspired robot swarms , 2015, Swarm Intelligence.

[13]  Joshua P. Hecker,et al.  Beyond pheromones: evolving error-tolerant, flexible, and scalable ant-inspired robot swarms , 2015, Swarm Intelligence.

[14]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[15]  Martin A Nowak,et al.  Natural selection drives the evolution of ant life cycles , 2014, Proceedings of the National Academy of Sciences.

[16]  Haibin Duan,et al.  Swarm intelligence inspired shills and the evolution of cooperation , 2014, Scientific Reports.

[17]  Eric Nichols,et al.  Biologically Inspired SNN for Robot Control , 2013, IEEE Transactions on Cybernetics.

[18]  Sylvain Chevallier,et al.  SpikeAnts, a spiking neuron network modelling the emergence of organization in a complex system , 2010, NIPS.

[19]  Eric Nichols,et al.  Case Study on a Self-Organizing Spiking Neural Network for Robot Navigation , 2010, Int. J. Neural Syst..

[20]  Stefano Nolfi,et al.  Self-Organizing Sync in a Robotic Swarm: A Dynamical System View , 2009, IEEE Transactions on Evolutionary Computation.

[21]  Dario Floreano,et al.  Genetic Team Composition and Level of Selection in the Evolution of Cooperation , 2009, IEEE Transactions on Evolutionary Computation.

[22]  G. Robinson,et al.  Genetic and genomic analyses of the division of labour in insect societies , 2008, Nature Reviews Genetics.

[23]  Aluizio F. R. Araújo,et al.  Modeling ant colony foraging in dynamic and confined environment , 2008, GECCO '08.

[24]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[25]  Mike Holcombe,et al.  Insect communication: ‘No entry’ signal in ant foraging , 2005, Nature.

[26]  Guy Theraulaz,et al.  Modeling Ant Behavior Under a Variable Environment , 2004, ANTS Workshop.

[27]  E. Wilson,et al.  The First Mesozoic Ants , 1967, Science.

[28]  R. Beutel,et al.  Evidence for the evolution of eusociality in stem ants and a systematic revision of † Gerontoformica (Hymenoptera: Formicidae) , 2022 .

[29]  Dmitriy Shutin,et al.  SWARM TECHNOLOGIES FOR FUTURE SPACE EXPLORATION MISSIONS , 2018 .

[30]  Uri Wilensky,et al.  NetLogo: A simple environment for modeling complexity , 2014 .

[31]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[32]  Marco Dorigo,et al.  Evolution, Self-organization and Swarm Robotics , 2008, Swarm Intelligence.

[33]  Luis Mateus Rocha,et al.  Evolving an Integrated Phototaxis and Hole-avoidance Behavior for a Swarm-bot , 2006 .

[34]  Stuart A. Kauffman,et al.  The origins of order , 1993 .