Multi-agent system dynamics: Bifurcation and behavior of animal groups

Systematic design of decentralized feedback for coordinated control of multi-agent systems has much to gain from the rigorous examination of the nonlinear dynamics of collective animal behavior. Animals in groups, from bird flocks to fish schools, employ decentralized strategies and have limitations on sensing, computation, and actuation. Yet, at the level of the group, they are known to manage a variety of challenging tasks quickly, accurately, robustly and adaptively in an uncertain and changing environment. In this paper we review recent work on models and methods for studying the mechanisms of collective migration and collective decision-making in high-performing animal groups. Through bifurcation analyses we prove systematically how behavior depends on parameters that model the system and the environment. These connections lay the foundations for proving systematic control design methodologies that endow engineered multi-agent systems with the remarkable features of animal group dynamics.

[1]  É. Kisdi,et al.  Evolutionarily singular strategies and the adaptive growth and branching of the evolutionary tree , 2004, Evolutionary Ecology.

[2]  N. Franks,et al.  A Mechanism for Value-Sensitive Decision-Making , 2013, PloS one.

[3]  I. Couzin,et al.  Collective memory and spatial sorting in animal groups. , 2002, Journal of theoretical biology.

[4]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[5]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[6]  J. Hutchinson.  Animal groups in three dimensions , 1999 .

[7]  D. Sumpter.  Collective Animal Behavior , 2010 .

[8]  Peter F. Stadler,et al.  Mutation in autocatalytic reaction networks , 1992, Journal of mathematical biology.

[9]  Odo Diekmann,et al.  A beginners guide to adaptive dynamics , 2002 .

[10]  Reza Olfati-Saber,et al.  Evolutionary dynamics of behavior in social networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[11]  Sasha R. X. Dall,et al.  Information and its use by animals in evolutionary ecology. , 2005, Trends in ecology & evolution.

[12]  Bassam Bamieh,et al.  Leader selection for optimal network coherence , 2010, 49th IEEE Conference on Decision and Control (CDC).

[13]  Naomi Ehrich Leonard,et al.  Coordinated control of an underwater glider fleet in an adaptive ocean sampling field experiment in Monterey Bay , 2010, J. Field Robotics.

[14]  Chris Cosner,et al.  Leadership, social learning, and the maintenance (or collapse) of migratory populations , 2011, Theoretical Ecology.

[15]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[16]  D. Pais.  Emergent Collective Behavior in Multi-Agent Systems: An Evolutionary Perspective , 2012 .

[17]  Naomi Ehrich Leonard,et al.  On the trajectories and coordination of steered particles with time-periodic speed profiles , 2009, 2009 American Control Conference.

[18]  Sachit Butail,et al.  The Dance of Male Anopheles gambiae in Wild Mating Swarms , 2013, Journal of medical entomology.

[19]  Martin Wikelski,et al.  How and Why Do Insects Migrate? , 2006, Science.

[20]  M A Nowak,et al.  Evolution of universal grammar. , 2001, Science.

[21]  Naomi Ehrich Leonard,et al.  SPATIAL PATTERNS IN THE DYNAMICS OF ENGINEERED AND BIOLOGICAL NETWORKS , 2007 .

[22]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[23]  S. Pratt,et al.  Groups have a larger cognitive capacity than individuals , 2012, Current Biology.

[24]  Andrew T. Hartnett,et al.  This PDF file includes: Materials and Methods SOM Text Figs. S1 to S12 Table S1 Full Reference List , 2022 .

[25]  Naomi Ehrich Leonard,et al.  Adaptive Network Dynamics and Evolution of Leadership in Collective Migration , 2013, ArXiv.

[26]  T. Seeley,et al.  Nest-site selection in honey bees: how well do swarms implement the "best-of-N" decision rule? , 2001, Behavioral Ecology and Sociobiology.

[27]  É. Kisdi,et al.  Dynamics of Adaptation and Evolutionary Branching , 1997 .

[28]  R. R. Krausz.  Living in Groups , 2013 .

[29]  Iain D. Couzin,et al.  Specialization and evolutionary branching within migratory populations , 2010, Proceedings of the National Academy of Sciences.

[30]  Fumin Zhang,et al.  Robust Cooperative Exploration With a Switching Strategy , 2012, IEEE Transactions on Robotics.

[31]  Naomi Ehrich Leonard,et al.  Decision versus compromise for animal groups in motion , 2011, Proceedings of the National Academy of Sciences.

[32]  Islam I. Hussein,et al.  An individual-based evolutionary dynamics model for networked social behaviors , 2009, 2009 American Control Conference.

[33]  Naomi Ehrich Leonard,et al.  Vehicle networks for gradient descent in a sampled environment , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[34]  Y Wang,et al.  Evolutionary bandwidth allocation and routing in large-scale wireless sensor networks , 2010, Proceedings of the 2010 American Control Conference.

[35]  Naomi Ehrich Leonard,et al.  Collective Motion, Sensor Networks, and Ocean Sampling , 2007, Proceedings of the IEEE.

[36]  Natalia L. Komarova,et al.  Eavesdropping and language dynamics. , 2010, Journal of theoretical biology.

[37]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[38]  Naomi Ehrich Leonard,et al.  Cooperative Filters and Control for Cooperative Exploration , 2010, IEEE Transactions on Automatic Control.

[39]  Maja J. Matarić,et al.  Designing emergent behaviors: from local interactions to collective intelligence , 1993 .

[40]  Martin A Nowak,et al.  Chaos and language , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[41]  Naomi Ehrich Leonard,et al.  Stabilization of Planar Collective Motion With Limited Communication , 2008, IEEE Transactions on Automatic Control.

[42]  Naomi Ehrich Leonard,et al.  Stabilization of Planar Collective Motion: All-to-All Communication , 2007, IEEE Transactions on Automatic Control.

[43]  L. Edelstein-Keshet,et al.  Complexity, pattern, and evolutionary trade-offs in animal aggregation. , 1999, Science.

[44]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[45]  T. L. Vincent,et al.  Evolution and control system design. The evolutionary game , 2000 .

[46]  Ermin Wei,et al.  Pursuit and an evolutionary game , 2009, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[47]  M. Nowak,et al.  Unifying evolutionary dynamics. , 2002, Journal of theoretical biology.

[48]  Naomi Ehrich Leonard,et al.  Starling Flock Networks Manage Uncertainty in Consensus at Low Cost , 2013, PLoS Comput. Biol..

[49]  Eitan Altman,et al.  Evolutionary Games in Wireless Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[50]  Radha Poovendran,et al.  A Supermodular Optimization Framework for Leader Selection Under Link Noise in Linear Multi-Agent Systems , 2012, IEEE Transactions on Automatic Control.

[51]  Spring Berman,et al.  Experimental Study and Modeling of Group Retrieval in Ants as an Approach to Collective Transport in Swarm Robotic Systems , 2011, Proceedings of the IEEE.

[52]  Naomi Ehrich Leonard,et al.  Hopf Bifurcations and Limit Cycles in Evolutionary Network Dynamics , 2012, SIAM J. Appl. Dyn. Syst..

[53]  Thilo Gross,et al.  Patterns of cooperation: fairness and coordination in networks of interacting agents , 2009, 0902.2954.

[54]  G. Parisi,et al.  Interaction ruling animal collective behavior depends on topological rather than metric distance: Evidence from a field study , 2007, Proceedings of the National Academy of Sciences.

[55]  David M. Fratantoni,et al.  Multi-AUV Control and Adaptive Sampling in Monterey Bay , 2006, IEEE Journal of Oceanic Engineering.

[56]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[57]  Naomi Ehrich Leonard,et al.  Spatial models of bistability in biological collectives , 2007, 2007 46th IEEE Conference on Decision and Control.

[58]  Natalia L Komarova,et al.  Replicator-mutator equation, universality property and population dynamics of learning. , 2004, Journal of theoretical biology.

[59]  G. Uhlenbeck,et al.  On the Theory of the Brownian Motion , 1930 .

[60]  A. Sinclair,et al.  Causes and consequences of migration by large herbivores. , 1988, Trends in ecology & evolution.

[61]  I. Couzin,et al.  Self-Organization and Collective Behavior in Vertebrates , 2003 .

[62]  D. Grünbaum.  Schooling as a strategy for taxis in a noisy environment , 1998, Evolutionary Ecology.

[63]  Fu Lin,et al.  Algorithms for Leader Selection in Stochastically Forced Consensus Networks , 2013, IEEE Transactions on Automatic Control.

[64]  James A. R. Marshall,et al.  Swarm Cognition: an interdisciplinary approach to the study of self-organising biological collectives , 2011, Swarm Intelligence.

[65]  Jean-Louis Deneubourg,et al.  From local actions to global tasks: stigmergy and collective robotics , 2000 .

[66]  Colin Torney,et al.  Context-dependent interaction leads to emergent search behavior in social aggregates , 2009, Proceedings of the National Academy of Sciences.

[67]  I. Couzin,et al.  Social interactions, information use, and the evolution of collective migration , 2010, Proceedings of the National Academy of Sciences.