The Best-of-n Problem in Robot Swarms: Formalization, State of the Art, and Novel Perspectives

The ability to collectively choose the best among a finite set of alternatives is a fundamental cognitive skill for robot swarms. In this paper, we propose a formal definition of the best-of-n problem and a taxonomy that details its possible variants. Based on this taxonomy, we analyze the swarm robotics literature focusing on the decision-making problem dealt with by the swarm. We find that, so far, the literature has primarily focused on certain variants of the best-of-n problem while other variants have been the subject of only a few isolated studies. Additionally, we consider a second taxonomy about the design methodologies used to develop collective decision-making strategies. Based on this second taxonomy, we provide an in-depth survey of the literature that details the strategies proposed so far and discusses the advantages and disadvantages of current design methodologies.

[1]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[2]  Yilun Shang,et al.  Influence of the number of topologically interacting neighbors on swarm dynamics , 2014, Scientific Reports.

[3]  Eliseo Ferrante,et al.  The ${k}$ -Unanimity Rule for Self-Organized Decision-Making in Swarms of Robots , 2016, IEEE Transactions on Cybernetics.

[4]  Eliseo Ferrante,et al.  Self-organized flocking with a mobile robot swarm: a novel motion control method , 2012, Adapt. Behav..

[5]  Ali Emre Turgut,et al.  Cue-based aggregation with a mobile robot swarm: a novel fuzzy-based method , 2014, Adapt. Behav..

[6]  J. Deneubourg,et al.  A model of animal movements in a bounded space. , 2003, Journal of theoretical biology.

[7]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1998 .

[8]  Alcherio Martinoli,et al.  Aggregation-mediated collective perception and action in a group of miniature robots , 2010, AAMAS.

[9]  S. Redner,et al.  Dynamics of majority rule in two-state interacting spin systems. , 2003, Physical review letters.

[10]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[11]  Serge Galam,et al.  SOCIOPHYSICS: A REVIEW OF GALAM MODELS , 2008, 0803.1800.

[12]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[13]  Jacobus C. Biesmeijer,et al.  Self-organization in collective honeybee foraging: emergence of symmetry breaking, cross inhibition and equal harvest-rate distribution , 2002, Behavioral Ecology and Sociobiology.

[14]  Andrew T. Hartnett,et al.  This PDF file includes: Materials and Methods SOM Text Figs. S1 to S12 Table S1 Full Reference List , 2022 .

[15]  T. Vicsek,et al.  Collective behavior of interacting self-propelled particles , 2000, cond-mat/0611742.

[16]  Nikos A. Vlassis,et al.  Multi-robot decision making using coordination graphs , 2003 .

[17]  Utkarsh Upadhyay,et al.  Top-Down vs. Bottom-Up Model-Based Methodologies for Distributed Control: A Comparative Experimental Study , 2010, ISER.

[18]  Mehran Mesbahi,et al.  Agreement over random networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[19]  Marco Dorigo,et al.  Collective Perception of Environmental Features in a Robot Swarm , 2016, ANTS Conference.

[20]  Thomas Schlegel,et al.  Stop Signals Provide Cross Inhibition in Collective Decision-making , 2022 .

[21]  Guy Theraulaz,et al.  The Embodiment of Cockroach Aggregation Behavior in a Group of Micro-robots , 2008, Artificial Life.

[22]  James M. Hereford Analysis of a new swarm search algorithm based on trophallaxis , 2010, IEEE Congress on Evolutionary Computation.

[23]  Alessio Lomuscio,et al.  Formal Verification of Opinion Formation in Swarms , 2016, AAMAS.

[24]  G.,et al.  Majority Rule with Differential Latency : An Absorbing Markov Chain to Model Consensus , 2012 .

[25]  Tony J. Dodd,et al.  Self-organized aggregation without computation , 2014, Int. J. Robotics Res..

[26]  C. List,et al.  Group decisions in humans and animals: a survey , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  M. Dorigo,et al.  A Design Pattern for Decentralised Decision Making , 2015, PloS one.

[28]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[29]  J. Deneubourg,et al.  Collective patterns and decision-making , 1989 .

[30]  Yongcan Cao,et al.  Distributed Coordinated Tracking With Reduced Interaction via a Variable Structure Approach , 2012, IEEE Transactions on Automatic Control.

[31]  Ali Emre Turgut,et al.  Self-organized flocking in mobile robot swarms , 2008, Swarm Intelligence.

[32]  Matthias Bethge,et al.  Beyond GLMs: A Generative Mixture Modeling Approach to Neural System Identification , 2012, PLoS Comput. Biol..

[33]  Heiko Hamann,et al.  Space-Time Continuous Models of Swarm Robotic Systems - Supporting Global-to-Local Programming , 2010, Cognitive Systems Monographs.

[34]  Heinz Wörn,et al.  A framework of space–time continuous models for algorithm design in swarm robotics , 2008, Swarm Intelligence.

[35]  Karl Crailsheim,et al.  Protein trophallaxis and the regulation of pollen foraging by honey bees (Apis mellifera L.) , 1998 .

[36]  Tim Kovacs,et al.  On optimal decision-making in brains and social insect colonies , 2009, Journal of The Royal Society Interface.

[37]  Mehmet Serdar Guzel,et al.  A Collective Behaviour Framework for Multi-agent Systems , 2017 .

[38]  Thomas Schmickl,et al.  Collective Perception in a Robot Swarm , 2006, Swarm Robotics.

[39]  M. Beekman,et al.  Information integration and multiattribute decision making in non-neuronal organisms , 2015, Animal Behaviour.

[40]  Francesco Mondada,et al.  The e-puck, a Robot Designed for Education in Engineering , 2009 .

[41]  Paul Levi,et al.  Minimalistic approach towards communication and perception in microrobotic swarms , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  G. Theraulaz,et al.  Robots Self-Organized Aggregation Triggers Collective Decision Making in a Group of Cockroach-Like , 2009 .

[43]  Thomas Schmickl,et al.  Noname manuscript No. (will be inserted by the editor) Analysis of Emergent Symmetry Breaking in Collective Decision Making , 2010 .

[44]  Bin Wei,et al.  Mechatronics and Robotics Engineering for Advanced and Intelligent Manufacturing , 2017 .

[45]  Eamonn B. Mallon,et al.  Information flow, opinion polling and collective intelligence in house-hunting social insects. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[46]  T. Vicsek,et al.  Collective Motion , 1999, physics/9902023.

[47]  Francisco C. Santos,et al.  Social Odometry: Imitation Based Odometry in Collective Robotics , 2009 .

[48]  Marco Dorigo,et al.  Morphology control in a multirobot system , 2007, IEEE Robotics & Automation Magazine.

[49]  Deborah M. Gordon,et al.  From division of labor to the collective behavior of social insects , 2015, Behavioral Ecology and Sociobiology.

[50]  Jie Chen,et al.  Towards Energy Optimization: Emergent Task Allocation in a Swarm of Foraging Robots , 2007, Adapt. Behav..

[51]  Eliseo Ferrante,et al.  Majority-rule opinion dynamics with differential latency: a mechanism for self-organized collective decision-making , 2011, Swarm Intelligence.

[52]  Eliseo Ferrante,et al.  Binary Consensus via Exponential Smoothing , 2012, Complex.

[53]  Heinz Wörn,et al.  Distributed Shortest-Path Finding by a Micro-robot Swarm , 2006, ANTS Workshop.

[54]  Josh C. Bongard,et al.  Evolutionary robotics , 2013, CACM.

[55]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[56]  Kristina Lerman,et al.  Autonomous Robots manuscript No. (will be inserted by the editor) Top–Down vs Bottom–up Methodologies in Multi–Agent System Design , 2022 .

[57]  J. Deneubourg,et al.  Self-organized shortcuts in the Argentine ant , 1989, Naturwissenschaften.

[58]  M. Caputa,et al.  Social versus individual behaviour: a comparative approach to thermal behaviour of the honeybee (Apis mellifera L.) and the American cockroach (Periplaneta americana L.). , 2005, Journal of insect physiology.

[59]  Eliseo Ferrante,et al.  “Can ants inspire robots?” Self-organized decision making in robotic swarms , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[60]  Thomas Schmickl,et al.  Trophallaxis within a robotic swarm: bio-inspired communication among robots in a swarm , 2008, Auton. Robots.

[61]  Hong Zhang,et al.  Biologically inspired collective comparisons by robotic swarms , 2011, Int. J. Robotics Res..

[62]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[63]  P. Visscher,et al.  House-hunting by honey bee swarms: collective decisions and individual behaviors , 1999, Insectes Sociaux.

[64]  Thomas Schmickl,et al.  Two different approaches to a macroscopic model of a bio-inspired robotic swarm , 2009, Robotics Auton. Syst..

[65]  D M Gordon,et al.  The behavioral ecology of variation in social insects. , 2016, Current opinion in insect science.

[66]  H. Roche,et al.  Why Copy Others? Insights from the Social Learning Strategies Tournament , 2010 .

[67]  Hong Zhang,et al.  Collective unary decision-making by decentralized multiple-robot systems applied to the task-sequencing problem , 2010, Swarm Intelligence.

[68]  Hiroaki Kitano,et al.  RoboCup: A Challenge Problem for AI , 1997, AI Mag..

[69]  Marco Dorigo,et al.  From Solitary to Collective Behaviours: Decision Making and Cooperation , 2007, ECAL.

[70]  A. Ōkubo Dynamical aspects of animal grouping: swarms, schools, flocks, and herds. , 1986, Advances in biophysics.

[71]  Dario Floreano,et al.  Minimalist Coherent Swarming of Wireless Networked Autonomous Mobile Robots , 2002 .

[72]  Eliseo Ferrante,et al.  A self-adaptive communication strategy for flocking in stationary and non-stationary environments , 2013, Natural Computing.

[73]  Eliseo Ferrante,et al.  Swarm robotics: a review from the swarm engineering perspective , 2013, Swarm Intelligence.

[74]  Stefano Nolfi,et al.  Engineering the Evolution of Self-Organizing Behaviors in Swarm Robotics: A Case Study , 2011, Artificial Life.

[75]  Stergios I. Roumeliotis,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part II: Distributed Estimation and Smoothing of Random Signals , 2008, IEEE Transactions on Signal Processing.

[76]  Roland Bouffanais,et al.  Resilience and Controllability of Dynamic Collective Behaviors , 2013, PloS one.

[77]  S. Moscovici,et al.  The group as a polarizer of attitudes. , 1969 .

[78]  Nikolaus Correll,et al.  Modeling and designing self-organized aggregation in a swarm of miniature robots , 2011, Int. J. Robotics Res..

[79]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.

[80]  Roland Siegwart,et al.  Fascination of down scaling — Alice the sugar cube robot , 2001 .

[81]  Guy Theraulaz,et al.  The biological principles of swarm intelligence , 2007, Swarm Intelligence.

[82]  Martin C. Stumpe,et al.  Harvester ants use interactions to regulate forager activation and availability , 2013, Animal Behaviour.

[83]  Jari Saramäki,et al.  Dynamics of latent voters. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[84]  Marco Dorigo,et al.  Collective decision-making based on social odometry , 2010, Neural Computing and Applications.

[85]  Nikolaus Correll,et al.  Parameter estimation and optimal control of swarm-robotic systems: A case study in distributed task allocation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[86]  Jelle R. Kok,et al.  Distributed decision making of robotic agents , 2003 .

[87]  Mauro Birattari,et al.  Swarm robotics , 2014, Scholarpedia.

[88]  Dave Cliff,et al.  Challenges in evolving controllers for physical robots , 1996, Robotics Auton. Syst..

[89]  Mauro Birattari,et al.  AutoMoDe: A novel approach to the automatic design of control software for robot swarms , 2014, Swarm Intelligence.

[90]  Erol Sahin,et al.  A Macroscopic Model for Self-organized Aggregation in Swarm Robotic Systems , 2006, Swarm Robotics.

[91]  Guy Theraulaz,et al.  Collective response to perturbations in a data-driven fish school model , 2014, Journal of The Royal Society Interface.

[92]  Brett Browning,et al.  Plays as Effective Multiagent Plans Enabling Opponent-Adaptive Play Selection , 2004, ICAPS.

[93]  Mauro Birattari,et al.  Analysing an Evolved Robotic Behaviour Using a Biological Model of Collegial Decision Making , 2012, SAB.

[94]  Diego Latella,et al.  On the use of Bio-PEPA for modelling and analysing collective behaviours in swarm robotics , 2013, Swarm Intelligence.

[95]  Francesco Mondada,et al.  Decentralized self-selection of swarm trajectories: from dynamical systems theory to robotic implementation , 2014, Swarm Intelligence.

[96]  F Mondada,et al.  Social Integration of Robots into Groups of Cockroaches to Control Self-Organized Choices , 2007, Science.

[97]  E.M. Atkins,et al.  A survey of consensus problems in multi-agent coordination , 2005, Proceedings of the 2005, American Control Conference, 2005..

[98]  William M. Spears,et al.  Distributed, Physics-Based Control of Swarms of Vehicles , 2004 .

[99]  Milind Tambe,et al.  The Communicative Multiagent Team Decision Problem: Analyzing Teamwork Theories and Models , 2011, J. Artif. Intell. Res..

[100]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.

[101]  A. Barabasi,et al.  Collective Motion of Self-Propelled Particles: Kinetic Phase Transition in One Dimension , 1997, cond-mat/9712154.

[102]  Marco Dorigo,et al.  Efficient Decision-Making in a Self-Organizing Robot Swarm: On the Speed Versus Accuracy Trade-Off , 2015, AAMAS.

[103]  S. Fortunato,et al.  Statistical physics of social dynamics , 2007, 0710.3256.

[104]  Andrey V. Savkin,et al.  Decentralized Navigation of Groups of Wheeled Mobile Robots With Limited Communication , 2010, IEEE Transactions on Robotics.

[105]  John Woods,et al.  Beyond swarm intelligence: the UltraSwarm , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[106]  Jan Wessnitzer,et al.  Collective Decision-Making and Behaviour Transitions in Distributed Ad Hoc Wireless Networks of Mobile Robots: Target-Hunting , 2003, ECAL.

[107]  I. Couzin,et al.  Shared decision-making drives collective movement in wild baboons , 2015, Science.

[108]  Spring Berman,et al.  Optimized Stochastic Policies for Task Allocation in Swarms of Robots , 2009, IEEE Transactions on Robotics.

[109]  Serge Kernbach,et al.  Re-embodiment of Honeybee Aggregation Behavior in an Artificial Micro-Robotic System , 2009, Adapt. Behav..

[110]  Marco Dorigo,et al.  Emergent collective decisions in a swarm of robots , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[111]  Serge Kernbach,et al.  Get in touch: cooperative decision making based on robot-to-robot collisions , 2009, Autonomous Agents and Multi-Agent Systems.

[112]  José Halloy,et al.  Collegial decision making based on social amplification leads to optimal group formation. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[113]  T. Schmickl,et al.  Trophallaxis among swarm-robots: A biologically inspired strategy for swarm robotics , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[114]  Iain D. Couzin,et al.  Collective Learning and Optimal Consensus Decisions in Social Animal Groups , 2014, PLoS Comput. Biol..

[115]  Hong Zhang,et al.  Cooperative Decision-Making in Decentralized Multiple-Robot Systems: The Best-of-N Problem , 2009, IEEE/ASME Transactions on Mechatronics.

[116]  Eliseo Ferrante,et al.  Hybrid Societies: Challenges and Perspectives in the Design of Collective Behavior in Self-organizing Systems , 2016, Front. Robot. AI.

[117]  M. Dorigo,et al.  Self-Organized Discrimination of Resources , 2011, PloS one.

[118]  P. Levi,et al.  Cognitive micro-Agents: individual and collective perception in microrobotic swarm , 2005 .

[119]  David W. Payton,et al.  Pheromone Robotics , 2001, Auton. Robots.

[120]  Matthias Scheutz,et al.  Architectural mechanisms for dynamic changes of behavior selection strategies in behavior-based systems , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[121]  Alexander Scheidler,et al.  Dynamics of Majority Rule with Differential Latencies , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[122]  Eliseo Ferrante,et al.  Swarmanoid: A Novel Concept for the Study of Heterogeneous Robotic Swarms , 2013, IEEE Robotics & Automation Magazine.

[123]  Marco Dorigo,et al.  Artificial pheromone for path selection by a foraging swarm of robots , 2010, Biological Cybernetics.

[124]  Guy Theraulaz,et al.  Alice in Pheromone Land: An Experimental Setup for the Study of Ant-like Robots , 2007, 2007 IEEE Swarm Intelligence Symposium.

[125]  M. S. Poole,et al.  Communication and Group Decision-Making , 1986 .

[126]  Guy Theraulaz,et al.  Do Ants Need to Estimate the Geometrical Properties of Trail Bifurcations to Find an Efficient Route? A Swarm Robotics Test Bed , 2013, PLoS Comput. Biol..

[127]  Angelo Cangelosi,et al.  Reynolds flocking in reality with fixed-wing robots: Communication range vs. maximum turning rate , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[128]  Marco Dorigo,et al.  A quantitative micro–macro link for collective decisions: the shortest path discovery/selection example , 2015, Swarm Intelligence.

[129]  Mauro Birattari,et al.  Property-Driven Design for Robot Swarms: A Design Method Based on Prescriptive Modeling and Model Checking , 2015, TAAS.

[130]  Christian A. Yates,et al.  Inherent noise can facilitate coherence in collective swarm motion , 2009, Proceedings of the National Academy of Sciences.

[131]  Eliseo Ferrante,et al.  Collective Decision with 100 Kilobots Speed vs Accuracy in Binary Discrimination Problems , 2015 .

[132]  Heiko Hamann Towards swarm calculus: urn models of collective decisions and universal properties of swarm performance , 2013, Swarm Intelligence.

[133]  D. Sumpter Collective Animal Behavior , 2010 .

[134]  Marco Dorigo,et al.  Evolving Aggregation Behaviors in a Swarm of Robots , 2003, ECAL.

[135]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[136]  Marco Dorigo,et al.  Self-organized collective decision making: the weighted voter model , 2014, AAMAS.

[137]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[138]  T. Vicsek,et al.  Phase transition in the collective migration of tissue cells: experiment and model. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[139]  Ali Emre Turgut,et al.  Fuzzy-Based Aggregation with a Mobile Robot Swarm , 2012, ANTS.

[140]  Joseph J. Hale,et al.  From Disorder to Order in Marching Locusts , 2006, Science.