Cooperative Decision-Making in Decentralized Multiple-Robot Systems: The Best-of-N Problem

Multiple-robot systems (MRS) that are decentrally organized have many benefits over centralized systems. Decentralized systems are less affected by computational and communicative bottlenecks, and they are more robust to the loss of individual member robots. System-level cognitive operations, though, are much more difficult to implement in decentralized systems. One example is the best-of-N decision-making problem, in which a team attempts to unanimously select a single alternative from a list that maximizes a given metric. This is a valuable operation, since many system-level operations can be expressed in this form. Optimal best-of-N decision-making, however, is intractable in large decentralized systems. The contribution of this paper is a biologically inspired algorithm that enables a decentralized MRS composed of very simple robots to make good, unanimous decisions. In a series of physical experiments using real robots, the best decision was made at least 80% of the time. In all, 100% of the decisions achieved perfect consensus, which prevented the MRS from becoming fragmented. The decisions are made using anonymous, local communication, with no direct comparisons of the available alternatives by the individual robots.

[1]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[2]  Luca Maria Gambardella,et al.  Collaboration Through the Exploitation of Local Interactions in Autonomous Collective Robotics: The Stick Pulling Experiment , 2001, Auton. Robots.

[3]  Bildungswesen Advanced School for Computing and Imaging , 2010 .

[4]  Nikos A. Vlassis,et al.  Multi-robot decision making using coordination graphs , 2003 .

[5]  J. Deneubourg,et al.  Colony size, communication and ant foraging strategy , 1989 .

[6]  Eamonn B. Mallon,et al.  Individual and collective decision-making during nest site selection by the ant Leptothorax albipennis , 2001, Behavioral Ecology and Sociobiology.

[7]  Erfu Yang,et al.  Nonlinear Formation-Keeping and Mooring Control of Multiple Autonomous Underwater Vehicles , 2007, IEEE/ASME Transactions on Mechatronics.

[8]  Eric Bonabeau,et al.  Cooperative transport by ants and robots , 2000, Robotics Auton. Syst..

[9]  Hong Zhang,et al.  Active versus passive expression of preference in the control of multiple-robot decision-making , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Eamonn B. Mallon,et al.  Information flow, opinion polling and collective intelligence in house-hunting social insects. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  S. Pratt Quorum sensing by encounter rates in the ant Temnothorax albipennis , 2005 .

[12]  Jean-Louis Deneubourg,et al.  From local actions to global tasks: stigmergy and collective robotics , 2000 .

[13]  Alex Fukunaga,et al.  Cooperative mobile robotics: antecedents and directions , 1995 .

[14]  Maja J. Mataric,et al.  Interference as a Tool for Designing and Evaluating Multi-Robot Controllers , 1997, AAAI/IAAI.

[15]  Hong Zhang,et al.  Collective Decision Making: A Biologically Inspired Approach to Making Up All of Your Minds , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[16]  George Michailidis,et al.  Local Vote Decision Fusion for Target Detection in Wireless Sensor Networks , 2008, IEEE Transactions on Signal Processing.

[17]  Jan Wessnitzer,et al.  Collective Decision-Making and Behaviour Transitions in Distributed Ad Hoc Wireless Networks of Mobile Robots: Target-Hunting , 2003, ECAL.

[18]  Seth Copen Goldstein,et al.  The robot is the tether: active, adaptive power routing modular robots with unary inter-robot connectors , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  T. Seeley,et al.  Group decision making in nest-site selection by honey bees , 2004 .

[20]  Hong Zhang,et al.  Consensus-based task sequencing in decentralized multiple-robot systems using local communication , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Brett Browning,et al.  Plays as Effective Multiagent Plans Enabling Opponent-Adaptive Play Selection , 2004, ICAPS.

[22]  Jelle R. Kok,et al.  Distributed decision making of robotic agents , 2003 .

[23]  Chris Melhuish,et al.  Stigmergy, Self-Organization, and Sorting in Collective Robotics , 1999, Artificial Life.

[24]  Gaurav S. Sukhatme,et al.  Collective construction with multiple robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Milind Tambe,et al.  The Communicative Multiagent Team Decision Problem: Analyzing Teamwork Theories and Models , 2011, J. Artif. Intell. Res..

[26]  Pradeep K. Khosla,et al.  Millibot trains for enhanced mobility , 2002 .

[27]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[28]  Hong Zhang,et al.  Biologically inspired decision making for collective robotic systems , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[29]  Hong Zhang,et al.  Collective Robotic Site Preparation , 2006, Adapt. Behav..

[30]  Panganamala Ramana Kumar,et al.  RHEINISCH-WESTFÄLISCHE TECHNISCHE HOCHSCHULE AACHEN , 2001 .

[31]  L. Conradt,et al.  Consensus decision making in animals. , 2005, Trends in ecology & evolution.

[32]  Steve Goddard,et al.  Localization and follow-the-leader control of a heterogeneous group of mobile robots , 2006 .