Multi-Robot Systems. From Swarms to Intelligent Automata Volume III

We address the basic problem of coordinating the actions of multiple robots that are working toward a common goal. This kind of problem is NP-hard, because in order to coordinate a system of n robots, it is in principle necessary to generate and evaluate a number of actions or plans that is exponential in n (assuming P 6= NP ). However, we suggest that many instances of coordination problems, despite the NP-hardness of the overall class of problems, do not in practice require exponential computation in order to arrive at good solutions. In such problems, it is not necessary to consider all possible actions of the n robots; instead an algorithm may restrict its attention to interactions within small teams, and still produce high-quality solutions. We use this insight in the development of a novel coordination algorithm that we call parallel stochastic hill-climbing with small teams, or Parish. This algorithm is designed specifically for use in multi-robot systems: it can run off-line or on-line, is easily distributed across multiple machines, and is efficient with regard to communication. We state and analyze the Parish algorithm present results from the implementation and application of the algorithm for a concrete problem: multi-robot pursuit-evasion. In this demanding domain, a team of robots must coordinate their actions so as to guarantee location of a skilled evader.

[1]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[2]  Eiichi Yoshida,et al.  Cooperative sweeping by multiple mobile robots , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[3]  Steven Vajda,et al.  The Theory of Linear Economic Models , 1960 .

[4]  Victor R. Lesser,et al.  Multi-agent policies: from centralized ones to decentralized ones , 2002, AAMAS '02.

[5]  Vijay Kumar,et al.  A Framework and Architecture for Multi-Robot Coordination , 2000, ISER.

[6]  Tucker R. Balch,et al.  Communication in reactive multiagent robotic systems , 1995, Auton. Robots.

[7]  Andrew Richard Conway,et al.  Autonomous control of an unstable model helicopter using carrier phase gps only , 1995 .

[8]  Maja J. Mataric,et al.  Broadcast of Local Elibility for Multi-Target Observation , 2000, DARS.

[9]  Terrence Fong,et al.  Robot, asker of questions , 2003, Robotics Auton. Syst..

[10]  T. D. Parsons,et al.  Pursuit-evasion in a graph , 1978 .

[11]  Edmund H. Durfee,et al.  Congregation Formation in Multiagent Systems , 2003, Autonomous Agents and Multi-Agent Systems.

[12]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[13]  Micah Adler,et al.  Randomized Pursuit-Evasion In Graphs , 2003, Comb. Probab. Comput..

[14]  Gaurav S. Sukhatme,et al.  Coverage, Exploration and Deployment by a Mobile Robot and Communication Network , 2004, Telecommun. Syst..

[15]  Leonidas J. Guibas,et al.  A Visibility-Based Pursuit-Evasion Problem , 1999, Int. J. Comput. Geom. Appl..

[16]  Wolfram Burgard,et al.  A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[17]  Dan R. Olsen,et al.  Metrics for human driving of multiple robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[18]  F. Y. Edgeworth Mathematical Psychics: An Essay on the Application of Mathematics to the Moral Sciences , 2007 .

[19]  R. Murray,et al.  Consensus protocols for networks of dynamic agents , 2003, Proceedings of the 2003 American Control Conference, 2003..

[20]  Maria L. Gini,et al.  Scan Matching Without Odometry Information , 2004, ICINCO.

[21]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[22]  Manuela M. Veloso,et al.  Real-Time Randomized Path Planning for Robot Navigation , 2002, RoboCup.

[23]  Kyung-Yong Chwa,et al.  Simple algorithms for searching a polygon with flashlights , 2002, Inf. Process. Lett..

[24]  Lynne E. Parker,et al.  Cooperative Robotics for Multi-Target Observation , 1999, Intell. Autom. Soft Comput..

[25]  Gaurav S. Sukhatme,et al.  Putting the 'I' in 'team': an ego-centric approach to cooperative localization , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[26]  Victor R. Lesser,et al.  Coalitions Among Computationally Bounded Agents , 1997, Artif. Intell..

[27]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[28]  Pedro U. Lima,et al.  Multi-Robot Systems , 2005, Innovations in Robot Mobility and Control.

[29]  Hong Zhang,et al.  Collective Robotics: From Social Insects to Robots , 1993, Adapt. Behav..

[30]  Gaurav S. Sukhatme,et al.  Mobile robot navigation using a sensor network , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[31]  Aloysius K. Mok,et al.  Multiprocessor On-Line Scheduling of Hard-Real-Time Tasks , 1989, IEEE Trans. Software Eng..

[32]  Lynne E. Parker,et al.  ASyMTRe: Automated Synthesis of Multi-Robot Task Solutions through Software Reconfiguration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[33]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[34]  Bruno Sinopoli,et al.  Vision based navigation for an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[35]  Sampath Kannan,et al.  Locating and Capturing an Evader in a Polygonal Environment , 2004, WAFR.

[36]  Anthony Stentz,et al.  Opportunistic optimization for market-based multirobot control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Sven Koenig,et al.  Complexity Analysis of Real-Time Reinforcement Learning , 1992, AAAI.

[38]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[39]  Jindong Tan,et al.  Peer-to-peer model for the area coverage and cooperative control of mobile sensor networks , 2004, SPIE Defense + Commercial Sensing.

[40]  William M. Spears,et al.  Using artificial physics to control agents , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[41]  Sebastian Thrun,et al.  Monte Carlo POMDPs , 1999, NIPS.

[42]  Vijay Kumar,et al.  Cooperative localization and control for multi-robot manipulation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[43]  Keith B. Ward,et al.  Chemical Plume Tracing , 2002 .

[44]  Héctor H. González-Baños,et al.  Navigation Strategies for Exploring Indoor Environments , 2002, Int. J. Robotics Res..

[45]  Wolfram Burgard,et al.  Coordination for Multi-Robot Exploration and Mapping , 2000, AAAI/IAAI.

[46]  Michail G. Lagoudakis,et al.  Simple auctions with performance guarantees for multi-robot task allocation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[47]  Brett Browning,et al.  Multi-robot team response to a multi-robot opponent team , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[48]  Manuela M. Veloso,et al.  CM-Pack'01: Fast Legged Robot Walking, Robust Localization, and Team Behaviors , 2001, RoboCup.

[49]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[50]  Dan R. Olsen,et al.  Fan-out: measuring human control of multiple robots , 2004, CHI.

[51]  Anthony Stentz,et al.  A Market Approach to Multirobot Coordination , 2001 .

[52]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[53]  A. Kramer,et al.  Changes in executive control across the life span: examination of task-switching performance. , 2001, Developmental psychology.

[54]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[55]  Camillo J. Taylor,et al.  A vision-based formation control framework , 2002, IEEE Trans. Robotics Autom..

[56]  R. L. Thorndike The problem of classification of personnel , 1950, Psychometrika.

[57]  Frank Dellaert,et al.  An MCMC-Based Particle Filter for Tracking Multiple Interacting Targets , 2004, ECCV.

[58]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[59]  Randal W. Beard,et al.  A coordination architecture for spacecraft formation control , 2001, IEEE Trans. Control. Syst. Technol..

[60]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[61]  Hiroaki Kitano,et al.  RoboCup: The Robot World Cup Initiative , 1997, AGENTS '97.

[62]  M. Endsley The role of situation awareness in naturalistic decision making , 1997 .

[63]  Bruce Randall Donald,et al.  Towards a Theory of Information Invariants for Cooperating Autonomous Mobile Robots , 1993 .

[64]  Sven Koenig,et al.  Robot exploration with combinatorial auctions , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[65]  Shlomo Zilberstein,et al.  Dynamic Programming for Partially Observable Stochastic Games , 2004, AAAI.

[66]  Manuela M. Veloso,et al.  Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork , 1999, Artif. Intell..

[67]  Maja J. Mataric,et al.  Robot formations using only local sensing and control , 2001, Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515).

[68]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[69]  Anthony Stentz,et al.  Enhanced Negotiation and Opportunistic Optimization for Market-Based Multirobot Coordination , 2002 .

[70]  Maja J. Mataric,et al.  Designing and Understanding Adaptive Group Behavior , 1995, Adapt. Behav..

[71]  Christian Lebiere,et al.  Intention superiority effect: A context-switching account , 2002, Cognitive Systems Research.

[72]  A. Chella,et al.  Metaphor of Politics: A Mechanism of Coalition Formation , 2004 .

[73]  Maja J. Mataric,et al.  Sold!: auction methods for multirobot coordination , 2002, IEEE Trans. Robotics Autom..

[74]  Martial Hebert,et al.  Distributed robotic mapping of extreme environments , 2001, SPIE Optics East.

[75]  Makoto Yokoo,et al.  Taming Decentralized POMDPs: Towards Efficient Policy Computation for Multiagent Settings , 2003, IJCAI.

[76]  Dan R. Olsen,et al.  Metrics for Evaluating Human-Robot Interactions , 2003 .

[77]  Howie Choset,et al.  Limited communication, multi-robot team based coverage , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[78]  Robin Cohen,et al.  A User Modeling Approach to Determining System Initiative in Mixed-Initiative AI Systems , 2001, User Modeling.

[79]  George A. Bekey,et al.  Learning helicopter control through "teaching by showing" , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[80]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1986 .

[81]  Li Zhang,et al.  Line segment based map building and localization using 2D laser rangefinder , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[82]  Mireille E. Broucke,et al.  Local control strategies for groups of mobile autonomous agents , 2004, IEEE Transactions on Automatic Control.

[83]  Peter Stone,et al.  Anticipation as a key for collaboration in a team of agents: a case study in robotic soccer , 1999, Optics East.

[84]  John J. Leonard,et al.  Cooperative concurrent mapping and localization , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[85]  Anthony Stentz,et al.  A Free Market Architecture for Distributed Control of a Multirobot System , 2000 .

[86]  Tamio Arai,et al.  Distributed Autonomous Robotic Systems 3 , 1998 .

[87]  Vijay Kumar,et al.  Hierarchical Hybrid Modeling of Embedded Systems , 2001, EMSOFT.

[88]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[89]  Maja J. Mataric,et al.  Broadcast of local eligibility: behavior-based control for strongly cooperative robot teams , 2000, International Conference on Autonomous Agents.

[90]  Yaakov Bar-Shalom,et al.  Sonar tracking of multiple targets using joint probabilistic data association , 1983 .

[91]  Chaomin Luo,et al.  A real-time cooperative sweeping strategy for multiple cleaning robots , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[92]  I. Koch The role of external cues for endogenous advance reconfiguration in task switching , 2003, Psychonomic bulletin & review.

[93]  C. Ronald Kube,et al.  Task Modelling in Collective Robotics , 1997, Auton. Robots.

[94]  Sarit Kraus,et al.  Methods for Task Allocation via Agent Coalition Formation , 1998, Artif. Intell..

[95]  Gaurav S. Sukhatme,et al.  Call and response: experiments in sampling the environment , 2004, SenSys '04.

[96]  Bernhard Nebel,et al.  CS Freiburg: Doing the Right Thing in a Group , 2000, RoboCup.

[97]  Richard T. Vaughan,et al.  The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[98]  Anthony Stentz,et al.  TraderBots : a market-based approach for resource, role, and task allocation in multirobot coordination , 2003 .

[99]  J. A. McGeoch The psychology of human learning , 1942 .

[100]  Donald D. Dudenhoeffer,et al.  A Robotic Swarm for Spill Finding and Perimeter Formation , 2002 .

[101]  Luc Moreau,et al.  Leaderless coordination via bidirectional and unidirectional time-dependent communication , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[102]  Rodney M. Goodman,et al.  Distributed odor source localization , 2002 .

[103]  Giulio Sandini,et al.  Gradient driven self-organizing systems , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[104]  Lynne E. Parker,et al.  Tightly-coupled navigation assistance in heterogeneous multi-robot teams , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[105]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1997, J. Intell. Robotic Syst..

[106]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[107]  Katia P. Sycara,et al.  Distributed Intelligent Agents , 1996, IEEE Expert.

[108]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[109]  Milind Tambe,et al.  Towards Adjustable Autonomy for the Real World , 2002, J. Artif. Intell. Res..

[110]  Gaurav S. Sukhatme,et al.  Using a sensor network for distributed multi-robot task allocation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[111]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[112]  Ewald von Puttkamer,et al.  Keeping track of position and orientation of moving indoor systems by correlation of range-finder scans , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[113]  Masafumi Yamashita,et al.  Searching for a Mobile Intruder in a Polygonal Region , 1992, SIAM J. Comput..

[114]  Ralph L. Hollis,et al.  Distributed coverage of rectilinear environments , 2000 .

[115]  Tucker R. Balch,et al.  Value-based action selection for observation with robot teams using probabilistic techniques , 2005, Robotics Auton. Syst..

[116]  Donald Reid An algorithm for tracking multiple targets , 1978 .

[117]  Lynne E. Parker Cooperative motion control for multi-target observation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[118]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[119]  Lynne E. Parker,et al.  Multi-Robot Systems: From Swarms to Intelligent Automata , 2002, Springer Netherlands.

[120]  Dimitri P. Bertsekas,et al.  The Auction Algorithm for Assignment and Other Network Flow Problems: A Tutorial , 1990 .

[121]  Anthony Stentz,et al.  Market-Based Multi-Robot Planning in a Distributed Layered Architecture , 2003 .

[122]  Gaurav S. Sukhatme,et al.  Most valuable player: a robot device server for distributed control , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[123]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[124]  Vijay Kumar,et al.  Dynamic role assignment for cooperative robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[125]  Maja J. Mataric,et al.  Multi-robot task allocation: analyzing the complexity and optimality of key architectures , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[126]  Sebastian Thrun,et al.  Visibility-based Pursuit-evasion with Limited Field of View , 2004, Int. J. Robotics Res..

[127]  Manuela M. Veloso,et al.  A real-time world model for multi-robot teams with high-latency communication , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[128]  Trey Smith,et al.  A Layered Architecture for Coordination of Mobile Robots , 2002 .

[129]  William D. Smart,et al.  Localizing while mapping: a segment approach , 2002, AAAI/IAAI.

[130]  Hong Zhang,et al.  Blind bulldozing: multiple robot nest construction , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[131]  Gaurav S. Sukhatme,et al.  Spreading Out: A Local Approach to Multi-robot Coverage , 2002, DARS.

[132]  Leslie Pack Kaelbling,et al.  Learning Policies for Partially Observable Environments: Scaling Up , 1997, ICML.

[133]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[134]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[135]  Sarit Kraus,et al.  A Kernel-Oriented Model for Coalition-Formation in General Environments: Implementation and Results , 1996, AAAI/IAAI, Vol. 1.

[136]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[137]  David Kortenkamp,et al.  Three tier architecture for controlling space life support systems , 1998, Proceedings. IEEE International Joint Symposia on Intelligence and Systems (Cat. No.98EX174).

[138]  Rachid Alami,et al.  M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[139]  Kurt Konolige,et al.  A practical, decision-theoretic approach to multi-robot mapping and exploration , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[140]  Tucker R. Balch,et al.  Communication of behavorial state in multi-agent retrieval tasks , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[141]  Kee-Eung Kim,et al.  Learning to Cooperate via Policy Search , 2000, UAI.

[142]  Rodney M. Goodman,et al.  Swarm robotic odor localization , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[143]  Douglas B. Moran,et al.  The Open Agent Architecture: A Framework for Building Distributed Software Systems , 1999, Appl. Artif. Intell..

[144]  Maja J. Matarić,et al.  A Framework for Studying Multi-Robot Task Allocation , 2003 .