Market-Based Multirobot Coordination: A Comprehensive Survey and Analysis

Abstract : As robotic technology improves, we charge robots with increasingly varied and difficult tasks. Many of these tasks can potentially be completed better by a team of robots working together than by individual robots working alone. Coordination can lead to faster task completion, increased robustness, higher-quality solutions, and the completion of tasks impossible for single robots. Nevertheless, effective coordination can be difficult to achieve because of a range of adverse real-world conditions including dynamic events, changing task demands, resource failures, and limited deliberation time. The desire to overcome these challenges and harness the benefits of robot teams has made multirobot coordination a vital field in robotics research. Of the resulting wealth of research, market-based multirobot coordination approaches in particular have received significant attention and are growing in popularity within the community. These approaches harness the principles of market economies?which have successfully governed human coordination for thousands of years?and use them to enable robot coordination. In market-based approaches, robots on the team act as self-interested agents operating in a virtual economy in which tasks and team resources are exchanged over the market in pursuit of individual profit. The essence of market-based approaches is that the process of robots trading tasks and resources with one another to maximize their wealth simultaneously improves the efficiency of the team. Market-based approaches to multirobot coordination inherit many of the benefits associated with market economies, including flexibility, efficiency, responsiveness, robustness scalability, and generality. In practice, they have been successfully implemented in a variety of domains ranging from mapping and exploration to robot soccer.

[1]  José M. Vidal,et al.  The effects of cooperation on multiagent search in task-oriented domains , 2002, AAMAS '02.

[2]  Anthony Stentz,et al.  Traderbots: a new paradigm for robust and efficient multirobot coordination in dynamic environments , 2004 .

[3]  Sebastian Thrun,et al.  Auction Mechanism Design for Multi-Robot Coordination , 2003, NIPS.

[4]  Nidhi Kalra,et al.  Comparative Study of Market-Based and Threshold-Based Task Allocation , 2006, DARS.

[5]  Bernard Ghanem,et al.  Improving cost estimation in market-based coordination of a distributed sensing task , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Andrew B. Williams,et al.  Multirobot task allocation in lunar mission construction scenarios , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[7]  Evangelos Markakis,et al.  Auction-Based Multi-Robot Routing , 2005, Robotics: Science and Systems.

[8]  Anthony Stentz,et al.  Market-Based Multirobot Coordination For Complex Space Applications , 2003 .

[9]  Rachid Alami,et al.  M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[10]  Tara A. Estlin,et al.  A comparison of coordinated planning methods for cooperating rovers , 1999, AGENTS '00.

[11]  Tuomas Sandholm,et al.  Algorithm for optimal winner determination in combinatorial auctions , 2002, Artif. Intell..

[12]  Anthony Stentz,et al.  Multi-robot exploration controlled by a market economy , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  Agusti Solanas,et al.  Coordinated multi-robot exploration through unsupervised clustering of unknown space , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[14]  Yang Xu,et al.  Comparing market and token-based coordination , 2006, AAMAS '06.

[15]  David J. Williams,et al.  Modelling of communications and control in an auction-based manufacturing control system , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[16]  Anthony Stentz,et al.  Market-Based Multi-Robot Planning in a Distributed Layered Architecture , 2003 .

[17]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[18]  Çetin Meriçli,et al.  Market-Driven Multi-Agent Collaboration in Robot Soccer Domain , 2005 .

[19]  Elizabeth Sklar,et al.  Exploring Auction Mechanisms for Role Assignment in Teams of Autonomous Robots , 2004, RoboCup.

[20]  Elmar G. Wolfstetter AUCTIONS: AN INTRODUCTION , 1996 .

[21]  M. Golfarelli,et al.  A Task-Swap Negotiation Protocol Based on the Contract Net Paradigm , 2000 .

[22]  Victor R. Lesser,et al.  Coalitions Among Computationally Bounded Agents , 1997, Artif. Intell..

[23]  Nidhi Kalra,et al.  Constrained Exploration for Studies in Multirobot Coordination , 2006 .

[24]  Takayuki Ito,et al.  Task Allocation in the RoboCup Rescue Simulation Domain: A Short Note , 2001, RoboCup.

[25]  E. Sklar,et al.  A team-based coevolutionary approach to multi agent learning , 2004 .

[26]  Vijay Kumar,et al.  Dynamic role assignment for cooperative robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[27]  Tuomas Sandholm Contract Types for Satisficing Task Allocation:I Theoretical Results , 2002 .

[28]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[29]  Wright-Patterson Afb,et al.  Hierarchical Control for Autonomous Teams , 2001 .

[30]  Mark Yim,et al.  Indoor automation with many mobile robots , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[31]  Weihua Sheng,et al.  Multi-robot area exploration with limited-range communications , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[32]  Anthony Stentz,et al.  Market-based Multirobot Coordination for Complex Tasks , 2006, Int. J. Robotics Res..

[33]  Michail G. Lagoudakis,et al.  The Generation of Bidding Rules for Auction-Based Robot Coordination , 2005 .

[34]  Anthony Stentz,et al.  A Free Market Architecture for Coordinating Multiple Robots , 1999 .

[35]  Dídac Busquets,et al.  Learning when to Auction and when to Bid , 2006, DARS.

[36]  Anthony Stentz,et al.  Opportunistic optimization for market-based multirobot control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Anthony Stentz,et al.  A Versatile Implementation of the TraderBots Approach for Multirobot Coordination , 2004 .

[38]  Anthony Stentz,et al.  Complex Task Allocation For Multiple Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[39]  Lovekesh Vig,et al.  Market-Based Multi-robot Coalition Formation , 2006, DARS.

[40]  Brett Browning,et al.  Dynamic Heterogeneous Robot Teams Engaged in Adversarial Tasks , 2005 .

[41]  Tuomas Sandholm,et al.  An Implementation of the Contract Net Protocol Based on Marginal Cost Calculations , 1993, AAAI.

[42]  Nidhi Kalra,et al.  Hoplites: A Market-Based Framework for Planned Tight Coordination in Multirobot Teams , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[43]  Refael Hassin,et al.  Approximation algorithms for some vehicle routing problems , 2005, Discret. Appl. Math..

[44]  Juris Vagners,et al.  Market-based Co-evolution Planning for Multiple Autonomous Vehicles , 2003 .

[45]  Zhiqiang Zheng,et al.  Combinatorial Bids based Multi-robot Task Allocation Method , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[46]  H. L. Akin,et al.  Q-Learning based Market-Driven Multi-Agent Collaboration in Robot Soccer , 2004 .

[47]  Brett Browning,et al.  Dynamically formed heterogeneous robot teams performing tightly-coordinated tasks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[48]  Sven Koenig,et al.  Greedy mapping of terrain , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[49]  Reid G. Simmons,et al.  First Results in the Coordination of Heterogeneous Robots for Large-Scale Assembly , 2000, ISER.

[50]  Tucker R. Balch,et al.  Efficient Bids on Task Allocation for Multi-Robot Exploration , 2006, FLAIRS Conference.

[51]  Michail G. Lagoudakis,et al.  Simple auctions with performance guarantees for multi-robot task allocation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[52]  Rachid Alami,et al.  A distributed tasks allocation scheme in multi-UAV context , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[53]  Luke Hunsberger,et al.  A combinatorial auction for collaborative planning , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[54]  José Guerrero,et al.  Multi-Robot Task Allocation Strategies Using Auction-Like Mechanisms , 2003 .

[55]  Wolfram Burgard,et al.  Coordination for Multi-Robot Exploration and Mapping , 2000, AAAI/IAAI.

[56]  Anthony Stentz,et al.  Robust multirobot coordination in dynamic environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[57]  Bala Kalyanasundaram,et al.  Online Weighted Matching , 1993, J. Algorithms.

[58]  Martin Andersson,et al.  Contract type sequencing for reallocative negotiation , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[59]  Sven Koenig,et al.  Robot exploration with combinatorial auctions , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[60]  Reid G. Simmons,et al.  Learning Opportunity Costs in Multi-Robot Market Based Planners , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[61]  Manuela Veloso,et al.  Multi-Robot Dynamic Role Assignment and Coordination Through Shared Potential Fields , 2002 .

[62]  Anthony Stentz,et al.  A Free Market Architecture for Distributed Control of a Multirobot System , 2000 .

[63]  Howie Choset,et al.  Distributed Coverage of Unknown/Unstructured Environments by Mobile Sensor Networks , 2005 .

[64]  A. J.,et al.  Analysis of Christofides ' heuristic : Some paths are more difficult than cycles , 2002 .

[65]  Zengqi Sun,et al.  A learning market based layered multi-robot architecture , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[66]  Nicholas R. Jennings,et al.  Learning to be Competitive in the Market , 1999, AAAI 1999.

[67]  Günther Schmidt,et al.  A decentralized approach for the conflict-free motion of multiple mobile robots , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.