Traderbots: a new paradigm for robust and efficient multirobot coordination in dynamic environments

The challenge of efficient multirobot coordination has risen to the forefront of robotics research in recent years. The wide range of applications demanding multirobot solutions motivates interest in this problem. In general, multirobot coordination strategies assume either a centralized approach, where a single agent plans for the group, or a distributed approach, where each robot is responsible for its own planning. Inherent to many centralized approaches are difficulties such as intractable solutions for large groups, sluggish response to changes in the local environment, heavy communication requirements, and brittle systems with single points of failure. The key advantage of centralized approaches is that they can produce globally optimal plans. While most distributed approaches can overcome these difficulties, they can only produce suboptimal plans because they cannot take full advantage of information available to all team members. This work develops TraderBots, a market-based coordination approach that is inherently distributed, but can also opportunistically form centralized subgroups to improve efficiency. Robots are self-interested with the primary goal of maximizing individual profits. The revenue and cost models and the rules of engagement are designed so that maximizing individual profit has the benevolent effect of, on average, moving the team toward the globally optimal solution. This approach inherits the flexibility of markets in allowing cooperation and competition to emerge opportunistically. This dissertation addresses the multirobot coordination problem for autonomous robotic teams executing tasks in dynamic environments where it is efficient solutions are desirable. Contributions of this dissertation are the first extensive investigation of the application of market-based techniques to multirobot coordination, the most versatile coordination-approach for dynamic multirobot application domains, the first market-based approach to multirobot coordination that allows opportunistic optimization by “leaders”, the first in-depth investigation of the requirements for robust multirobot coordination in dynamic environments, the most extensive implementation of a market-based approach to multirobot coordination, and first steps in a systematic approach for evaluating and comparing multirobot coordination strategies.

[1]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[2]  Nicholas R. Jennings,et al.  Reasoning about commitments and penalties for coordination between autonomous agents , 2001, AGENTS '01.

[3]  Edmund H. Durfee,et al.  Deciding When to Commit to Action During Observation-Based Coordination , 1995, ICMAS.

[4]  Enrico Pagello,et al.  Cooperative behaviors in multi-robot systems through implicit communication , 1999, Robotics Auton. Syst..

[5]  Arthur C. Graesser,et al.  Agent behaviors in virtual negotiation environments , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[6]  Anthony Stentz,et al.  Market-Based Multirobot Coordination Using Task Abstraction , 2003, FSR.

[7]  李幼升,et al.  Ph , 1989 .

[8]  Manuela M. Veloso,et al.  Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork , 1999, Artif. Intell..

[9]  Lynne E. Parker Designing control laws for cooperative agent teams , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[10]  Tuomas Sandholm,et al.  Auctions with untrustworthy bidders , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[11]  Victor R. Lesser,et al.  Designing a Family of Coordination Algorithms , 1997, ICMAS.

[12]  Anthony Stentz,et al.  A comparative study between centralized, market-based, and behavioral multirobot coordination approaches , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[13]  Tim Lüth,et al.  A distributed control architecture for autonomous mobile robots - implementation of the Karlsruhe Multi-Agent Robot Architecture (KAMARA) , 1997, Adv. Robotics.

[14]  Anthony Stentz,et al.  Robust multirobot coordination in dynamic environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[15]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[16]  Milind Tambe,et al.  Argumentation as distributed constraint satisfaction: applications and results , 2001, AGENTS '01.

[17]  Maja J. Mataric,et al.  Multi-robot task allocation: analyzing the complexity and optimality of key architectures , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[18]  Anthony Stentz,et al.  MULTIROBOT CONTROL USING TASK ABSTRACTION IN A MARKET FRAMEWORK , 2022 .

[19]  Maja J. Matarić,et al.  Sold!: Market methods for multi-robot control , 2001 .

[20]  Åke Arvidsson,et al.  Co-operating Market/Ant Based Multi-agent Systems for Intelligent Network Load Control , 1999, IATA.

[21]  Manuela M. Veloso,et al.  A real-time world model for multi-robot teams with high-latency communication , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[22]  Trey Smith,et al.  A Layered Architecture for Coordination of Mobile Robots , 2002 .

[23]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[24]  Nidhi Kalra,et al.  A MARKET APPROACH TO TIGHTLY-COUPLED MULTI-ROBOT COORDINATION: FIRST RESULTS , 2003 .

[25]  Anthony Stentz,et al.  TraderBots : a market-based approach for resource, role, and task allocation in multirobot coordination , 2003 .

[26]  Mark H. Overmars,et al.  Coordinated path planning for multiple robots , 1998, Robotics Auton. Syst..

[27]  Nicholas R. Jennings,et al.  Social Influence and the Generation of Joint Mental Attitudes in Multi-agent Systems , 2001 .

[28]  Lynne E. Parker,et al.  Multi-Robot Systems: From Swarms to Intelligent Automata , 2002, Springer Netherlands.

[29]  Stephen F. Smith,et al.  A Distributed Layered Architecture for Mobile Robot Coordination: Application to Space Exploration , 2002 .

[30]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[31]  Geoffrey J. Gordon,et al.  Distributed Planning in Hierarchical Factored MDPs , 2002, UAI.

[32]  Maria L. Gini,et al.  A market architecture for multi-agent contracting , 1998, AGENTS '98.

[33]  John M. Dolan,et al.  Modified reactive control framework for cooperative mobile robots , 1997, Other Conferences.

[34]  Rachid Alami,et al.  M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[35]  Alexei Makarenko,et al.  Information-theoretic coordinated control of multiple sensor platforms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[36]  Tara A. Estlin,et al.  A comparison of coordinated planning methods for cooperating rovers , 1999, AGENTS '00.

[37]  Samir Khuller,et al.  On-Line Algorithms for Weighted Bipartite Matching and Stable Marriages , 1991, Theor. Comput. Sci..

[38]  Wolfram Burgard,et al.  Optimizing schedules for prioritized path planning of multi-robot systems , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[39]  Tuomas Sandholm,et al.  An Implementation of the Contract Net Protocol Based on Marginal Cost Calculations , 1993, AAAI.

[40]  Tucker R. Balch,et al.  AuRA: principles and practice in review , 1997, J. Exp. Theor. Artif. Intell..

[41]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[42]  Nicholas R. Jennings,et al.  Controlling Cooperative Problem Solving in Industrial Multi-Agent Systems Using Joint Intentions , 1995, Artif. Intell..

[43]  Jeffrey S. Rosenschein,et al.  Coalition, Cryptography, and Stability: Mechanisms for Coalition Formation in Task Oriented Domains , 2018, AAAI.

[44]  Wilfried Brauer,et al.  Task Assignment in Multiagent Systems Based on Vickrey-Type Auctioning and Leveled Commitment Contracting , 2000, CIA.

[45]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[46]  Maja J. Matarić,et al.  A market-based formulation of sensor-actuator network coordination , 2002, AAAI 2002.

[47]  Martial Hebert,et al.  Distributed robotic mapping of extreme environments , 2001, SPIE Optics East.

[48]  Vijay Kumar,et al.  A Framework and Architecture for Multirobot Coordination , 2000, International Symposium on Experimental Robotics.

[49]  Rachid Alami,et al.  Multi-robot cooperation through the common use of "mechanisms" , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[50]  Anthony Stentz,et al.  A Free Market Architecture for Coordinating Multiple Robots , 1999 .

[51]  Allen R. Hanson,et al.  Maximum-weight bipartite matching technique and its application in image feature matching , 1996, Other Conferences.

[52]  Abhimanyu Das,et al.  Adaptive Agent Integration Architectures for Heterogeneous Team Members , 2000, ICMAS.

[53]  Subhash Suri,et al.  Improved Algorithms for Optimal Winner Determination in Combinatorial Auctions and Generalizations , 2000, AAAI/IAAI.

[54]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[55]  Tuomas Sandholm,et al.  Algorithms for Optimizing Leveled Commitment Contracts , 1999, IJCAI.

[56]  Katia P. Sycara,et al.  Coordination of Multiple Intelligent Software Agents , 1996, Int. J. Cooperative Inf. Syst..

[57]  Sarit Kraus,et al.  Task Allocation Via Coalition Formation Among Autonomous Agents , 1995, IJCAI.

[58]  Onn Shehory,et al.  Coalition structure generation with worst case guarantees , 2022 .

[59]  Barry Brumitt,et al.  Dynamic mission planning for multiple mobile robots , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[60]  Maja J. Mataric,et al.  New Directions: Robotics: Coordination and Learning in Multirobot Systems , 1998, IEEE Intell. Syst..

[61]  Chris Kirkwood-Watts,et al.  Distributed Mobile Robotics by the Method of Dynamic Teams , 1998, DARS.

[62]  Anthony Stentz,et al.  Market-based Multirobot Coordination for Complex Tasks , 2006, Int. J. Robotics Res..

[63]  Manuela M. Veloso,et al.  Communication in Domains with Unreliable, Single-Channel, Low-Bandwidth Communication , 1998, CRW.

[64]  Maja J. Matarić,et al.  On multi-robot task allocation , 2003 .

[65]  Cristiano Castelfranchi,et al.  Limits of economic and strategic rationality for agents and MA systems , 1998, Robotics Auton. Syst..

[66]  M. Matari Coordination and Learning in Multi-Robot Systems , 1998 .

[67]  Victor R. Lesser,et al.  Coalition Formation among Bounded Rational Agents , 1995, IJCAI.

[68]  Stephen F. Smith,et al.  Wasp nests for self-configurable factories , 2001, AGENTS '01.

[69]  A. Farinelli,et al.  Coordination in dynamic environments with constraints on resources , .

[70]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[71]  Anthony Stentz,et al.  Opportunistic optimization for market-based multirobot control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[72]  Anthony Stentz,et al.  A Versatile Implementation of the TraderBots Approach for Multirobot Coordination , 2004 .

[73]  François Michaud,et al.  Sharing charging stations for long-term activity of autonomous robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[74]  Anthony Stentz,et al.  A Market Approach to Multirobot Coordination , 2001 .

[75]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[76]  M. Golfarelli,et al.  A Task-Swap Negotiation Protocol Based on the Contract Net Paradigm , 2000 .

[77]  Tucker Balch,et al.  Collaborative execution of exploration and tracking using move value estimation for robot teams (mvert) , 2003 .

[78]  Maja J. Matarić,et al.  Robust Behavior-Based Control for Distributed Multi-Robot Collection Tasks , 2000 .

[79]  Tucker R. Balch,et al.  Protocols for collaboration, coordination and dynamic role assignment in a robot team , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[80]  Julio Rosenblatt,et al.  DAMN: a distributed architecture for mobile navigation , 1997, J. Exp. Theor. Artif. Intell..

[81]  Victor R. Lesser,et al.  Advantages of a Leveled Commitment Contracting Protocol , 1996, AAAI/IAAI, Vol. 1.

[82]  Maja J. Mataric,et al.  Issues and approaches in the design of collective autonomous agents , 1995, Robotics Auton. Syst..

[83]  David P. Miller,et al.  Experiences with an architecture for intelligent, reactive agents , 1995, J. Exp. Theor. Artif. Intell..

[84]  Peter Stone,et al.  Anticipation as a key for collaboration in a team of agents: a case study in robotic soccer , 1999, Optics East.

[85]  Anthony Stentz,et al.  A Free Market Architecture for Distributed Control of a Multirobot System , 2000 .

[86]  Wei-Min Shen,et al.  Are multiagent algorithms relevant for real hardware?: a case study of distributed constraint algorithms , 2003, SAC '03.

[87]  Vijay Kumar,et al.  An architecture for tightly coupled multi-robot cooperation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[88]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[89]  Bala Kalyanasundaram,et al.  Not All Insertion Methods Yield Constant Approximate Tours in the Euclidean Plane , 1994, Theor. Comput. Sci..

[90]  Mark Yim,et al.  Indoor automation with many mobile robots , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[91]  Michael P. Wellman Market-aware agents for a multiagent world , 1997, Robotics Auton. Syst..

[92]  Ronald L. Rivest,et al.  Introduction to Algorithms, Second Edition , 2001 .

[93]  Fabrice R. Noreils,et al.  Toward a Robot Architecture Integrating Cooperation between Mobile Robots: Application to Indoor Environment , 1993, Int. J. Robotics Res..

[94]  Tuomas Sandholm,et al.  Contracting With Uncertain Level Of Trust , 2002, Comput. Intell..

[95]  Jay Gowdy SAUSAGES: Between Planning and Action , 1997 .

[96]  Manuela M. Veloso,et al.  OBDD-based Universal Planning: Specifying and Solving Planning Problems for Synchronized Agents in Non-deterministic Domains , 1999, Artificial Intelligence Today.

[97]  Milind Tambe,et al.  Tracking Dynamic Team Activity , 1996, AAAI/IAAI, Vol. 1.

[98]  Anthony Stentz,et al.  The Focussed D* Algorithm for Real-Time Replanning , 1995, IJCAI.

[99]  Tuomas Sandholm Advantages of a Leveled Commitment Contracting , 1996 .

[100]  Maja J. Mataric,et al.  Territorial multi-robot task division , 1998, IEEE Trans. Robotics Autom..

[101]  Gerhard Weiss,et al.  Achieving Coordination through Combining Joint Planning and Joint Learning , 2000, ECAI.

[102]  Robert P. Goldman,et al.  Coordinated deployment of multiple, heterogeneous robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[103]  Rachid Alami,et al.  A multi-robot cooperative task achievement system , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[104]  Claudia V. Goldman,et al.  Emergent Coordination through the Use of Cooperative State-Changing Rules , 1994, AAAI.

[105]  Carles Sierra,et al.  Evolutionary Computing and Negotiating Agents , 1998, AMET.

[106]  Stefano Rizzi,et al.  Unsupervised Multi-Agent Exploration of Structured Environments , 1995, ICMAS.

[107]  Manuela Veloso,et al.  A World Model for Multi-Robot Teams with Communication , 2002 .

[108]  Kagan Tumer,et al.  Learning sequences of actions in collectives of autonomous agents , 2002, AAMAS '02.

[109]  Tuomas Sandholm,et al.  Contracting With Uncertain Level Of Trust , 1999, EC '99.

[110]  Eiichi Osawa,et al.  A Metalevel Coordination Strategy for Reactive Cooperative Planning , 1995, ICMAS.

[111]  Anthony Stentz,et al.  Multi-robot exploration controlled by a market economy , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[112]  Bruce Randall Donald,et al.  Distributed Robotic Manipulation: Experiments in Minimalism , 1995, ISER.

[113]  Milind Tambe,et al.  Robust Agent Teams via Socially-Attentive Monitoring , 2000, J. Artif. Intell. Res..

[114]  Alois Knoll,et al.  Carrying heavy objects by multiple manipulators with self-adapting force control , 2000 .

[115]  M. Marchesi,et al.  Scaling and criticality in a stochastic multi-agent model of a financial market , 1999, Nature.

[116]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[117]  Ronald C. Arkin,et al.  Cooperation without communication: Multiagent schema-based robot navigation , 1992, J. Field Robotics.

[118]  Pradeep K. Khosla,et al.  An analysis of cooperative repair capabilities in a team of robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[119]  Sebastian Thrun,et al.  Auction Mechanism Design for Multi-Robot Coordination , 2003, NIPS.

[120]  Pattie Maes,et al.  A Study of Territoriality: The Role of Critical Mass in Adaptive Task Division , 1996 .

[121]  Vijay Kumar,et al.  Controlling formations of multiple mobile robots , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[122]  Stephen F. Smith,et al.  Insect Societies and Manufacturing , 2001, IJCAI 2001.

[123]  D. Gale,et al.  Multi-Item Auctions , 1986, Journal of Political Economy.

[124]  Wolfram Burgard,et al.  Collaborative multi-robot exploration , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[125]  Nicholas R. Jennings,et al.  Market-Based Call Routing in Telecommunications Networks Using Adaptive Pricing and Real Bidding , 1999, IATA.

[126]  Bruce Randall Donald,et al.  Moving furniture with teams of autonomous robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[127]  Victor R. Lesser,et al.  Issues in Automated Negotiation and Electronic Commerce: Extending the Contract Net Framework , 1997, ICMAS.

[128]  Martin Andersson,et al.  Sequencing of Contract Types for Anytime Task Reallocation , 1998, AMET.

[129]  Vijay Kumar,et al.  A Framework and Architecture for Multi-Robot Coordination , 2000, ISER.

[130]  Tucker R. Balch,et al.  Communication in reactive multiagent robotic systems , 1995, Auton. Robots.

[131]  Anthony Stentz,et al.  The D* Algorithm for Real-Time Planning of Optimal Traverses , 1994 .

[132]  Reid G. Simmons,et al.  First Results in the Coordination of Heterogeneous Robots for Large-Scale Assembly , 2000, ISER.