A market-based framework for tightly-coupled planned coordination in multirobot teams

This dissertation explores the challenges of one of the most difficult classes of real-world tasks for multirobot teams: those that require long-term planning of tightly-coordinated actions between teammates. These tasks involve solving a distributed multi-agent planning problem in which the actions of robots are tightly coupled. Moreover, because of uncertainty in the environment and the team, robots must frequently replan and closely coordinate with each other throughout execution. We have developed a coordination framework called Hoplites in response to the need for effective approaches to these problems. Although planning for tightly-coupled multirobot systems is a difficult problem, Hoplites solves this problem efficiently by using distributed decision-making whenever possible and centralized planning as required. Hoplites is a market-based system that consists of passive coordination and active coordination mechanisms which are tailored to easier and harder problem scenarios, respectively. Passive coordination is light on computation and communication and allows teammates to iteratively respond to each other's actions without directly influencing them. When passive coordination traps robots in local minima, active coordination improves solutions by enabling robots to influence each other directly by buying each other's participation in complex plans over the market. Because Hoplites selectively injects pockets of complex coordination into the system, it provides these improvements while remaining computationally competitive with other distributed approaches. Moreover, this selective complexity allows Hoplites to outperform centralized approaches as well because it can often exploit planners with performance guarantees which a centralized approach cannot. Additionally, Hoplites is widely applicable to real-world problems because it is general, computationally feasible, scalable, operates under uncertainty, and improves solutions with new information. This dissertation makes a number of contributions to the literature. First, it develops Hoplites, a general and adaptive approach to these complex problems. Second, it formalizes the problem space which, in turn, enables us to describe and share solutions between domains that may have previously appeared disparate. Third, it is the first application of market-based approaches to tight coordination. Fourth, it presents the first evaluation of and recommendations for planning algorithms for tight coordination. Lastly, it improves the previous state-of-the-art coordination framework for these problems.

[1]  Kazuhito Yokoi,et al.  Force Strategies for Cooperative Tasks in Multiple Mobile Manipulation Systems , 1996 .

[2]  Jeff G. Schneider,et al.  Game Theoretic Control for Robot Teams , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[3]  Shane Farritor,et al.  Distributed control for a modular, reconfigurable cliff robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  Eric Feron,et al.  Multivehicle path planning for nonline‐of‐sight communication , 2006, J. Field Robotics.

[5]  Ronald C. Arkin,et al.  Multi-robot communication-sensitive reconnaissance , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[6]  T. D. Parsons,et al.  Pursuit-evasion in a graph , 1978 .

[7]  Steven M. LaValle,et al.  Pursuit-evasion in an unknown environment using gap navigation trees , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[8]  Matthew Powers,et al.  Value-Based Communication Preservation for Mobile Robots , 2004, DARS.

[9]  Anthony Stentz,et al.  Opportunistic optimization for market-based multirobot control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  D. T. Lee,et al.  Two-Guard Walkability of Simple Polygons , 1998, Int. J. Comput. Geom. Appl..

[11]  Vijay Kumar,et al.  An architecture for tightly coupled multi-robot cooperation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  Chinh Nguyen,et al.  Development and testing for physical security robots , 2005, SPIE Defense + Commercial Sensing.

[13]  Thierry Siméon,et al.  Multiple Path Coordination for Mobile Robots: A Geometric Algorithm , 1999, IJCAI.

[14]  Anthony Stentz,et al.  A Versatile Implementation of the TraderBots Approach for Multirobot Coordination , 2004 .

[15]  Anthony Stentz,et al.  Multi-robot exploration controlled by a market economy , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[16]  Wolfram Burgard,et al.  Optimizing schedules for prioritized path planning of multi-robot systems , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[17]  J. Beardwood,et al.  The shortest path through many points , 1959, Mathematical Proceedings of the Cambridge Philosophical Society.

[18]  Maja J. Matarić,et al.  Behavior-Based Robotics , 1999 .

[19]  Manuela Veloso,et al.  What to Communicate? Execution-Time Decision in Multi-agent POMDPs , 2006, DARS.

[20]  Leonidas J. Guibas,et al.  Visibility-Based Pursuit-Evasion in a Polygonal Environment , 1997, WADS.

[21]  Masafumi Yamashita,et al.  Searching for a Mobile Intruder in a Polygonal Region , 1992, SIAM J. Comput..

[22]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[23]  Michail G. Lagoudakis,et al.  Simple auctions with performance guarantees for multi-robot task allocation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[24]  Brett Browning,et al.  Plays as Effective Multiagent Plans Enabling Opponent-Adaptive Play Selection , 2004, ICAPS.

[25]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[26]  Rachid Alami,et al.  A distributed tasks allocation scheme in multi-UAV context , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[27]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[28]  C. Malcolm,et al.  Distributed multirobot exploration maintaining a mobile network , 2004, 2004 2nd International IEEE Conference on 'Intelligent Systems'. Proceedings (IEEE Cat. No.04EX791).

[29]  Nidhi Kalra,et al.  Replanning with RRTs , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[30]  Sven Koenig,et al.  Robot exploration with combinatorial auctions , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[31]  Yehuda Elmaliach,et al.  Single Operator, Multiple Robots: Call-Request Handling in Tight-Coordination Tasks , 2006, DARS.

[32]  Nidhi Kalra,et al.  Constrained Exploration for Studies in Multirobot Coordination , 2006 .

[33]  Rachid Alami,et al.  A multi-robot cooperative task achievement system , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[34]  Reid G. Simmons,et al.  First Results in the Coordination of Heterogeneous Robots for Large-Scale Assembly , 2000, ISER.

[35]  M. J. van Kreveld,et al.  Variations on sweep algorithms: efficient computation of extended viewsheds and class intervals , 1996 .

[36]  M. Golfarelli,et al.  A Task-Swap Negotiation Protocol Based on the Contract Net Paradigm , 2000 .

[37]  Tucker Balch,et al.  Collaborative execution of exploration and tracking using move value estimation for robot teams (mvert) , 2003 .

[38]  J. Ota,et al.  Transferring and regrasping a large object by cooperation of multiple mobile robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[39]  Russell G. Brown,et al.  A pusher/steerer model for strongly cooperative mobile robot manipulation , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[40]  Illah R. Nourbakhsh,et al.  A constraint optimization framework for fractured robot teams , 2006, AAMAS '06.

[41]  Jun Ota,et al.  Motion control of cooperative transportation system by quadruped robots based on vibration model in walking , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[42]  G. Whelan,et al.  Cooperative search and rescue with a team of mobile robots , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[43]  Anoop Gupta,et al.  Maintaining Communication Link for a Robot Operating in a Hazardous Environment , 2004 .

[44]  Nidhi Kalra,et al.  Hoplites: A Market-Based Framework for Planned Tight Coordination in Multirobot Teams , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[45]  Vijay Kumar,et al.  A Paradigm for Dynamic Coordination of Multiple Robots , 2004, Auton. Robots.

[46]  René Vidal,et al.  A hierarchical approach to probabilistic pursuit-evasion games with unmanned ground and aerial vehicles , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[47]  Anthony Stentz,et al.  Market-Driven Multi-Robot Exploration , 2002 .

[48]  Maja J. Mataric,et al.  Robot formations using only local sensing and control , 2001, Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515).

[49]  Gaurav S. Sukhatme,et al.  Distributed multi-robot task allocation for emergency handling , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[50]  Jack Snoeyink,et al.  Testing Homotopy for Paths in the Plane , 2004, Discret. Comput. Geom..

[51]  G. Sukhatme,et al.  Negotiated Formations , 2003 .

[52]  Anthony Stentz,et al.  Robust multirobot coordination in dynamic environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[53]  Giora Slutzki,et al.  An algorithm for searching a polygonal region with a flashlight , 2000, SCG '00.

[54]  Maja J. Mataric,et al.  Sold!: auction methods for multirobot coordination , 2002, IEEE Trans. Robotics Autom..

[55]  Lynne E. Parker Designing control laws for cooperative agent teams , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[56]  Lynne E. Parker An Experiment in Mobile Robotic Cooperation , 1994 .

[57]  Maja J. Mataric,et al.  Pusher-watcher: an approach to fault-tolerant tightly-coupled robot coordination , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[58]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[59]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[60]  Maxim Likhachev,et al.  D*lite , 2002, AAAI/IAAI.

[61]  Kurt Mehlhorn,et al.  Data Structures and Algorithms 3: Multi-dimensional Searching and Computational Geometry , 2012, EATCS Monographs on Theoretical Computer Science.

[62]  Mark Yim,et al.  Indoor automation with many mobile robots , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[63]  Sung Yong Shin,et al.  Visibility-based pursuit-evasion in a polygonal room with a door , 1999, SCG '99.

[64]  Joel M. Esposito,et al.  Wireless Connectivity of Swarms in Presence of Obstacles , 2006 .

[65]  H. L. Akin,et al.  Q-Learning based Market-Driven Multi-Agent Collaboration in Robot Soccer , 2004 .

[66]  Brett Browning,et al.  Dynamically formed heterogeneous robot teams performing tightly-coordinated tasks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[67]  Paul S. Schenker,et al.  CAMPOUT: a control architecture for tightly coupled coordination of multirobot systems for planetary surface exploration , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[68]  Anthony Stentz,et al.  Anytime RRTs , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[69]  Mario F. M. Campos,et al.  Decentralized motion planning for multiple robots subject to sensing and communication constraints , 2003 .

[70]  Günther Schmidt,et al.  A decentralized approach for the conflict-free motion of multiple mobile robots , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[71]  Anthony Stentz,et al.  Market-Based Multirobot Coordination Using Task Abstraction , 2003, FSR.

[72]  Reid G. Simmons,et al.  Preliminary results in sliding autonomy for assembly by coordinated teams , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[73]  平田 泰久 Motion Control of Multiple Autonomous Mobile Robots Handling a Large Object in Coordination , 1999 .

[74]  Edward P. K. Tsang,et al.  Adaptive Constraint Satisfaction: The Quickest First Principle , 1996, ECAI.

[75]  Hiroaki Yamaguchi,et al.  Adaptive formation control for distributed autonomous mobile robot groups , 1997, Proceedings of International Conference on Robotics and Automation.

[76]  Hoa G. Nguyen,et al.  Autonomous Communication Relays for Tactical Robots , 2003 .

[77]  Sebastian Thrun,et al.  Auction Mechanism Design for Multi-Robot Coordination , 2003, NIPS.

[78]  Hisahi Osumi,et al.  Cooperative control of multiple mobile manipulators on uneven ground , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[79]  Tucker R. Balch,et al.  Social potentials for scalable multi-robot formations , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[80]  Leonidas J. Guibas,et al.  Sweeping simple polygons with a chain of guards , 2000, SODA '00.

[81]  Wolfram Burgard,et al.  Collaborative multi-robot exploration , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[82]  Manuela Veloso,et al.  DYNAMIC MULTI-ROBOT COORDINATION , 2003 .

[83]  Anthony Stentz,et al.  Market-based Multirobot Coordination for Complex Tasks , 2006, Int. J. Robotics Res..

[84]  Sebastian Thrun,et al.  Visibility-based Pursuit-evasion with Limited Field of View , 2004, Int. J. Robotics Res..

[85]  Sebastian Thrun,et al.  Parallel Stochastic Hill- Climbing with Small Teams , 2005 .

[86]  Rolf Klein,et al.  The two guards problem , 1991, SCG '91.

[87]  D. R. Lick,et al.  Theory and Applications of Graphs , 1978 .

[88]  Henry W. Stone,et al.  Hazardous-Materials Robot , 1995 .

[89]  Anthony Stentz,et al.  The Focussed D* Algorithm for Real-Time Replanning , 1995, IJCAI.

[90]  Brett Browning,et al.  Dynamic Heterogeneous Robot Teams Engaged in Adversarial Tasks , 2005 .

[91]  Vijay Kumar,et al.  Leader-to-formation stability , 2004, IEEE Transactions on Robotics and Automation.

[92]  Mark H. Overmars,et al.  Prioritized motion planning for multiple robots , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[93]  Edward Tunstel,et al.  Planetary Rover Developments Supporting Mars Exploration, Sample Return and Future Human-Robotic Colonization , 2003, Auton. Robots.

[94]  Eiji Nakano,et al.  Realizing cooperative object manipulation using multiple behaviour-based robots , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[95]  Barry Brumitt,et al.  Dynamic mission planning for multiple mobile robots , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[96]  Wolfram Burgard,et al.  Coordination for Multi-Robot Exploration and Mapping , 2000, AAAI/IAAI.

[97]  Evangelos Markakis,et al.  Auction-Based Multi-Robot Routing , 2005, Robotics: Science and Systems.

[98]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[99]  Rachid Alami,et al.  M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[100]  Anthony Stentz,et al.  Traderbots: a new paradigm for robust and efficient multirobot coordination in dynamic environments , 2004 .

[101]  Nidhi Kalra,et al.  Hoplites: A Market Framework for Complex Tight Coordination in Multi-Agent Teams , 2004 .

[102]  Jane Yung-jen Hsu,et al.  Cooperation and deadlock-handling for an object-sorting task in a multi-agent robotic system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[103]  Michail G. Lagoudakis,et al.  The Generation of Bidding Rules for Auction-Based Robot Coordination , 2005 .

[104]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[105]  Çetin Meriçli,et al.  Market-Driven Multi-Agent Collaboration in Robot Soccer Domain , 2005 .