Abstract reasoning for multiagent coordination and planning

As autonomous software and robotic systems (or agents) grow in complexity, they will increasingly need to communicate and coordinate with each other. These agents will need planned courses of action to achieve their goals while sharing limited resources. This dissertation addresses the problem of efficiently interleaving planning and coordination for multiple agents. As part of my approach, I represent agents as having hierarchies of tasks that can be decomposed into executable primitive actions. Using task hierarchies, an agent can reason efficiently about its own goals and tasks (and those of others) at multiple levels of abstraction. By exploiting hierarchy, these agents can make planning and coordination decisions while avoiding complex computation involving unnecessary details of their tasks. To reason at abstract levels, agents must be aware of the constraints an abstract task embodies in its potential decompositions. Thus, I provide algorithms that summarize these constraints (represented as propositional state conditions and metric resource us ages) for each abstract task in an agent's library of hierarchical plans. This summary information can be derived offline for a domain of problems and used for any instance of tasks (or plans) assigned to the agents during coordination and planning. I also provide algorithms for reasoning about the concurrent interactions of abstract tasks, for identifying conflicts, and for resolving them. I use these algorithms to build sound and complete refinement-based coordination and planning algorithms. I also integrate summary information with a local search planner/scheduler, showing how the benefits can be extended to different classes of planning algorithms. Complexity analyses and experiments show where abstract reasoning using summary information can reduce computation and communication exponentially along a number of dimensions for coordination, planning, and scheduling in finding a single agent's plan or in optimally coordinating the plans of multiple agents. In addition, I provide pruning techniques and heuristics for decomposition that can further dramatically reduce computation. Overall, the techniques developed in this thesis enable researchers and system designers to scale the capabilities of interleaved coordination, planning, and execution by providing agents with tools to reason efficiently about their plans at multiple levels of abstraction.

[1]  Henry A. Kautz,et al.  Constraint Propagation Algorithms for Temporal Reasoning , 1986, AAAI.

[2]  Itay Meiri Temporal reasoning: a constraint-based approach , 1992 .

[3]  Steve Chien,et al.  Extending the Representational Power of Model- Based Systems using Generalized Timelines , 2001 .

[4]  J. Davenport Editor , 1960 .

[5]  Eithan Ephrati,et al.  Divide and Conquer in Multi-Agent Planning , 1994, AAAI.

[6]  Qiang Yang,et al.  Intelligent planning - a decomposition and abstraction based approach , 1997, Artificial intelligence.

[7]  Earl D. Sacerdoti,et al.  Planning in a Hierarchy of Abstraction Spaces , 1974, IJCAI.

[8]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[9]  Rob Sherwood,et al.  Using Iterative Repair to Improve the Responsiveness of Planning and Scheduling , 2000, AIPS.

[10]  James A. Hendler,et al.  Analyzing External Conditions to Improve the Efficiency of HTN Planning , 1998, AAAI/IAAI.

[11]  Tom Bylander,et al.  The Computational Complexity of Propositional STRIPS Planning , 1994, Artif. Intell..

[12]  Qiang Yang,et al.  Formalizing planning knowledge for hierarchical planning , 1990, Comput. Intell..

[13]  R A Rathmell A COALITION FORCE SCENARIO ‘BINNI – GATEWAY TO THE GOLDEN BOWL OF AFRICA’ , 2002 .

[14]  Shlomo Zilberstein,et al.  Efficient resource-bounded reasoning in AT-RALPH , 1992 .

[15]  Steve A. Chien,et al.  Computing Valid Intervals for Collections of Activities with Shared States and Resources , 2000, AIPS.

[16]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[17]  M.P. Georgeff,et al.  Procedural knowledge , 1986, Proceedings of the IEEE.

[18]  Moshe Tennenholtz,et al.  On the Synthesis of Useful Social Laws for Artificial Agent Societies (Preliminary Report) , 1992, AAAI.

[19]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[20]  Alex Fukunaga,et al.  Iterative Repair Planning for Spacecraft Operations Using the Aspen System , 2000 .

[21]  Edmund H. Durfee,et al.  Coordination as distributed search in a hierarchical behavior space , 1991, IEEE Trans. Syst. Man Cybern..

[22]  Marcus J. Huber JAM: a BDI-theoretic mobile agent architecture , 1999, AGENTS '99.

[23]  Daniel D. Corkill,et al.  Hierarchical Planning in a Distributed Environment , 1979, IJCAI.

[24]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[25]  E. W. Beth,et al.  Proof by Contradiction , 1970 .

[26]  Martha E. Pollack,et al.  Merging Plans with Quantitative Temporal Constraints, Temporally Extended Actions, and Conditional Branches , 2000, AIPS.

[27]  Kristian J. Hammond,et al.  CHEF: A Model of Case-Based Planning , 1986, AAAI.

[28]  Henry A. Kautz,et al.  Reasoning about plans , 1991, Morgan Kaufmann series in representation and reasoning.

[29]  Amy L. Lansky,et al.  Localized Search for Controlling Automated Reasoning , 1990 .

[30]  James F. Allen,et al.  Planning Using a Temporal World Model , 1983, IJCAI.

[31]  Earl David Sacerdoti,et al.  A Structure for Plans and Behavior , 1977 .

[32]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[33]  Edmund H. Durfee,et al.  Coordinating plan execution in dynamic multiagent environments , 2002 .

[34]  Qiang Yang,et al.  Delaying Variable Binding Commitments in Planning , 1994, AIPS.

[35]  Martha E. Pollack,et al.  There's More to Life than Making Plans: Plan Management in Dynamic, Multiagent Environments , 1999, AI Mag..

[36]  David A. McAllester,et al.  Systematic Nonlinear Planning , 1991, AAAI.

[37]  Michael P. Georgeff,et al.  A Theory of Action for MultiAgent Planning , 1984, AAAI.

[38]  Daniel S. Weld An Introduction to Least Commitment Planning , 1994, AI Mag..

[39]  Austin Tate,et al.  O-Plan: The open Planning Architecture , 1991, Artif. Intell..

[40]  Johanna D. Moore,et al.  Decomposition and Causality in Partial-order Planning , 1994, AIPS.

[41]  Richard E. Korf,et al.  Planning as Search: A Quantitative Approach , 1987, Artif. Intell..

[42]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[43]  Austin Tate,et al.  Generating Project Networks , 1977, IJCAI.

[44]  Malik Ghallab,et al.  Planning with Sharable Resource Constraints , 1995, IJCAI.

[45]  Makoto Yokoo,et al.  The Distributed Constraint Satisfaction Problem: Formalization and Algorithms , 1998, IEEE Trans. Knowl. Data Eng..

[46]  Victor Lesser,et al.  Environment Centered Analysis and Design of Coordination Mechanisms , 1996 .

[47]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[48]  Martha E. Pollack,et al.  Evaluating new options in the context of existing plans , 2001, Artif. Intell..

[49]  E. Gat On Three-Layer Architectures , 1997 .

[50]  Craig A. Knoblock Search Reduction in Hierarchical Problem Solving , 1991, AAAI.

[51]  Amedeo Cesta,et al.  Recent Advances in AI Planning , 1997, Lecture Notes in Computer Science.

[52]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[53]  James A. Hendler,et al.  UMCP: A sound and complete planning procedure for hierarchical task-network planning , 1994 .

[54]  Edmund H. Durfee,et al.  UM-PRS: An implementation of the procedural reasoning system for multirobot applications , 1994 .

[55]  Witold Lukaszewicz,et al.  Reasoning about Plans , 1997, IJCAI.

[56]  Michael P. Georgeff,et al.  Communication and interaction in multi-agent planning , 1983, AAAI 1983.

[57]  Milind Tambe,et al.  Toward Team-Oriented Programming , 1999, ATAL.