There's More to Life than Making Plans: Plan Management in Dynamic, Multiagent Environments

For many years, research in AI plan generation was governed by a number of strong, simplifying assumptions: The planning agent is omniscient, its actions are deterministic and instantaneous, its goals are fixed and categorical, and its environment is static. More recently, researchers have developed expanded planning algorithms that are not predicated on such assumptions, but changing the way in which plans are formed is only part of what is required when the classical assumptions are abandoned. The demands of dynamic, uncertain environments mean that in addition to being able to form plans -- even probabilistic, uncertain plans -- agents must be able to effectively manage their plans. In this article, which is based on a talk given at the 1998 AAAI Fall Symposium on Distributed, Continual Planning, we first identify reasoning tasks that are involved in plan management, including commitment management, environment monitoring, alternative assessment, plan elaboration, metalevel control, and coordination with other agents. We next survey approaches we have developed to many of these tasks and discuss a plan-management system we are building to ground our theoretical work, by providing us with a platform for integrating our techniques and exploring their value in a realistic problem. Throughout, our discussion is informal and relies on numerous examples; the reader can consult the various papers cited for technical details.

[1]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[2]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[3]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[5]  Mark S. Boddy,et al.  An Analysis of Time-Dependent Planning , 1988, AAAI.

[6]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[7]  Michael P. Georgeff,et al.  Decision-Making in an Embedded Reasoning System , 1989, IJCAI.

[8]  Martha E. Pollack,et al.  Introducing the Tileworld: Experimentally Evaluating Agent Architectures , 1990, AAAI.

[9]  Michael P. Georgeff,et al.  Commitment and Effectiveness of Situated Agents , 1991, IJCAI.

[10]  James A. Hendler,et al.  Experiments in Optimal Sensing for Situated Agents , 1992 .

[11]  Martha E. Pollack,et al.  The Uses of Plans , 1992, Artif. Intell..

[12]  Mark A. Peot,et al.  Conditional nonlinear planning , 1992 .

[13]  Erann Gat,et al.  Integrating Planning and Reacting in a Heterogeneous Asynchronous Architecture for Controlling Real-World Mobile Robots , 1992, AAAI.

[14]  Daniel S. Weld,et al.  A Probablistic Model of Action for Least-Commitment Planning with Information Gathering , 1994, UAI.

[15]  Steve Hanks,et al.  Optimal Planning with a Goal-directed Utility Model , 1994, AIPS.

[16]  Thomas Dean,et al.  Solving Time-critical Decision-making Problems with Predictable Computational Demands , 1994, AIPS.

[17]  Robert P. Goldman,et al.  Epsilon-Safe Planning , 1994, UAI.

[18]  R. James Firby Task Networks for Controlling Continuous Processes , 1994, AIPS.

[19]  W. Bruce Croft,et al.  From Office Automation to Intelligent Workflow Systems , 1995, IEEE Expert.

[20]  Nicholas Kushmerick,et al.  An Algorithm for Probabilistic Planning , 1995, Artif. Intell..

[21]  Gregg Collins,et al.  Planning Under Uncertainty: Some Key Issues , 1995, IJCAI.

[22]  Craig A. Knoblock Planning, Executing, Sensing, and Replanning for Information Gathering , 1995, IJCAI.

[23]  David Madigan,et al.  Probabilistic Temporal Reasoning with Endogenous Change , 1995, UAI.

[24]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[25]  Eithan Ephrati,et al.  Deriving Multi-Agent Coordination through Filtering Strategies , 1995, IJCAI.

[26]  Peter Haddawy,et al.  Efficient Decision-Theoretic Planning: Techniques and Empirical Analysis , 1995, UAI.

[27]  Subbarao Kambhampati,et al.  Planning as Refinement Search: A Unified Framework for Evaluating Design Tradeoffs in Partial-Order Planning , 1995, Artif. Intell..

[28]  Eugene Fink,et al.  Integrating planning and learning: the PRODIGY architecture , 1995, J. Exp. Theor. Artif. Intell..

[29]  Robert P. Goldman,et al.  Expressive Planning and Explicit Knowledge , 1996, AIPS.

[30]  R. James Firby Modularity Issues in Reactive Planning , 1996, AIPS.

[31]  Gary J. Nutt,et al.  The evolution towards flexible workflow systems , 1996, Distributed Syst. Eng..

[32]  Shlomo Zilberstein,et al.  Optimal Composition of Real-Time Systems , 1996, Artif. Intell..

[33]  Jim Blythe,et al.  Event-Based Decompositions for Reasoning about External Change in Planners , 1996, AIPS.

[34]  Eric Horvitz,et al.  Models of Continual Computation , 1997, AAAI/IAAI.

[35]  Qiang Yang,et al.  Intelligent planning - a decomposition and abstraction based approach , 1997, Artificial intelligence.

[36]  Martha E. Pollack,et al.  Contingency Selection in Plan Generation , 1997, ECP.

[37]  Peter A. Jarvis,et al.  Intelligent Support for Enterprise Modelling , 1998 .

[38]  Reid G. Simmons,et al.  Search Control of Plan Generation in Decision-Theoretic Planners , 1998, AIPS.

[39]  Manuela M. Veloso,et al.  Rationale-Based Monitoring for Planning in Dynamic Environments , 1998, AIPS.

[40]  Peter Haddawy,et al.  Utility Models for Goal‐Directed, Decision‐Theoretic Planners , 1998, Comput. Intell..

[41]  Jim Blythe,et al.  Planning Under Uncertainty in Dynamic Domains , 1998 .

[42]  Martha E. Pollack,et al.  Adjustable Autonomy for a Plan Management Agent , 1999 .

[43]  Craig Boutilier,et al.  Decision-Theoretic Planning: Structural Assumptions and Computational Leverage , 1999, J. Artif. Intell. Res..

[44]  Martha E. Pollack,et al.  Towards Focused Plan Monitoring: A Technique and an Application to Mobile Robots , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[45]  Martha E. Pollack,et al.  Conditional, Probabilistic Planning: A Unifying Algorithm and Effective Search Control Mechanisms , 1999, AAAI/IAAI.