A Survey of Research in Distributed, Continual Planning

Complex, real-world domains require rethinking traditional approaches to AI planning. Planning and executing the resulting plans in a dynamic environment implies a continual approach in which planning and execution are interleaved, uncertainty in the current and projected world state is recognized and handled appropriately, and replanning can be performed when the situation changes or planned actions fail. Furthermore, complex planning and execution problems may require multiple computational agents and human planners to collaborate on a solution. In this article, we describe a new paradigm for planning in complex, dynamic environments, which we term distributed, continual planning (DCP). We argue that developing DCP systems will be necessary for planning applications to be successful in these environments. We give a historical overview of research leading to the current state of the art in DCP and describe research in distributed and continual planning.

[1]  Edmund H. Durfee,et al.  Top-down search for coordinating the hierarchical plans of multiple agents , 1999, AGENTS '99.

[2]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[3]  Devika Subramanian,et al.  Provably Bounded Optimal Agents , 1993, IJCAI.

[4]  Marcel Schoppers,et al.  Universal Plans for Reactive Robots in Unpredictable Environments , 1987, IJCAI.

[5]  Yoav Shoham,et al.  Agent-Oriented Programming , 1992, Artif. Intell..

[6]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[7]  Sarit Kraus,et al.  Multiagent Negotiation under Time Constraints , 1995, Artif. Intell..

[8]  Moshe Tennenholtz,et al.  On the Synthesis of Useful Social Laws for Artificial Agent Societies (Preliminary Report) , 1992, AAAI.

[9]  Amy L. Lansky,et al.  Scope and Abstraction: Two Criteria for Localized Planning , 1995, IJCAI.

[10]  Edmund H. Durfee,et al.  Partial global planning: a coordination framework for distributed hypothesis formation , 1991, IEEE Trans. Syst. Man Cybern..

[11]  H. Simon,et al.  Reason in Human Affairs. , 1984 .

[12]  Earl David Sacerdoti,et al.  A Structure for Plans and Behavior , 1977 .

[13]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[14]  Marie desJardins,et al.  Controlling Communication in Distributed Planning Using Irrelevance Reasoning , 1998, AAAI/IAAI.

[15]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[16]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[17]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[18]  Edmund H. Durfee,et al.  Coordination as distributed search in a hierarchical behavior space , 1991, IEEE Trans. Syst. Man Cybern..

[19]  Nicholas R. Jennings,et al.  Agent Theories, Architectures, and Languages: A Survey , 1995, ECAI Workshop on Agent Theories, Architectures, and Languages.

[20]  David Atkinson,et al.  Generating Perception Requests and Expectations to Verify the Execution of Plans , 1986, AAAI.

[21]  James A. Hendler,et al.  HTN Planning: Complexity and Expressivity , 1994, AAAI.

[22]  Michael P. Wellman A General-Equilibrium Approach to Distributed Transportation Planning , 1992, AAAI.

[23]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[24]  Jeffrey S. Rosenschein and Gilad Zlotkin Rules of Encounter , 1994 .

[25]  David E. Wilkins,et al.  A Multiagent Planning Architecture , 1998, AIPS.

[26]  S. Toulmin The uses of argument , 1960 .

[27]  Eithan Ephrati,et al.  A Tractable Heuristic that Maximizes Global Utility through Local Plan Combination , 1995, ICMAS.

[28]  Edmund H. Durfee,et al.  UM-PRS: An implementation of the procedural reasoning system for multirobot applications , 1994 .

[29]  Karen L. Myers Advisable Planning Systems , 1996 .

[30]  David J. Musliner,et al.  World Modeling for the Dynamic Construction of Real-Time Control Plans , 1995, Artif. Intell..

[31]  Victor R. Lesser,et al.  Generalizing the Partial Global Planning Algorithm , 1992, Int. J. Cooperative Inf. Syst..

[32]  Gil Tidhar,et al.  Planned Team Activity , 1992, MAAMAW.

[33]  Eithan Ephrati,et al.  Deriving Multi-Agent Coordination through Filtering Strategies , 1995, IJCAI.

[34]  Afsaneh Haddadi,et al.  Belief-desire-intention agent architectures , 1996 .

[35]  Katia Sycara,et al.  Persuasive argumentation in negotiation , 1990 .

[36]  M.P. Georgeff,et al.  Procedural knowledge , 1986, Proceedings of the IEEE.

[37]  James A. Hendler,et al.  AI Planning: Systems and Techniques , 1990, AI Mag..

[38]  David E. Wilkins,et al.  Practical planning - extending the classical AI planning paradigm , 1989, Morgan Kaufmann series in representation and reasoning.

[39]  Martha E. Pollack,et al.  Planning in Dynamic Environments: The DIPART System , 1996 .

[40]  Craig Boutilier,et al.  Decision-Theoretic Planning: Structural Assumptions and Computational Leverage , 1999, J. Artif. Intell. Res..

[41]  Hector J. Levesque,et al.  Intention is Choice with Commitment , 1990, Artif. Intell..

[42]  Sandip Sen,et al.  Satisfying user preferences while negotiating meetings , 1997, Int. J. Hum. Comput. Stud..

[43]  M. Veloso Towards Mixed-Initiative Rationale-Supported Planning , 1996 .

[44]  Karen E. Lochbaum,et al.  A Collaborative Planning Model of Intentional Structure , 1998, CL.

[45]  Herbert A. Simon,et al.  Alternative visions of rationality. , 1990 .

[46]  Thomas Wagner,et al.  MACRON: An Architecture for Multi-agent Cooperative Information Gathering , 1995, CIKM 1995.

[47]  Eithan Ephrati,et al.  The Clarke Tax as a Consensus Mechanism Among Automated Agents , 1991, AAAI.

[48]  M. Lings,et al.  Articles , 1967, Soil Science Society of America Journal.

[49]  Subbarao Kambhampati,et al.  Integrating general purpose planners and specialized reasoners: case study of a hybrid planning architecture , 1993, IEEE Trans. Syst. Man Cybern..

[50]  James F. Allen,et al.  TRAINS-95: Towards a Mixed-Initiative Planning Assistant , 1996, AIPS.

[51]  Manuela M. Veloso,et al.  Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork , 1999, Artif. Intell..

[52]  Edmund H. Durfee,et al.  Negotiating Task Decomposition and Allocation Using Partial Global Planning , 1989, Distributed Artificial Intelligence.

[53]  Daniel D. Corkill,et al.  Hierarchical Planning in a Distributed Environment , 1979, IJCAI.

[54]  Michael E. Bratman,et al.  Shared Cooperative Activity , 1991 .

[55]  John E. Laird,et al.  Maintaining Consistency in Hierarchical Reasoning , 1998, AAAI/IAAI.

[56]  David Chapman,et al.  Pengi: An Implementation of a Theory of Activity , 1987, AAAI.

[57]  Hector J. Levesque,et al.  On Acting Together , 1990, AAAI.

[58]  Michael P. Georgeff,et al.  Commitment and Effectiveness of Situated Agents , 1991, IJCAI.

[59]  Edmund H. Durfee,et al.  The Utility of Communication in Coordinating Intelligent Agents , 1991, AAAI.

[60]  Nicholas R. Jennings,et al.  Controlling Cooperative Problem Solving in Industrial Multi-Agent Systems Using Joint Intentions , 1995, Artif. Intell..

[61]  Randall Davis,et al.  Negotiation as a Metaphor for Distributed Problem Solving , 1988, Artificial Intelligence.

[62]  Grattan StreetCarlton,et al.  Commitment and Eeectiveness of Situated Agents , 1991 .

[63]  Sam Steel,et al.  Integrating Planning, Execution and Monitoring , 1988, AAAI.

[64]  A. Rubinstein,et al.  Bargaining and Markets. , 1991 .