AGAINST OPTIMALITY: LOGICAL FOUNDATIONS FOR DECISION‐THEORETIC PLANNING IN AUTONOMOUS AGENTS

This paper investigates decision‐theoretic planning in sophisticated autonomous agents operating in environments of real‐world complexity. An example might be a planetary rover exploring a largely unknown planet. It is argued that existing algorithms for decision‐theoretic planning are based on a logically incorrect theory of rational decision making. Plans cannot be evaluated directly in terms of their expected values, because plans can be of different scopes, and they can interact with other previously adopted plans. Furthermore, in the real world, the search for optimal plans is completely intractable. An alternative theory of rational decision making is proposed, called “locally global planning.”

[1]  Raymond Reiter,et al.  A Logic for Default Reasoning , 1987, Artif. Intell..

[2]  John L. Pollock,et al.  Perceiving and Reasoning about a Changing World , 1998, Comput. Intell..

[3]  John L. Pollock,et al.  The Logical Foundations of Goal-Regression Planning in Autonomous Agents , 1998, Artif. Intell..

[4]  John L. Pollock,et al.  Causal Probability , 2004, Synthese.

[5]  Peter Haddawy,et al.  A Modular Structured Approach to Conditional Decision-Theoretic Planning , 1998, AIPS.

[6]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[7]  J. Pollock.  An Easy “ Hard Problem ” for Decision-Theoretic Planning , 2002 .

[8]  Daniel S. Weld,et al.  UCPOP: A Sound, Complete, Partial Order Planner for ADL , 1992, KR.

[9]  Jim Blythe,et al.  Decision-Theoretic Planning , 1999, AI Mag..

[10]  Manuela M. Veloso,et al.  Analogical Replay for Efficient Conditional Planning , 1997, AAAI/IAAI.

[11]  John L. Pollock,et al.  Defeasible reasoning with variable degrees of justification , 2001, Artif. Intell..

[12]  J. Pollock.  Evaluative Cognition , 1999 .

[13]  John L. Pollock.  Thinking about Acting: Logical Foundations for Rational Decision Making , 2006 .

[14]  John L. Pollock,et al.  New foundations for practical reasoning , 1992, Minds and Machines.

[15]  Amedeo Cesta,et al.  Recent Advances in AI Planning , 1997, Lecture Notes in Computer Science.

[16]  Bart Selman,et al.  Pushing the Envelope: Planning, Propositional Logic and Stochastic Search , 1996, AAAI/IAAI, Vol. 2.

[17]  Ted E. Senator,et al.  The NASD Regulation Advanced-Detection System (ADS) , 1998, AI Mag..

[18]  Diane J. Cook,et al.  Decision-Theoretic Planning in the Graphplan Framework , 2000 .

[19]  Henry A. Kautz,et al.  BLACKBOX: A New Approach to the Application of Theorem Proving to Problem Solving , 1998 .

[20]  Steve,et al.  Beyond Symbolic Goals : A Step Towards Utility-directed Planning , 2002 .

[21]  S. Majercik,et al.  C-MAXPLAN: Contingent Planning in the MAXPLAN Framework , 1999 .

[22]  Martha E. Pollack,et al.  Conditional, Probabilistic Planning: A Unifying Algorithm and Effective Search Control Mechanisms , 1999, AAAI/IAAI.

[23]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[24]  David J. Israel.  What's Wrong with Non-Monotonic Logic? , 1980, AAAI.

[25]  Michael L. Littman,et al.  Contingent planning under uncertainty via stochastic satisfiability , 1999, Artif. Intell..

[26]  John L. Pollock,et al.  Rational Choice and Action Omnipotence , 2002 .

[27]  Craig Boutilier,et al.  Decision-Theoretic Planning: Structural Assumptions and Computational Leverage , 1999, J. Artif. Intell. Res..

[28]  Nicholas Kushmerick,et al.  An Algorithm for Probabilistic Planning , 1995, Artif. Intell..

[29]  Martha E. Pollack,et al.  A Unifying Algorithm for Conditional, Probabilistic Planning , 1998 .

[30]  Martha E. Pollack,et al.  Contingency Selection in Plan Generation , 1997, ECP.

[31]  Karl Johan Åström,et al.  Optimal control of Markov processes with incomplete state information , 1965 .

[32]  H. Kyburg,et al.  Nomic probability and the foundations of induction , 1990 .

[33]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.