Probabilistic Planning is Multi-objective!

Probabilistic planning is an inherently multi-objective p roblem where plans must trade-off probability of goal satisfaction with expected plan cost. To date, probabilist ic plan synthesis algorithms have focussed on single objective formulations that bound one of the objectives by making some unnatural assumptions. We show that a multi-objective formulation is not only needed, but also enables us to (i) generate Pareto sets of plans, (ii) use recent advances in probabilistic planning reachability heuristics, and (iii ) elegantly solve limited contingency planning problems. We

[1]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  M. I. Henig.  Vector-Valued Dynamic Programming , 1983 .

[3]  Daniel S. Weld,et al.  Probabilistic Planning with Information Gathering and Contingent Execution , 1994, AIPS.

[4]  Nicholas Kushmerick,et al.  An Algorithm for Probabilistic Least-Commitment Planning , 1994, AAAI.

[5]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..

[6]  Stanley J. Rosenschein,et al.  Learning to act using real-time dynamic programming , 1996 .

[7]  Martha E. Pollack,et al.  Contingency Selection in Plan Generation , 1997, ECP.

[8]  Michael L. Littman,et al.  Probabilistic Propositional Planning: Representations and Complexity , 1997, AAAI/IAAI.

[9]  Michael L. Littman,et al.  Contingent planning under uncertainty via stochastic satisfiability , 1999, Artif. Intell..

[10]  Craig Boutilier,et al.  Decision-Theoretic Planning: Structural Assumptions and Computational Leverage , 1999, J. Artif. Intell. Res..

[11]  Shapour Azarm,et al.  Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set , 2001 .

[12]  Shlomo Zilberstein,et al.  LAO*: A heuristic search algorithm that finds solutions with loops , 2001, Artif. Intell..

[13]  David E. Smith,et al.  Optimal Limited Contingency Planning , 2002, UAI.

[14]  Nathanael Hyafil,et al.  Utilizing Structured Representations and CSP's in Conformant Probabilistic Planning , 2004, ECAI.

[15]  Sylvie Thiébaux,et al.  Prottle: A Probabilistic Temporal Planner , 2005, AAAI.

[16]  Daniel Bryce,et al.  Sequential Monte Carlo in Probabilistic Planning Reachability Heuristics , 2006, ICAPS.