A Heuristic Approach to Planning with Incomplete STRIPS Action Models

Most current planners assume complete domain models and focus on generating correct plans. Unfortunately, domain modeling is a laborious and error-prone task, thus real world agents have to plan with incomplete domain models. While domain experts cannot guarantee completeness, often they are able to circumscribe the incompleteness of the model by providing annotations as to which parts of the domain model may be incomplete. In this paper, we study planning problems with incomplete STRIPS domain models where the annotations specify possible preconditions and effects of actions. We show that the problem of assessing the quality of a plan, or its plan robustness, is #P-complete, establishing its equivalence with the weighted model counting problems. We introduce two approximations, lower and upper bound, for plan robustness, and then utilize them to derive heuristics for synthesizing robust plans. Our planning system, PISA, incorporating stochastic local search with these novel techniques outperforms a state-of-the-art planner handling incomplete domains in most of the tested domains, both in terms of plan quality and planning time.

[1]  Eyal Amir,et al.  Learning Partially Observable Deterministic Action Models , 2005, IJCAI.

[2]  Maria Fox,et al.  Exploration of the Robustness of Plans , 2005, AAAI.

[3]  Laurent El Ghaoui,et al.  Robust Control of Markov Decision Processes with Uncertain Transition Matrices , 2005, Oper. Res..

[4]  Subbarao Kambhampati,et al.  Model-Lite Case-Based Planning , 2012, AAAI.

[5]  Manuela M. Veloso,et al.  Fault Tolerant Planning: Toward Probabilistic Uncertainty Models in Symbolic Non-Deterministic Planning , 2004, ICAPS.

[6]  Ronen I. Brafman,et al.  Conformant planning via heuristic forward search: A new approach , 2004, Artif. Intell..

[7]  Qiang Yang,et al.  Learning action models from plan examples using weighted MAX-SAT , 2007, Artif. Intell..

[8]  Subbarao Kambhampati,et al.  Model-lite Planning for the Web Age Masses: The Challenges of Planning with Incomplete and Evolving Domain Models , 2007, AAAI.

[9]  Robert Givan,et al.  Bounded-parameter Markov decision processes , 2000, Artif. Intell..

[10]  Carmel Domshlak,et al.  Fast Probabilistic Planning through Weighted Model Counting , 2006, ICAPS.

[11]  Andrew Garland,et al.  Plan evaluation with incomplete action descriptions , 2002, AAAI/IAAI.

[12]  Chelsea C. White,et al.  Markov Decision Processes with Imprecise Transition Probabilities , 1994, Oper. Res..

[13]  Henry A. Kautz,et al.  Heuristics for Fast Exact Model Counting , 2005, SAT.

[14]  Andrew Coles,et al.  A New Local-Search Algorithm for Forward-Chaining Planning , 2007, ICAPS.

[15]  Leslie G. Valiant,et al.  The Complexity of Enumeration and Reliability Problems , 1979, SIAM J. Comput..

[16]  Daniel Bryce,et al.  Planning and Acting in Incomplete Domains , 2011, ICAPS.

[17]  Subbarao Kambhampati,et al.  Refining Incomplete Planning Domain Models Through Plan Traces , 2013, IJCAI.

[18]  Scott Sanner,et al.  Efficient Solutions to Factored MDPs with Imprecise Transition Probabilities , 2009, ICAPS.

[19]  J. K. Satia,et al.  Markovian Decision Processes with Uncertain Transition Probabilities , 1973, Oper. Res..

[20]  Subbarao Kambhampati,et al.  Assessing and Generating Robust Plans with Partial Domain Models , 2010 .

[21]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..