Resource-Constrained Planning: A Monte Carlo Random Walk Approach

The need to economize limited resources, such as fuel or money, is a ubiquitous feature of planning problems. If the resources cannot be replenished, the planner must make do with the initial supply. It is then of paramount importance how constrained the problem is, i.e., whether and to which extent the initial resource supply exceeds the minimum need. While there is a large body of literature on numeric planning and planning with resources, such resource constrainedness has only been scantily investigated. We herein start to address this in more detail. We generalize the previous notion of resource constrainedness, characterized through a numeric problem feature C ≥ 1, to the case of multiple resources. We implement an extended benchmark suite controlling C. We conduct a large-scale study of the current state of the art as a function of C, highlighting which techniques contribute to success. We introduce two new techniques on top of a recent Monte Carlo Random Walk method, resulting in a planner that, in these benchmarks, outperforms previous planners when resources are scarce (C close to 1). We investigate the parameters influencing the performance of that planner, and we show that one of the two new techniques works well also on the regular IPC benchmarks.

[1]  Jörg Hoffmann,et al.  SAT Encodings of State-Space Reachability Problems in Numeric Domains , 2007, IJCAI.

[2]  Carmel Domshlak,et al.  Landmarks, Critical Paths and Abstractions: What's the Difference Anyway? , 2009, ICAPS.

[3]  Stefan Edelkamp,et al.  Generalizing the Relaxed Planning Heuristic to Non-linear Tasks , 2004, KI.

[4]  Martin Müller,et al.  Monte-Carlo Exploration for Deterministic Planning , 2009, IJCAI.

[5]  Jussi Rintanen,et al.  Heuristics for Planning with SAT , 2010, CP.

[6]  Stefan Edelkamp,et al.  Taming Numbers and Durations in the Model Checking Integrated Planning System , 2003, PuK.

[7]  Jörg Hoffmann,et al.  The Metric-FF Planning System: Translating ''Ignoring Delete Lists'' to Numeric State Variables , 2003, J. Artif. Intell. Res..

[8]  Ivan Serina,et al.  Planning Through Stochastic Local Search and Temporal Action Graphs in LPG , 2003, J. Artif. Intell. Res..

[9]  Jana Koehler,et al.  Planning under Resource Constraints , 1998, ECAI.

[10]  Andrew Coles,et al.  LPRPG-P: Relaxed Plan Heuristics for Planning with Preferences , 2011, ICAPS.

[11]  Andrew Coles,et al.  A New Local-Search Algorithm for Forward-Chaining Planning , 2007, ICAPS.

[12]  J. Christopher Beck,et al.  Understanding the behavior of Solution-Guided Search for job-shop scheduling , 2011, J. Sched..

[13]  Malte Helmert,et al.  The Fast Downward Planning System , 2006, J. Artif. Intell. Res..

[14]  Erez Karpas,et al.  To Max or Not to Max: Online Learning for Speeding Up Optimal Planning , 2010, AAAI.

[15]  Roman Barták,et al.  Integrating Time and Resources into Planning , 2010, 2010 22nd IEEE International Conference on Tools with Artificial Intelligence.

[16]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[17]  C. Fawcett,et al.  FD-Autotune: Automated Configuration of Fast Downward , 2011 .

[18]  Patrik Haslum,et al.  Flexible Abstraction Heuristics for Optimal Sequential Planning , 2007, ICAPS.

[19]  Jörg Hoffmann,et al.  Improving Local Search for Resource-Constrained Planning , 2010, SOCS.

[20]  Andrew Coles,et al.  A Hybrid Relaxed Planning Graph'LP Heuristic for Numeric Planning Domains , 2008, ICAPS.

[21]  Hector Geffner,et al.  Heuristic Planning with Time and Resources , 2014 .

[22]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[23]  Malte Helmert,et al.  Landmarks Revisited , 2008, AAAI.

[24]  Ivan Serina,et al.  An approach to efficient planning with numerical fluents and multi-criteria plan quality , 2008, Artif. Intell..

[25]  Jörg Hoffmann,et al.  Computing Perfect Heuristics in Polynomial Time: On Bisimulation and Merge-and-Shrink Abstraction in Optimal Planning , 2011, IJCAI.