Probabilistic Temporal Planning with Uncertain Durations

Few temporal planners handle both concurrency and uncertain durations, but these features commonly co-occur in real-world domains. In this paper, we discuss the challenges caused by concurrent, durative actions whose durations are uncertain. We present five implemented algorithms, including ΔDURprun, a planner guaranteed to find the optimal policy. An empirical comparison reveals that ΔDURexp, our fastest planner, obtains orders of magnitude speed-up compared to ΔDURprun--with little loss in solution quality. Importantly, our algorithms can handle probabilistic effects in addition to stochastic durations, and they are effective even when duration distributions are multi-modal.

[1]  Sylvie Thiébaux,et al.  Prottle: A Probabilistic Temporal Planner , 2005, AAAI.

[2]  Mausam,et al.  Challenges for Temporal Planning with Uncertain Durations , 2006, ICAPS.

[3]  Hector Geffner,et al.  Heuristic Planning with Time and Resources , 2014 .

[4]  Daniel S. Weld,et al.  Temporal Planning with Continuous Change , 1994, AAAI.

[5]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..

[6]  Nilufer Onder,et al.  Generating Temporally Contingent Plans , .

[7]  David J. Musliner,et al.  World Modeling for the Dynamic Construction of Real-Time Control Plans , 1995, Artif. Intell..

[8]  Malik Ghallab,et al.  Planning with Sharable Resource Constraints , 1995, IJCAI.

[9]  Ivan Serina,et al.  LPG: A Planner Based on Local Search for Planning Graphs with Action Costs , 2002, AIPS.

[10]  Lin Zhang,et al.  Decision-Theoretic Military Operations Planning , 2004, ICAPS.

[11]  Geoffrey J. Gordon,et al.  Bounded real-time dynamic programming: RTDP with monotone upper bounds and performance guarantees , 2005, ICML.

[12]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[13]  David E. Smith,et al.  Temporal Planning with Mutual Exclusion Reasoning , 1999, IJCAI.

[14]  Nicholas Kushmerick,et al.  An Algorithm for Probabilistic Planning , 1995, Artif. Intell..

[15]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[16]  Blai Bonet,et al.  Labeled RTDP: Improving the Convergence of Real-Time Dynamic Programming , 2003, ICAPS.

[17]  Mausam,et al.  Solving Concurrent Markov Decision Processes , 2004, AAAI.

[18]  Mausam,et al.  Concurrent Probabilistic Temporal Planning , 2005, ICAPS.

[19]  David E. Smith,et al.  Planning Under Continuous Time and Resource Uncertainty: A Challenge for AI , 2002, AIPS Workshop on Planning for Temporal Domains.

[20]  Daniel S. Weld,et al.  Temporal graphplan with mutual exclusion reasoning , 1999 .

[21]  Fahiem Bacchus,et al.  Planning with Resources and Concurrency: A Forward Chaining Approach , 2001, IJCAI.

[22]  David E. Smith,et al.  Incremental Contingency Planning , 2003 .

[23]  Håkan L. S. Younes,et al.  Solving Generalized Semi-Markov Decision Processes Using Continuous Phase-Type Distributions , 2004, AAAI.

[24]  Michael L. Littman,et al.  Exact Solutions to Time-Dependent MDPs , 2000, NIPS.

[25]  Håkan L. S. Younes,et al.  Policy Generation for Continuous-time Stochastic Domains with Concurrency , 2004, ICAPS.

[26]  Sylvie Thiébaux,et al.  Concurrent Probabilistic Planning in the Graphplan Framework , 2006, ICAPS.