Extending Classical Planning with State Constraints: Heuristics and Search for Optimal Planning

We present a principled way of extending a classical AI planning formalism with systems of state constraints, which relate – sometimes determine – the values of variables in each state traversed by the plan. This extension occupies an attractive middle ground between expressivity and complexity. It enables modelling a new range of problems, as well as formulating more efficient models of classical planning problems. An example of the former is planning-based control of networked physical systems – power networks, for example – in which a local, discrete control action can have global effects on continuous quantities, such as altering flows across the entire network. At the same time, our extension remains decidable as long as the satisfiability of sets of state constraints is decidable, including in the presence of numeric state variables, and we demonstrate that effective techniques for costoptimal planning known in the classical setting – in particular, relaxation-based admissible heuristics – can be adapted to the extended formalism. In this paper, we apply our approach to constraints in the form of linear or non-linear equations over numeric state variables, but the approach is independent of the type of state constraints, as long as there exists a procedure that decides their consistency. The planner and the constraint solver interact through a well-defined, narrow interface, in which the solver requires no specialisation to the planning context. Furthermore, we present an admissible search algorithm – a variant of A – that is able to make use of additional information provided by the search heuristic, in the form of preferred actions. Although preferred actions have been widely used in satisficing planning, we are not aware of any previous use of them in optimal planning. c ©2018 AI Access Foundation. All rights reserved. Haslum, Ivankovic, Raḿırez, Gordon, Thiébaux, Shivashankar & Nau

[1]  Patrik Haslum,et al.  Numeric Planning with Disjunctive Global Constraints via SMT , 2016, ICAPS.

[2]  Paul W. H. Chung,et al.  AI Planning in a Chemical Plant Domain , 1998, ECAI.

[3]  Nathan R. Sturtevant,et al.  Partial-Expansion A* with Selective Node Generation , 2012, SOCS.

[4]  Patrik Haslum,et al.  New Admissible Heuristics for Domain-Independent Planning , 2005, AAAI.

[5]  Blai Bonet,et al.  Strengthening Landmark Heuristics via Hitting Sets , 2010, ECAI.

[6]  Daniel S. Weld,et al.  The LPSAT Engine & Its Application to Resource Planning , 1999, IJCAI.

[7]  John K. Slaney,et al.  Blocks World revisited , 2001, Artif. Intell..

[8]  Philip Kilby,et al.  There's more than one way to solve a long-haul transportation problem , 2015 .

[9]  J. Ho,et al.  The Metric FF Planning System Translating Ignoring Delete Lists to Numeric State Variables , 2003 .

[10]  Maria Fox,et al.  Isolating where planning and scheduling interact , 2003 .

[11]  Patrik Haslum,et al.  Merge-and-Shrink Abstraction , 2014, J. ACM.

[12]  Sylvie Thiébaux,et al.  Optimal distribution systems reconfiguration for radial and meshed grids , 2015 .

[13]  Carmel Domshlak,et al.  The Complexity of Optimal Monotonic Planning: The Bad, The Good, and The Causal Graph , 2014, ICAPS.

[14]  S. Edelkamp,et al.  Engineering Benchmarks for Planning: the Domains Used in the Deterministic Part of IPC-4 , 2006, J. Artif. Intell. Res..

[15]  Hector Geffner,et al.  Modeling and Computation in Planning: Better Heuristics from More Expressive Languages , 2015, ICAPS.

[16]  Carleton Coffrin,et al.  NESTA, The NICTA Energy System Test Case Archive , 2014, ArXiv.

[17]  David E. Smith,et al.  Reasoning About Action I: A Possible Worlds Approach , 1987, Artif. Intell..

[18]  Andrew Coles,et al.  Temporal Planning in Domains with Linear Processes , 2009, IJCAI.

[19]  Vladimir Lifschitz,et al.  ON THE SEMANTICS OF STRIPS , 1987 .

[20]  Malte Helmert,et al.  The Fast Downward Planning System , 2006, J. Artif. Intell. Res..

[21]  Jorg Homann A Heuristic for Domain Independent Planning and Its Use in an Enforced Hill-Climbing Algorithm , 2000 .

[22]  Patrik Haslum,et al.  Optimal Planning with Global Numerical State Constraints , 2014, ICAPS.

[23]  S. Edelkamp Planning with Pattern Databases , 2014 .

[24]  Carleton Coffrin,et al.  Planning with MIP for Supply Restoration in Power Distribution Systems , 2013, IJCAI.

[25]  Carmel Domshlak,et al.  Landmarks, Critical Paths and Abstractions: What's the Difference Anyway? , 2009, ICAPS.

[26]  Bernhard Nebel,et al.  On the Compilability and Expressive Power of Propositional Planning Formalisms , 2000, J. Artif. Intell. Res..

[27]  Masood Feyzbakhsh Rankooh,et al.  ITSAT: An Efficient SAT-Based Temporal Planner , 2015, J. Artif. Intell. Res..

[28]  Erez Karpas,et al.  Sensible Agent Technology Improving Coordination and Communication in Biosurveillance Domains , 2009, IJCAI.

[29]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[30]  Maria Fox,et al.  Hybrid STAN: Identifying and Managing Combinatorial Optimisation Sub- problems in Planning , 2001, IJCAI.

[31]  R. Jabr Radial distribution load flow using conic programming , 2006, IEEE Transactions on Power Systems.

[32]  Raquel Fuentetaja,et al.  Compiling irrelevant objects to counters. Special case of creation planning , 2016, AI Commun..

[33]  Patrik Haslum,et al.  Heuristics for Numeric Planning via Subgoaling , 2016, IJCAI.

[34]  Gérard Cornuéjols,et al.  An algorithmic framework for convex mixed integer nonlinear programs , 2008, Discret. Optim..

[35]  Patrik Haslum hm(P) = h1(Pm): Alternative Characterisations of the Generalisation From hmax To hm , 2009, ICAPS.

[36]  Jörg Hoffmann,et al.  Star-topology decoupled state space search , 2018, Artif. Intell..

[37]  Maria Fox,et al.  An extension of metric temporal planning with application to AC voltage control , 2015, Artif. Intell..

[38]  Marianne Winslett,et al.  Reasoning about Action Using a Possible Models Approach , 1988, AAAI.

[39]  Marie-Odile Cordier,et al.  Supply Restoration in Power Distribution Systems - A Benchmark for Planning under Uncertainty , 2014 .

[40]  Malte Helmert,et al.  Preferred Operators and Deferred Evaluation in Satisficing Planning , 2009, ICAPS.

[41]  Eugene Fink,et al.  Integrating planning and learning: the PRODIGY architecture , 1995, J. Exp. Theor. Artif. Intell..

[42]  Bernhard Nebel,et al.  COMPLEXITY RESULTS FOR SAS+ PLANNING , 1995, Comput. Intell..

[43]  Malte Helmert,et al.  Decidability and Undecidability Results for Planning with Numerical State Variables , 2002, PuK.

[44]  Hector J. Levesque,et al.  GOLOG: A Logic Programming Language for Dynamic Domains , 1997, J. Log. Program..

[45]  C. Cordell Green,et al.  Application of Theorem Proving to Problem Solving , 1969, IJCAI.

[46]  Patrik Haslum,et al.  Interval-Based Relaxation for General Numeric Planning , 2016, ECAI.

[47]  Brian C. Williams,et al.  Generative Planning for Hybrid Systems Based on Flow Tubes , 2008, ICAPS.

[48]  Teruhisa Miura,et al.  A* with Partial Expansion for Large Branching Factor Problems , 2000, AAAI/IAAI.

[49]  Oren Etzioni,et al.  The First Law of Robotics (A Call to Arms) , 1994, AAAI.

[50]  Eyal Amir,et al.  Factored planning , 2003, IJCAI 2003.

[51]  Marc Toussaint,et al.  Logic-Geometric Programming: An Optimization-Based Approach to Combined Task and Motion Planning , 2015, IJCAI.

[52]  Ronen I. Brafman,et al.  Factored Planning: How, When, and When Not , 2006, AAAI.

[53]  J. Hooker,et al.  Logic-Based Methods for Optimization: Combining Optimization and Constraint Satisfaction , 2000 .

[54]  Thomas Keller,et al.  Abstractions for Planning with State-Dependent Action Costs , 2016, ICAPS.

[55]  Malte Helmert,et al.  Optimal Planning for Delete-Free Tasks with Incremental LM-Cut , 2012, ICAPS.

[56]  Fahiem Bacchus,et al.  Using temporal logics to express search control knowledge for planning , 2000, Artif. Intell..

[57]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[58]  Alessandro Saffiotti,et al.  Constraint propagation on interval bounds for dealing with geometric backtracking , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Pieter Abbeel,et al.  Combined task and motion planning through an extensible planner-independent interface layer , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[60]  Rachid Alami,et al.  Overview of aSyMov: Integrating Motion, Manipulation and Task Planning , 2003 .

[61]  Patrik Haslum,et al.  Cost-Optimal Factored Planning: Promises and Pitfalls , 2010, ICAPS.

[62]  S. Edelkamp,et al.  The Deterministic Part of IPC-4: An Overview , 2005, J. Artif. Intell. Res..

[63]  Malte Helmert,et al.  Concise finite-domain representations for PDDL planning tasks , 2009, Artif. Intell..

[64]  Patrik Haslum,et al.  Minimal Landmarks for Optimal Delete-Free Planning , 2012, ICAPS.

[65]  Austin Tate,et al.  O-Plan2: an Open Architecture for Command, Planning and Control , 2006 .

[66]  Andrew Coles,et al.  A Hybrid LP-RPG Heuristic for Modelling Numeric Resource Flows in Planning , 2014, J. Artif. Intell. Res..

[67]  Patrik Haslum,et al.  Domain-Independent Construction of Pattern Database Heuristics for Cost-Optimal Planning , 2007, AAAI.

[68]  Tom Bylander,et al.  The Computational Complexity of Propositional STRIPS Planning , 1994, Artif. Intell..

[69]  E. Sandewall Features and fluents (vol. 1): the representation of knowledge about dynamical systems , 1995 .

[70]  Bernhard Nebel,et al.  A Planning Based Framework for Controlling Hybrid Systems , 2012, ICAPS.

[71]  Thomas Keller,et al.  Delete Relaxations for Planning with State-Dependent Action Costs , 2015, SOCS.

[72]  Rachid Alami,et al.  A Hybrid Approach to Intricate Motion, Manipulation and Task Planning , 2009, Int. J. Robotics Res..

[73]  Gregory D. Hager,et al.  Sampling-Based Motion and Symbolic Action Planning with geometric and differential constraints , 2010, 2010 IEEE International Conference on Robotics and Automation.

[74]  Austin Tate,et al.  O-Plan: The open Planning Architecture , 1991, Artif. Intell..

[75]  Ivan Serina,et al.  Fast Planning in Domains with Derived Predicates: An Approach Based on Rule-Action Graphs and Local Search , 2005, AAAI.

[76]  Nicola Muscettola,et al.  Next Generation Remote Agent Planner , 1999 .

[77]  Santiago Franco,et al.  Improving performance by reformulating PDDL into a bagged representation , 2016, ICAPS 2016.

[78]  Benedetto Intrigila,et al.  UPMurphi: A Tool for Universal Planning on PDDL+ Problems , 2009, ICAPS.

[79]  Jana Koehler,et al.  Planning under Resource Constraints , 1998, ECAI.

[80]  Bernhard Nebel,et al.  Semantic Attachments for Domain-Independent Planning Systems , 2009, ICAPS.

[81]  J. Christopher Beck,et al.  Planning Modulo Theories: Extending the Planning Paradigm , 2012, ICAPS.

[82]  Maria Fox,et al.  VAL: automatic plan validation, continuous effects and mixed initiative planning using PDDL , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[83]  Patrik Haslum,et al.  Optimal Planning with Axioms , 2015, IJCAI.

[84]  Joachim Hertzberg,et al.  A semi-reactive planner based on a possible models action formalization , 1992 .

[85]  Maria Fox,et al.  Boosting Search Guidance in Problems with Semantic Attachments , 2017, ICAPS.

[86]  Malte Helmert,et al.  Getting the Most Out of Pattern Databases for Classical Planning , 2013, IJCAI.

[87]  Lukás Chrpa,et al.  Efficient Macroscopic Urban Traffic Models for Reducing Congestion: A PDDL+ Planning Approach , 2016, AAAI.

[88]  Leslie Pack Kaelbling,et al.  FFRob: An Efficient Heuristic for Task and Motion Planning , 2015, WAFR.

[89]  Ji-Ae Shin,et al.  Processes and continuous change in a SAT-based planner , 2005, Artif. Intell..