Symbolic discrete-time planning with continuous numeric action parameters for agent-controlled processes

Abstract In industrial domains such as manufacturing control, a trend away from centralized planning and scheduling towards more flexible distributed agent-based approaches could be observed over recent years. To be of practical relevance, the local control mechanisms of the autonomous agents must be able to dependably adhere and dynamically adjust to complex numeric goal systems like business key performance indicators in an economically beneficial way. However, planning with numeric state variables and objectives still poses a challenging task within the field of artificial intelligence (AI). In this article, a new general-purpose AI planning approach is presented that operates in two stages and extends existing domain-independent modeling formalisms like PDDL with continuous (i.e., infinite-domain) numeric action parameters, which are currently still unsupported by state-of-the-art AI planners. In doing so, it enables the solution of mathematical optimization problems at the action level of the planning tasks, which are inherent to many real-world control problems. To deal with certain difficulties concerning reliable and fast detection of action applicability that arise when planning with real-valued action parameters, the implemented planner allows resorting to an adjustable “satisficing” strategy by means of partial execution and subsequent repair of infeasible plans over the course of time. The functioning of the system is evaluated in a multi-agent simulation of a shop floor control scenario with focus on the effects the possible problem cases and different degrees of satisficing have on attained plan quality and total planning time. As the results demonstrate the basic practicability of the approach for the given setting, this contribution constitutes an important step towards the effective and dependable integration of complex numeric goal systems and non-linear multi-criteria optimization tasks into autonomous agent-controlled industrial processes in a reusable, domain-independent way.

[1]  Derek Long,et al.  Plan Constraints and Preferences in PDDL3 , 2006 .

[2]  Enrico Giunchiglia,et al.  Partially Grounded Planning as Quantified Boolean Formula , 2013, ICAPS.

[3]  Arne Schuldt,et al.  Multiagent Coordination Enabling Autonomous Logistics , 2011, KI - Künstliche Intelligenz.

[4]  Jan D. Gehrke,et al.  An Agent-based Approach to Autonomous Logistic Processes , 2010, KI - Künstliche Intelligenz.

[5]  Till Becker,et al.  A classification pattern for autonomous control methods in logistics , 2010, Logist. Res..

[6]  Blai Bonet,et al.  Heuristics for Cost-Optimal Classical Planning Based on Linear Programming , 2015, IJCAI.

[7]  Jan D. Gehrke,et al.  Towards Ontology-Based Multiagent Simulations: The Plasma Approach , 2010, ECMS.

[8]  Dana S. Nau,et al.  On the Use of Integer Programming Models in AI Planning , 1999, IJCAI.

[9]  Abdul Sattar,et al.  SAT-Based Parallel Planning Using a Split Representation of Actions , 2009, ICAPS.

[10]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[11]  Matthias Ehrgott,et al.  Multicriteria Optimization , 2005 .

[12]  X. Yi On Automatic Differentiation , 2005 .

[13]  Andrew Coles,et al.  COLIN: Planning with Continuous Linear Numeric Change , 2012, J. Artif. Intell. Res..

[14]  Maria Fox,et al.  Validating Plans in the Context of Processes and Exogenous Events , 2005, AAAI.

[15]  Otthein Herzog,et al.  Planning with Numeric Key Performance Indicators over Dynamic Organizations of Intelligent Agents , 2014, MATES.

[16]  Subbarao Kambhampati,et al.  Planning Graph as a (Dynamic) CSP: Exploiting EBL, DDB and other CSP Search Techniques in Graphplan , 2000, J. Artif. Intell. Res..

[17]  Jussi Rintanen,et al.  Numeric State Variables in Constraint-Based Planning , 1999, ECP.

[18]  Subbarao Kambhampati,et al.  Planning as constraint satisfaction: Solving the planning graph by compiling it into CSP , 2001, Artif. Intell..

[19]  Patrik Haslum,et al.  Optimal Planning with Global Numerical State Constraints , 2014, ICAPS.

[20]  Guillaume Melquiond,et al.  The design of the Boost interval arithmetic library , 2006, Theor. Comput. Sci..

[21]  Daniel S. Weld,et al.  UCPOP: A Sound, Complete, Partial Order Planner for ADL , 1992, KR.

[22]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[23]  R. Baker Kearfott,et al.  Introduction to Interval Analysis , 2009 .

[24]  Otthein Herzog,et al.  Distributed Key Figure Optimization Approaches for Global Goal Coordination in Multi-agent Systems for Production Control , 2014 .

[25]  Bart Selman,et al.  Planning as Satisfiability , 1992, ECAI.

[26]  Hector Geffner,et al.  Solving Simple Planning Problems with More Inference and No Search , 2005, CP.

[27]  Toby Walsh,et al.  Handbook of Constraint Programming , 2006, Handbook of Constraint Programming.

[28]  Daniel S. Weld,et al.  Temporal Planning with Continuous Change , 1994, AAAI.

[29]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[30]  Malte Helmert,et al.  Decidability and Undecidability Results for Planning with Numerical State Variables , 2002, PuK.

[31]  Florian Pommerening,et al.  Linear programming for heuristics in optimal planning , 2015 .

[32]  Malte Helmert,et al.  Understanding Planning Tasks: Domain Complexity and Heuristic Decomposition , 2008, Lecture Notes in Computer Science.

[33]  Subbarao Kambhampati,et al.  A Theory of Intra-Agent Replanning , 2013 .

[34]  Hector Geffner,et al.  Branching and pruning: An optimal temporal POCL planner based on constraint programming , 2004, Artif. Intell..

[35]  J. Penberthy Planning with continuous change , 1993 .

[36]  Ingo J. Timm,et al.  Flexible Process Planning and Production Control Using Co-Operative Agent Systems , 2001 .

[37]  Frédéric Benhamou,et al.  Continuous and Interval Constraints , 2006, Handbook of Constraint Programming.

[38]  Edmund M. Clarke,et al.  Symbolic Model Checking: 10^20 States and Beyond , 1990, Inf. Comput..

[39]  Jörg Hoffmann,et al.  On the Instantiation of ADL Operators Involving Arbitrary First-Order Formulas , 2000, PuK.

[40]  Weiming Shen,et al.  Agent-based distributed manufacturing process planning and scheduling: a state-of-the-art survey , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[41]  Michael Wooldridge,et al.  Multiagent Systems for Manufacturing Control: A Design Methodology , 2010 .

[42]  Jörg Hoffmann,et al.  The Metric-FF Planning System: Translating ''Ignoring Delete Lists'' to Numeric State Variables , 2003, J. Artif. Intell. Res..

[43]  R. E. Wengert,et al.  A simple automatic derivative evaluation program , 1964, Commun. ACM.

[44]  Frédéric Benhamou,et al.  Algorithm 852: RealPaver: an interval solver using constraint satisfaction techniques , 2006, TOMS.

[45]  Henry A. Kautz,et al.  State-space Planning by Integer Optimization , 1999, AAAI/IAAI.

[46]  Daniel S. Weld,et al.  The LPSAT Engine & Its Application to Resource Planning , 1999, IJCAI.

[47]  Drew McDermott Reasoning about Autonomous Processes in an Estimated-Regression Planner , 2003, ICAPS.

[48]  Fahiem Bacchus,et al.  Using temporal logics to express search control knowledge for planning , 2000, Artif. Intell..

[49]  A. Neumaier Interval methods for systems of equations , 1990 .

[50]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[51]  Ingo J. Timm,et al.  Capability-based emerging organization of autonomous agents for flexible production control , 2006, Adv. Eng. Informatics.

[52]  Bart Selman,et al.  Unifying SAT-based and Graph-based Planning , 1999, IJCAI.

[53]  Jeremy Frank,et al.  Constraint-Based Attribute and Interval Planning , 2003, Constraints.

[54]  Bernhard Nebel,et al.  In Defense of PDDL Axioms , 2003, IJCAI.

[55]  Maria Fox,et al.  Automated Planning and Model Checking (Dagstuhl Seminar 14482) , 2014, Dagstuhl Reports.

[56]  Florian Pantke,et al.  Intelligent Agent Control and Coordination with User-Configurable Key Performance Indicators , 2009, LDIC.

[57]  J. Christopher Beck,et al.  Planning Modulo Theories: Extending the Planning Paradigm , 2012, ICAPS.

[58]  Otthein Herzog,et al.  Combinatorial Planning with Numerical Parameter Optimization for Local Control in Multi-agent Systems , 2014 .

[59]  Olvi L. Mangasarian,et al.  Exact penalty functions in nonlinear programming , 1979, Math. Program..

[60]  Maria Fox,et al.  Heuristic Evaluation Based on Lifted Relaxed Planning Graphs , 2014, ICAPS.

[61]  Lihui Wang,et al.  Process planning and scheduling for distributed manufacturing , 2007 .

[62]  Ivan Serina,et al.  An approach to efficient planning with numerical fluents and multi-criteria plan quality , 2008, Artif. Intell..

[63]  H. Simon,et al.  Theories of Decision-Making in Economics and Behavioural Science , 1966 .

[64]  Ingo J. Timm,et al.  Integrated Process Planning and Production Control , 2006 .

[65]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[66]  Eldon Hansen,et al.  Global optimization using interval analysis , 1992, Pure and applied mathematics.

[67]  Stefan Edelkamp,et al.  Generalizing the Relaxed Planning Heuristic to Non-linear Tasks , 2004, KI.

[68]  Huaxin Liu,et al.  Modelling dynamic bottlenecks in production networks , 2011, Int. J. Comput. Integr. Manuf..

[69]  Vitaliy Feoktistov Differential Evolution: In Search of Solutions , 2006 .

[70]  Ilkka Niemelä,et al.  Planning as satisfiability: parallel plans and algorithms for plan search , 2006, Artif. Intell..

[71]  Benedetto Intrigila,et al.  UPMurphi: A Tool for Universal Planning on PDDL+ Problems , 2009, ICAPS.

[72]  Jana Koehler,et al.  Planning under Resource Constraints , 1998, ECAI.

[73]  Uwe Naumann,et al.  Automatic Differentiation: Applications, Theory, and Implementations (Lecture Notes in Computational Science and Engineering) , 2006 .

[74]  Maria Fox,et al.  Modelling Mixed Discrete-Continuous Domains for Planning , 2006, J. Artif. Intell. Res..