An investigation into the use of evolutionary algorithms for fully automated planning

This thesis presents a new approach to the Artificial Intelligence (AI) problem of fully automated planning. Planning is the act of deliberation before acting that guides rational behaviour and is a core area of AI. Many practical real-world problems can be classed as planning problems, therefore practical and theoretical developments in AI planning are well motivated. Unfortunately, planning for even “toy” domains is hard, many different search algorithms have been proposed, and new approaches are actively encouraged. The approach taken in this thesis is to adopt ideas from Evolutionary Algorithms (EAs) and apply the techniques to fully automated plan synthesis. EA methods have enjoyed great success in many problem areas of AI. They are a new kind of search technique that have their foundation in evolution. Previous attempts to apply EAs to plan synthesis have promised encouraging results, but have been ad-hoc and piecemeal. This thesis thoroughly investigates the approach of applying evolutionary search to the fully automated planning problem. This is achieved by developing and modifying a proof of concept planner called GENPLAN. Before EA-based systems can be used, a thorough examination of various parameter settings must be explored. Once this was completed, the performance of GENPLAN was evaluated using a selection of benchmark domains and other competition style planners. The difficulties raised by the benchmark domains and the extent to which they cause problems for the approach are highlighted along with problems associated with EA search. Modifications are proposed and experimented with in an attempt to alleviate some of the identified problems. EAs offer a flexible framework for fully automated planning, but demonstrate a clear weakness across a range of currently used benchmark domains for plan synthesis.

[1]  M. Fox,et al.  The 3rd International Planning Competition: Results and Analysis , 2003, J. Artif. Intell. Res..

[2]  Thomas Bäck,et al.  An Overview of Evolutionary Computation , 1993, ECML.

[3]  Bart Selman,et al.  Noise Strategies for Improving Local Search , 1994, AAAI.

[4]  Dan C. Marinescu,et al.  A genetic approach to planning in heterogeneous computing environments , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[5]  Philippe Morignot,et al.  Genetic Planning Using Variable Length Chromosomes , 2005, ICAPS.

[6]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[7]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[8]  Gopal Kanji,et al.  100 Statistical Tests , 1994 .

[9]  Riccardo Poli,et al.  Foundations of Genetic Programming , 1999, Springer Berlin Heidelberg.

[10]  Malte Helmert,et al.  Complexity results for standard benchmark domains in planning , 2003, Artif. Intell..

[11]  Mary Sue Younger,et al.  Handbook for linear regression , 1979 .

[12]  Blai Bonet,et al.  Planning as Heuristic Search: New Results , 1999, ECP.

[13]  Daniel S. Weld An Introduction to Least Commitment Planning , 1994, AI Mag..

[14]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[15]  Derek Long,et al.  Planning with numeric variables in multiobjective planning , 2004 .

[16]  Håkan L. S. Younes,et al.  VHPOP: Versatile Heuristic Partial Order Planner , 2003, J. Artif. Intell. Res..

[17]  Hector J. Levesque,et al.  A New Method for Solving Hard Satisfiability Problems , 1992, AAAI.

[18]  Subbarao Kambhampati,et al.  Reviving Partial Order Planning , 2001, IJCAI.

[19]  Graham Kendall,et al.  A Survey And Analysis Of Diversity Measures In Genetic Programming , 2002, GECCO.

[20]  Sean Luke,et al.  A survey and comparison of tree generation algorithms , 2001 .

[21]  C. Darwin On the Origin of Species by Means of Natural Selection: Or, The Preservation of Favoured Races in the Struggle for Life , 2019 .

[22]  Conor Ryan,et al.  Grammatical Evolution , 2001, Genetic Programming Series.

[23]  John Levine,et al.  Learning Action Strategies for Planning Domains Using Genetic Programming , 2003, EvoWorkshops.

[24]  Simon Handley,et al.  The automatic generation of plans for a mobile robot via genetic programming with automatically defined functions , 1994 .

[25]  John K. Slaney,et al.  Blocks World revisited , 2001, Artif. Intell..

[26]  Riccardo Poli,et al.  Schema Theory for Genetic Programming with One-Point Crossover and Point Mutation , 1997, Evolutionary Computation.

[27]  Daniel S. Weld,et al.  UCPOP: A Sound, Complete, Partial Order Planner for ADL , 1992, KR.

[28]  Eugene Fink,et al.  Integrating planning and learning: the PRODIGY architecture , 1995, J. Exp. Theor. Artif. Intell..

[29]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[30]  Christopher R. Stephens,et al.  Schemata Evolution and Building Blocks , 1999, Evolutionary Computation.

[31]  W. J. Conover,et al.  Practical Nonparametric Statistics , 1972 .

[32]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[33]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[34]  Applying Genetic Algorithms to Hierarchical Task Network Planning , 2000 .

[35]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[36]  John R. Koza,et al.  Evolving Modules in Genetic Programming by Subtree Encapsulation , 2001, EuroGP.

[37]  Pedro Isasi Viñuela,et al.  Using genetic programming to learn and improve control knowledge , 2002, Artif. Intell..

[38]  M. Fox,et al.  Efficient Implementation of the Plan Graph in STAN , 2011, J. Artif. Intell. Res..

[39]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[40]  John Levine,et al.  Investigation of Different Seeding Strategies in a Genetic Planner , 2001, EvoWorkshops.

[41]  Blai Bonet,et al.  The AIPS-98 Planning Competition , 2000, AI Mag..

[42]  Bart Selman,et al.  Pushing the Envelope: Planning, Propositional Logic and Stochastic Search , 1996, AAAI/IAAI, Vol. 2.

[43]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[44]  Lee Spector,et al.  Genetic Programming and AI Planning Systems , 1994, AAAI.

[45]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[46]  Austin Tate Intelligible AI Planning — Generating Plans Represented as a Set of Constraints , 2001 .

[47]  Oren Etzioni,et al.  Explanation-Based Learning: A Problem Solving Perspective , 1989, Artif. Intell..

[48]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[49]  Maria Fox,et al.  Automatic Synthesis and Use of Generic Types in Planning , 2000, AIPS.

[50]  John Levine,et al.  Numeric briefcase domain metric optimisation using an EA , 2004 .

[51]  Maria Fox,et al.  STAN4: A Hybrid Planning Strategy Based on Subproblem Abstraction , 2001, AI Mag..

[52]  Bart Selman,et al.  Unifying SAT-based and Graph-based Planning , 1999, IJCAI.

[53]  Austin Tate,et al.  O-Plan: The open Planning Architecture , 1991, Artif. Intell..

[54]  Sean Luke,et al.  Fighting Bloat with Nonparametric Parsimony Pressure , 2002, PPSN.

[55]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[56]  Jeffrey M. Bradshaw,et al.  Intelligent Agents for Coalition Search and Rescue Task Support , 2004, AAAI.

[57]  Hector Geffner,et al.  Heuristic Planning with Time and Resources , 2014 .

[58]  W. Mendenhall,et al.  Statistics for engineering and the sciences , 1984 .

[59]  Tom Bylander,et al.  The Computational Complexity of Propositional STRIPS Planning , 1994, Artif. Intell..

[60]  Bart Selman,et al.  Planning as Satisfiability , 1992, ECAI.

[61]  Jeremy Frank,et al.  When Gravity Fails: Local Search Topology , 1997, J. Artif. Intell. Res..

[62]  E. Dahlman,et al.  A Critical Assessment of Benchmark Comparison in Planning , 2002, J. Artif. Intell. Res..

[63]  Maria Fox,et al.  An examination of resources in planning , 2000 .

[64]  John N. Hooker,et al.  Testing heuristics: We have it all wrong , 1995, J. Heuristics.

[65]  Alastair Smith,et al.  How not to do it , 2005 .

[66]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[67]  Dan C. Marinescu,et al.  Planning with Recursive Subgoals , 2004, KES.

[68]  Maria Fox,et al.  Exploiting a Graphplan Framework in Temporal Planning , 2003, ICAPS.

[69]  J. Levine,et al.  GenPlan " : Combining Genetic Programming and Planning C , 2000 .

[70]  Dana S. Nau,et al.  Computer Bridge - A Big Win for AI Planning , 1998, AI Mag..

[71]  John Levine,et al.  Apollo 13: a challenge domain for the planning community , 2003 .

[72]  William B. Langdon,et al.  Seeding Genetic Programming Populations , 2000, EuroGP.

[73]  Ion Muslea,et al.  SINERGY: A Linear Planner Based on Genetic Programming , 1997, ECP.

[74]  Mykel J. Kochenderfer Evolving Hierarchical and Recursive Teleo-reactive Programs through Genetic Programming , 2003, EuroGP.

[75]  Subbarao Kambhampati,et al.  Extracting Effective and Admissible State Space Heuristics from the Planning Graph , 2000, AAAI/IAAI.

[76]  Bernhard Nebel,et al.  Extending Planning Graphs to an ADL Subset , 1997, ECP.

[77]  P. Pandurang Nayak,et al.  Remote Agent: To Boldly Go Where No AI System Has Gone Before , 1998, Artif. Intell..

[78]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[79]  Craig A. Knoblock,et al.  PDDL-the planning domain definition language , 1998 .

[80]  Mauricio G. C. Resende,et al.  Designing and reporting on computational experiments with heuristic methods , 1995, J. Heuristics.

[81]  Maria Fox,et al.  The Automatic Inference of State Invariants in TIM , 1998, J. Artif. Intell. Res..

[82]  Michael J. Crawley,et al.  Statistical Computing: An Introduction to Data Analysis using S-Plus , 2002 .

[83]  Terry Jones,et al.  Crossover, Macromutationand, and Population-Based Search , 1995, ICGA.

[84]  S.J.J. Smith,et al.  Empirical Methods for Artificial Intelligence , 1995 .

[85]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .