Building a Planner: A Survey of Planning Systems Used in Commercial Video Games

In the last decade, many commercial video games have used planners instead of classical behavior trees or finite state machines to define agent behaviors. Planners allow looking ahead in time and can prevent some problems of purely reactive systems. Furthermore, some of them allow coordination of multiple agents. However, implementing a planner for highly dynamic environments such as video games is a difficult task. This paper aims to provide an overview of different elements of planners and the problems that developers might have when dealing with them. We identify the major areas of plan creation and execution, trying to guide developers through the process of implementing a planner and discuss possible solutions for problems that may arise in the following areas: environment, planning domain, goals, agents, actions, plan creation, and plan execution processes. Giving insights into multiple commercial games, we show different possibilities of solving such problems and discuss which solutions are better suited under specific circumstances, and why some academic approaches find a limited application in the context of commercial titles.

[1]  Kalyanmoy Deb,et al.  Multiobjective optimization , 1997 .

[2]  Yue Cao,et al.  Total-Order Planning with Partially Ordered Subtasks , 2001, IJCAI.

[3]  Jim Blythe,et al.  An Overview of Planning Under Certainty , 1999, Artificial Intelligence Today.

[4]  Juan Fernández-Olivares,et al.  Efficiently Handling Temporal Knowledge in an HTN Planner , 2006, ICAPS.

[5]  Hussein A. Abbass,et al.  A Survey of Learning Classifier Systems in Games [Review Article] , 2017, IEEE Computational Intelligence Magazine.

[6]  Dana S. Nau,et al.  Current Trends in Automated Planning , 2007, AI Mag..

[7]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[8]  Michael A. Leece.  Unsupervised Learning of HTNs in Complex Adversarial Domains , 2016, AAAI.

[9]  Leslie Pack Kaelbling,et al.  Backward-forward search for manipulation planning , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Hector Muñoz-Avila,et al.  Learning Methods to Generate Good Plans: Integrating HTN Learning and Reinforcement Learning , 2010, AAAI.

[11]  Sabrina Eberhart,et al.  Common Lisp The Language , 2016 .

[12]  H. Skubch.  Improving Believability by Leveraging Rule-Based AI , 2022 .

[13]  Jeff Orkin,et al.  Applying Goal-Oriented Action Planning to Games , 2008 .

[14]  Ron Alterovitz,et al.  Robot Planning in the Real World: Research Challenges and Opportunities , 2016, AI Mag..

[15]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[16]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[17]  Troy Humphreys.  Exploring HTN Planners through Example , 2019 .

[18]  David E. Wilkins,et al.  Practical planning - extending the classical AI planning paradigm , 1989, Morgan Kaufmann series in representation and reasoning.

[19]  Michael Mateas,et al.  Case-Based Reasoning for Build Order in Real-Time Strategy Games , 2009, AIIDE.

[20]  Petter Ögren,et al.  Towards Blended Reactive Planning and Acting using Behavior Trees , 2016, 2019 International Conference on Robotics and Automation (ICRA).

[21]  Santiago Ontañón,et al.  Case-Based Planning and Execution for Real-Time Strategy Games , 2007, ICCBR.

[22]  Eric Jacopin,et al.  Game AI Planning Analytics: The Case of Three First-Person Shooters , 2014, AIIDE.

[23]  Jeff Orkin,et al.  Agent Architecture Considerations for Real-Time Planning in Games , 2005, AIIDE.

[24]  Ronen I. Brafman,et al.  Planning with Concurrent Interacting Actions , 1997, AAAI/IAAI.

[25]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[26]  Marco Aiello,et al.  An Overview of Hierarchical Task Network Planning , 2014, ArXiv.

[27]  Melvin Fitting,et al.  First-Order Logic and Automated Theorem Proving , 1990, Graduate Texts in Computer Science.

[28]  Hector Muñoz-Avila,et al.  SHOP: Simple Hierarchical Ordered Planner , 1999, IJCAI.

[29]  Peter Gorniak,et al.  SquadSmart: Hierarchical Planning and Coordinated Plan Execution for Squads of Characters , 2007, AIIDE.

[30]  Hector Muñoz-Avila,et al.  Learning hierarchical task network domains from partially observed plan traces , 2014, Artif. Intell..