Reactive planning idioms for multi-scale game AI

Many modern games provide environments in which agents perform decision making at several levels of granularity. In the domain of real-time strategy games, an effective agent must make high-level strategic decisions while simultaneously controlling individual units in battle. We advocate reactive planning as a powerful technique for building multi-scale game AI and demonstrate that it enables the specification of complex, real-time agents in a unified agent architecture. We present several idioms used to enable authoring of an agent that concurrently pursues strategic and tactical goals, and an agent for playing the real-time strategy game StarCraft that uses these design patterns.

[1]  Jeff Orkin,et al.  Three States and a Plan: The A.I. of F.E.A.R. , 2006 .

[2]  Marco Antonio Gómez-Martín,et al.  Dynamic Expansion of Behaviour Trees , 2008, AIIDE.

[3]  Aaron Bryan Loyall,et al.  Believable agents: building interactive personalities , 1997 .

[4]  Michael Mateas,et al.  An Integrated Agent for Playing Real-Time Strategy Games , 2008, AAAI.

[5]  John E. Laird,et al.  Using a Computer Game to Develop Advanced AI , 2001, Computer.

[6]  Pat Langley,et al.  A Unified Cognitive Architecture for Physical Agents , 2006, AAAI.

[7]  Andrew Stern,et al.  A Behavior Language for Story-Based Believable Agents , 2002, IEEE Intell. Syst..

[8]  Sushil J. Louis,et al.  Co-Evolving Influence Map Tree Based Strategy Game Players , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[9]  Pat Langley,et al.  A Believable Agent for First-Person Shooter Games , 2007, AIIDE.

[10]  Bruce Blumberg,et al.  A Layered Brain Architecture for Synthetic Creatures , 2001, IJCAI.

[11]  David W. Aha,et al.  Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game , 2005, Künstliche Intell..

[12]  Jonathan Schaeffer,et al.  Monte Carlo Planning in RTS Games , 2005, CIG.

[13]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[14]  Jaime G. Carbonell,et al.  Interactive drama, art and artificial intelligence , 2002 .

[15]  John E. Laird,et al.  SORTS: A Human-Level Approach to Real-Time Strategy AI , 2007, AIIDE.

[16]  Hector Muñoz-Avila,et al.  Hierarchical Plan Representations for Encoding Strategic Game AI , 2005, AIIDE.

[17]  Sung-Bae Cho,et al.  Optimal strategy selection of non-player character on real time strategy game using a speciated evolutionary algorithm , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[18]  Michael Mateas,et al.  Conceptual Neighborhoods for Retrieval in Case-Based Reasoning , 2009, ICCBR.