Building Human-Level AI for Real-Time Strategy Games

Video games are complex simulation environments with many real-world properties that need to be addressed in order to build robust intelligence. In particular, realtime strategy games provide a multi-scale challenge which requires both deliberative and reactive reasoning processes. Experts approach this task by studying a corpus of games, building models for anticipating opponent actions, and practicing within the game environment. We motivate the need for integrating heterogeneous approaches by enumerating a range of competencies involved in gameplay and discuss how they are being implemented in EISBot, a reactive planning agent that we have applied to the task of playing real-time strategy games at the same granularity as humans.

[1]  Steve Rabin,et al.  AI Game Programming Wisdom , 2002 .

[2]  Luke Perkins,et al.  Terrain Analysis in Real-Time Strategy Games: An Integrated Approach to Choke Point Detection and Region Decomposition , 2010, AIIDE.

[3]  Pedro Pablo Gómez-Martín,et al.  Extending Case-Based Planning with Behavior Trees , 2011, FLAIRS Conference.

[4]  H. Jaap van den Herik,et al.  Rapid adaptation of video game AI , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[5]  Jeff Orkin,et al.  Three States and a Plan: The A.I. of F.E.A.R. , 2006 .

[6]  John E. Laird,et al.  Human-Level AI's Killer Application: Interactive Computer Games , 2000, AI Mag..

[7]  Barbara Hayes-Roth,et al.  A Blackboard Architecture for Control , 1985, Artif. Intell..

[8]  David W. Aha,et al.  Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game , 2005, Künstliche Intell..

[9]  Andrew Stern,et al.  A Behavior Language for Story-Based Believable Agents , 2002, IEEE Intell. Syst..

[10]  David W. Aha,et al.  Goal-Driven Autonomy in a Navy Strategy Simulation , 2010, AAAI.

[11]  Jeff Orkin,et al.  Applying Goal-Oriented Action Planning to Games , 2008 .

[12]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[13]  Pat Langley,et al.  A Unified Cognitive Architecture for Physical Agents , 2006, AAAI.

[14]  Kenneth D. Forbus,et al.  How qualitative spatial reasoning can improve strategy game AIs , 2002, IEEE Intelligent Systems.

[15]  Michael Mateas,et al.  Towards adaptive programming: integrating reinforcement learning into a programming language , 2008, OOPSLA.

[16]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[17]  Alan Fern,et al.  UCT for Tactical Assault Planning in Real-Time Strategy Games , 2009, IJCAI.

[18]  Arnav Jhala,et al.  A Particle Model for State Estimation in Real-Time Strategy Games , 2011, AIIDE.

[19]  Simon Colton,et al.  Combining AI Methods for Learning Bots in a Real-Time Strategy Game , 2009, Int. J. Comput. Games Technol..

[20]  D. Aha,et al.  Stratagus : An Open-Source Game Engine for Research in Real-Time Strategy Games , 2005 .

[21]  Simon M. Lucas,et al.  Ms Pac-Man competition , 2007, SEVO.

[22]  Santiago Ontañón,et al.  ON‐LINE CASE‐BASED PLANNING , 2010, Comput. Intell..

[23]  Santiago Ontañón,et al.  Using Automated Replay Annotation for Case-Based Planning in Games , 2010 .

[24]  John E. Laird,et al.  SORTS: A Human-Level Approach to Real-Time Strategy AI , 2007, AIIDE.

[25]  Arnav Jhala,et al.  Applying Goal-Driven Autonomy to StarCraft , 2010, AIIDE.

[26]  Darsana P. Josyula.  A Unified Theory Of Acting And Agency For A Universal Interfacing Agent , 2005 .

[27]  Arnav Jhala,et al.  Case-Based Goal Formulation , 2010 .

[28]  Michael Mateas,et al.  An Integrated Agent for Playing Real-Time Strategy Games , 2008, AAAI.

[29]  Michael Buro,et al.  Real-Time Strategy Games: A New AI Research Challenge , 2003, IJCAI.

[30]  Arnav Jhala,et al.  Reactive planning idioms for multi-scale game AI , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.