A Panorama of Artificial and Computational Intelligence in Games

This paper attempts to give a high-level overview of the field of artificial and computational intelligence (AI/CI) in games, with particular reference to how the different core research areas within this field inform and interact with each other, both actually and potentially. We identify ten main research areas within this field: NPC behavior learning, search and planning, player modeling, games as AI benchmarks, procedural content generation, computational narrative, believable agents, AI-assisted game design, general game artificial intelligence and AI in commercial games. We view and analyze the areas from three key perspectives: 1) the dominant AI method(s) used under each area; 2) the relation of each area with respect to the end (human) user; and 3) the placement of each area within a human-computer (player-game) interaction perspective. In addition, for each of these areas we consider how it could inform or interact with each of the other areas; in those cases where we find that meaningful interaction either exists or is possible, we describe the character of that interaction and provide references to published studies, if any. We believe that this paper improves understanding of the current nature of the game AI/CI research field and the interdependences between its core areas by providing a unifying overview. We also believe that the discussion of potential interactions between research areas provides a pointer to many interesting future research projects and unexplored subfields.

[1]  Julian Togelius,et al.  Computational Game Creativity , 2014, ICCC.

[2]  Michael Mateas,et al.  Tanagra: a mixed-initiative level design tool , 2010, FDG.

[3]  Martin V. Butz,et al.  Search in Real-Time Video Games , 2013, Artificial and Computational Intelligence in Games.

[4]  Julian Togelius,et al.  A Procedural Critique of Deontological Reasoning , 2011, DiGRA Conference.

[5]  Michael Buro,et al.  Real-Time Strategy Game Competitions , 2012, AI Mag..

[6]  Julian Togelius,et al.  Adapting Models of Visual Aesthetics for Personalized Content Creation , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[7]  Julian Togelius,et al.  An experiment in automatic game design , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[8]  Julian Togelius,et al.  Artificial and Computational Intelligence in Games , 2013, Artificial and Computational Intelligence in Games.

[9]  Christian Bauckhage,et al.  Pathfinding in Games , 2013, Artificial and Computational Intelligence in Games.

[10]  Daniele Loiacono,et al.  Interactive evolution for the procedural generation of tracks in a high-end racing game , 2011, GECCO '11.

[11]  Julian Togelius,et al.  The Mario AI Benchmark and Competitions , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[12]  Michael Mateas,et al.  Tanagra: Reactive Planning and Constraint Solving for Mixed-Initiative Level Design , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[13]  Clare Bates Congdon,et al.  REALM: A rule-based evolutionary computation agent that learns to play Mario , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[14]  Kostas Karpouzis,et al.  A Game-Based Corpus for Analysing the Interplay between Game Context and Player Experience , 2011, ACII.

[15]  Michael Mateas,et al.  Variations Forever: Flexibly generating rulesets from a sculptable design space of mini-games , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[16]  Igor Karpov and Leif Johnson and Vinod Valsalam and Ris Miikkulainen Evaluation Methods for Active Human-Guided Neuroevolution in Games , 2012 .

[17]  Julian Togelius,et al.  Ontogenetic and Phylogenetic Reinforcement Learning , 2009, Künstliche Intell..

[18]  Daniel A. Ashlock,et al.  Evolving A Diverse Collection of Robot Path Planning Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[19]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[20]  Simon M. Lucas,et al.  Coevolution versus self-play temporal difference learning for acquiring position evaluation in small-board go , 2005, IEEE Transactions on Evolutionary Computation.

[21]  Simon M. Lucas Computational intelligence and games: Challenges and opportunities , 2008, Int. J. Autom. Comput..

[22]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[23]  Christin Wirth,et al.  Blondie24 Playing At The Edge Of Ai , 2016 .

[24]  Araceli Sanchis,et al.  Towards Imitation of Human Driving Style in Car Racing Games , 2012, Believable Bots.

[25]  Julian Togelius,et al.  The 2007 IEEE CEC simulated car racing competition , 2008, Genetic Programming and Evolvable Machines.

[26]  R. Michael Young,et al.  An architecture for integrating plan-based behavior generation with interactive game environments , 2004, J. Game Dev..

[27]  Nathan R. Sturtevant,et al.  Benchmarks for Grid-Based Pathfinding , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[28]  Jordan B. Pollack,et al.  Coevolution of a Backgammon Player , 1996 .

[29]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[30]  Ingo Althöfer,et al.  Automatic Generation and Evaluation of Recombination Games , 2010, J. Int. Comput. Games Assoc..

[31]  Risto Miikkulainen,et al.  General Video Game Playing , 2013, Artificial and Computational Intelligence in Games.

[32]  Michael Sellers,et al.  Good moods: outlook, affect and mood in dynemotion and the mind module , 2008, Future Play.

[33]  Risto Miikkulainen,et al.  Coevolving Strategies for General Game Playing , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[34]  Graham Nelson,et al.  NATURAL LANGUAGE, SEMANTIC ANALYSIS AND INTERACTIVE FICTION , 2006 .

[35]  Julian Togelius,et al.  Robust player imitation using multiobjective evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[36]  Julian Togelius,et al.  The 2009 Simulated Car Racing Championship , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[37]  Julian Togelius,et al.  The turing test track of the 2012 Mario AI Championship: Entries and evaluation , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[38]  Yngvi Björnsson,et al.  CadiaPlayer: A Simulation-Based General Game Player , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[39]  Tom Schaul,et al.  A video game description language for model-based or interactive learning , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[40]  Mary P. Harper,et al.  VACE Multimodal Meeting Corpus , 2005, MLMI.

[41]  Julian Togelius,et al.  Towards Automatic Personalized Content Generation for Platform Games , 2010, AIIDE.

[42]  Shane Legg,et al.  Universal Intelligence: A Definition of Machine Intelligence , 2007, Minds and Machines.

[43]  Georgios N. Yannakakis,et al.  Towards affective camera control in games , 2010, User Modeling and User-Adapted Interaction.

[44]  Santiago Ontañón,et al.  Case-Based Planning and Execution for Real-Time Strategy Games , 2007, ICCBR.

[45]  Lakhmi C. Jain,et al.  Computational Intelligence in Games , 2005, IEEE Transactions on Neural Networks.

[46]  Jonathan Schaeffer,et al.  Checkers Is Solved , 2007, Science.

[47]  Michael Mateas,et al.  Answer Set Programming for Procedural Content Generation: A Design Space Approach , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[48]  Julian Togelius,et al.  The Mario AI Championship , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[49]  P. Hingston Believable Bots: Can Computers Play Like People? , 2012 .

[50]  Risto Miikkulainen,et al.  A Neuroevolution Approach to General Atari Game Playing , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[51]  Daniele Loiacono,et al.  Computational intelligence in games , 2012, GECCO '12.

[52]  Ana Paiva,et al.  FearNot! - An Experiment in Emergent Narrative , 2005, IVA.

[53]  Ana Paiva,et al.  Caring for agents and agents that care: building empathic relations with synthetic agents , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[54]  Marc G. Bellemare,et al.  The Arcade Learning Environment: An Evaluation Platform for General Agents , 2012, J. Artif. Intell. Res..

[55]  Juan Julián Merelo Guervós,et al.  Solving Master Mind Using GAs and Simulated Annealing: A Case of Dynamic Constraint Optimization , 1996, PPSN.

[56]  Julian Togelius,et al.  Designer Modeling for Personalized Game Content Creation Tools , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[57]  Georgios N. Yannakakis,et al.  Generic Physiological Features as Predictors of Player Experience , 2011, ACII.

[58]  Adam M. Smith,et al.  An Inclusive Taxonomy of Player Modeling , 2011 .

[59]  Fred Charles,et al.  Planning formalisms and authoring in interactive storytelling , 2003 .

[60]  James Babcock,et al.  Artificial General Intelligence , 2016, Lecture Notes in Computer Science.

[61]  Simon M. Lucas,et al.  Ms Pac-Man competition , 2007, SEVO.

[62]  Marc Cavazza,et al.  Character-Based Interactive Storytelling , 2002, IEEE Intell. Syst..

[63]  Philip Hingston,et al.  A Turing Test for Computer Game Bots , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[64]  Risto Miikkulainen,et al.  UT2: Human-like behavior via neuroevolution of combat behavior and replay of human traces , 2011, CIG.

[65]  Sung-Bae Cho,et al.  Hybrid of Evolution and Reinforcement Learning for Othello Players , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[66]  Mark O. Riedl,et al.  Toward supporting stories with procedurally generated game worlds , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[67]  Simon Colton,et al.  Evolving Behaviour Trees for the Commercial Game DEFCON , 2010, EvoApplications.

[68]  Hector Muñoz-Avila,et al.  Learning and Game AI , 2013, Artificial and Computational Intelligence in Games.

[69]  Randall W. Hill,et al.  Toward Virtual Humans , 2006, AI Mag..

[70]  Michael Mateas,et al.  LUDOCORE: A logical game engine for modeling videogames , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[71]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[72]  Sushil J. Louis,et al.  Evolving coordinated spatial tactics for autonomous entities using influence maps , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[73]  Julian Togelius,et al.  The Mario AI Championship 2009-2012 , 2013, AI Mag..

[74]  Risto Miikkulainen,et al.  Believable Bot Navigation via Playback of Human Traces , 2012, Believable Bots.

[75]  Mike Preuss,et al.  Automatic adaptation to generated content via car setup optimization in TORCS , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[76]  Jichen Zhu,et al.  Towards story-based content generation: From plot-points to maps , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[77]  Julian Togelius,et al.  The 2010 Mario AI Championship: Level Generation Track , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[78]  Julian Togelius,et al.  The 2009 Mario AI Competition , 2010, IEEE Congress on Evolutionary Computation.

[79]  Richard Evans,et al.  Versu—A Simulationist Storytelling System , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[80]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[81]  Simon M. Lucas,et al.  Cellz: a simple dynamic game for testing evolutionary algorithms , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[82]  Anne Auger,et al.  Comparing results of 31 algorithms from the black-box optimization benchmarking BBOB-2009 , 2010, GECCO '10.

[83]  Julian Togelius,et al.  Assessing Believability , 2012, Believable Bots.

[84]  Randall W. Hill,et al.  Toward a New Generation of Virtual Humans for Interactive Experiences , 2002, IEEE Intell. Syst..

[85]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[86]  Tzung-Pei Hong,et al.  The Computational Intelligence of MoGo Revealed in Taiwan's Computer Go Tournaments , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[87]  Rafael Bidarra,et al.  Procedural Generation of Dungeons , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[88]  Barney Pell,et al.  Strategy Generation and Evaluation for Meta-Game Playing , 2011, KI - Künstliche Intelligenz.

[89]  Simon M. Lucas,et al.  The physical travelling salesman problem: WCCI 2012 competition , 2012, 2012 IEEE Congress on Evolutionary Computation.

[90]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[91]  Mark O. Riedl,et al.  AI for game production , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[92]  Kenneth O. Stanley,et al.  Automatic Content Generation in the Galactic Arms Race Video Game , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[93]  Christian Bauckhage,et al.  Learning Human-Like Movement Behavior for Computer Games , 2004 .

[94]  Philip Hingston,et al.  Bots trained to play like a human are more fun , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[95]  Julian Togelius,et al.  Imitating human playing styles in Super Mario Bros , 2013, Entertain. Comput..

[96]  H. Jaap van den Herik,et al.  Rapid and Reliable Adaptation of Video Game AI , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[97]  Julian Togelius,et al.  Game Data Mining , 2013, Game Analytics, Maximizing the Value of Player Data.

[98]  Jeff Orkin,et al.  The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online , 2008, J. Game Dev..

[99]  Mark Steedman,et al.  APML, a Markup Language for Believable Behavior Generation , 2004, Life-like characters.

[100]  Santiago Ontañón,et al.  A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[101]  Rafael Bidarra,et al.  Interactive Creation of Virtual Worlds Using Procedural Sketching , 2010, Eurographics.

[102]  Michael Mateas,et al.  Prom week , 2012, AIIDE.

[103]  Michael Mateas,et al.  Search-Based Drama Management in the Interactive Fiction Anchorhead , 2005, AIIDE.

[104]  Risto Miikkulainen,et al.  Efficient Non-linear Control Through Neuroevolution , 2006, ECML.

[105]  Julian Togelius,et al.  Procedural Content Generation: Goals, Challenges and Actionable Steps , 2013, Artificial and Computational Intelligence in Games.

[106]  Julian Togelius,et al.  Measuring Intelligence through Games , 2011, ArXiv.

[107]  Julian Togelius,et al.  A procedural procedural level generator generator , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[108]  Anthony Brabazon,et al.  Evolving Behaviour Trees for the Mario AI Competition Using Grammatical Evolution , 2011, EvoApplications.

[109]  Ana Paiva,et al.  My dream theatre , 2013, AAMAS.

[110]  Gerald Tesauro,et al.  Temporal Difference Learning and TD-Gammon , 1995, J. Int. Comput. Games Assoc..

[111]  Andrew Stern,et al.  Believable Agents and Intelligent Story Adaptation for Interactive Storytelling , 2006, TIDSE.

[112]  Julian Togelius,et al.  Evolving Playable Content for Cut the Rope through a Simulation-Based Approach , 2013, AIIDE.

[113]  Xiaodong Li,et al.  A survey of procedural terrain generation techniques using evolutionary algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[114]  Julian Togelius,et al.  Experience-Driven Procedural Content Generation , 2011, IEEE Transactions on Affective Computing.

[115]  Michael Buro,et al.  Build Order Optimization in StarCraft , 2011, AIIDE.

[116]  Julian Togelius,et al.  Modelling and evaluation of complex scenarios with the Strategy Game Description Language , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[117]  Simon M. Lucas,et al.  Coevolving Game-Playing Agents: Measuring Performance and Intransitivities , 2013, IEEE Transactions on Evolutionary Computation.

[118]  Julian Togelius,et al.  Towards a Video Game Description Language , 2013, Artificial and Computational Intelligence in Games.

[119]  Georgios N. Yannakakis,et al.  Generating Narrative Action Schemas for Suspense , 2012, INT@AIIDE.

[120]  Ana Paiva,et al.  Emotion in Games , 2011, ACII.

[121]  Vadim Bulitko,et al.  Interactive Narrative: A Novel Application of Artificial Intelligence for Computer Games , 2012, AAAI.

[122]  Julian Togelius,et al.  Predicting player behavior in Tomb Raider: Underworld , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[123]  Julian Togelius,et al.  Towards the automatic generation of card games through grammar-guided genetic programming , 2013, FDG.

[124]  Julian Togelius,et al.  Sentient World: Human-Based Procedural Cartography - An Experiment in Interactive Sketching and Iterative Refining , 2013, EvoMUSART.

[125]  Rafael Bidarra,et al.  In Press: Ieee Transactions on Computational Intelligence and Ai in Games Adaptivity Challenges in Games and Simulations: a Survey , 2022 .

[126]  Daniele Loiacono,et al.  Player Modeling , 2013, Artificial and Computational Intelligence in Games.

[127]  Georgios N. Yannakakis Game AI revisited , 2012, CF '12.

[128]  Georgios N. Yannakakis,et al.  Combining local and global optimisation for virtual camera control , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[129]  Joel Lehman,et al.  Combining Search-Based Procedural Content Generation and Social Gaming in the Petalz Video Game , 2012, AIIDE.

[130]  Julian Togelius,et al.  A comparative evaluation of procedural level generators in the Mario AI framework , 2014, FDG.

[131]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[132]  Graham Kendall,et al.  Mobile games with intelligence: A killer application? , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[133]  Julian Togelius,et al.  Artificial and Computational Intelligence in Games (Dagstuhl Seminar 12191) , 2012, Dagstuhl Reports.

[134]  Monroe Newborn Computer Chess , 2003 .

[135]  S.M. Lucas,et al.  Evolutionary computation and games , 2006, IEEE Computational Intelligence Magazine.

[136]  David L. Roberts,et al.  Learning to Influence Emotional Responses for Interactive Storytelling , 2009, AAAI Spring Symposium: Intelligent Narrative Technologies II.

[137]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.