Learning and Game AI

The incorporation of learning into commercial games can enrich the player experience, but may concern developers in terms of issues such as losing control of their game world. We explore a number of applied research and some fielded applications that point to the tremendous possibilities of machine learning research including game genres such as real-time strategy games, flight simulation games, car and motorcycle racing games, board games such as Go, an even traditional game-theoretic problems such as the prisoners dilemma. A common trait of these works is the potential of machine learning to reduce the burden of game developers. However a number of challenges exists that hinder the use of machine learning more broadly. We discuss some of these challenges while at the same time exploring opportunities for a wide use of machine learning in games.

[1]  Clare Bates Congdon,et al.  REALM: A rule-based evolutionary computation agent that learns to play Mario , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[2]  Jonathan Schaeffer,et al.  A Gamut of Games , 2001, AI Mag..

[3]  Oliver Kramer,et al.  Learning the track and planning ahead in a car racing controller , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[4]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[5]  Kenneth O. Stanley and Bobby D. Bryant and Risto Miikkulainen,et al.  Real-Time Evolution in the NERO Video Game (Winner of CIG 2005 Best Paper Award) , 2005, CIG.

[6]  Dave Cliff,et al.  Creatures: artificial life autonomous software agents for home entertainment , 1997, AGENTS '97.

[7]  Risto Miikkulainen,et al.  Creating intelligent agents through shaping of coevolution , 2011, IEEE Congress on Evolutionary Computation.

[8]  Sushil J. Louis,et al.  Co-Evolving Influence Map Tree Based Strategy Game Players , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[9]  Colin Fyfe,et al.  Improving Artificial Intelligence In a Motocross Game , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[10]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[11]  Kenneth O. Stanley,et al.  Evolving content in the Galactic Arms Race video game , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[12]  Nir Oren,et al.  Evolving Neural Networks for the Capture Game , 2002 .

[13]  Oliver Kramer,et al.  Evolution of Human-Competitive Agents in Modern Computer Games , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[14]  Hector Muñoz-Avila,et al.  RETALIATE: Learning Winning Policies in First-Person Shooter Games , 2007, AAAI.

[15]  Georgios N. Yannakakis,et al.  Evolving opponents for interesting interactive computer games , 2004 .

[16]  Christian Bauckhage,et al.  Learning Human-Like Opponent Behavior for Interactive Computer Games , 2003, DAGM-Symposium.

[17]  Bruce Blumberg,et al.  Integrated learning for interactive synthetic characters , 2002, SIGGRAPH.

[18]  Clare Bates Congdon,et al.  Agent Smith: Towards an evolutionary rule-based agent for interactive dynamic games , 2009, 2009 IEEE Congress on Evolutionary Computation.

[19]  Ivan Tanev,et al.  Evolution of driving agent, remotely operating a scale model of a car with obstacle avoidance capabilities , 2006, GECCO '06.

[20]  Graham Kendall,et al.  Learning versus evolution in iterated prisoner's dilemma , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[21]  Rudolf Kadlec,et al.  Evoluce chovan´õ inteligentn´õch agentû u v poÿc´õtaÿcovych hrach Evolution of intelligent agent behaviour in computer games , 2008 .

[22]  Gifford Cheung,et al.  Starcraft from the stands: understanding the game spectator , 2011, CHI.

[23]  Jeff Orkin,et al.  The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online , 2008, J. Game Dev..

[24]  Sushil J. Louis,et al.  Using a genetic algorithm to tune first-person shooter bots , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[25]  Nicola Beume,et al.  Towards Intelligent Team Composition and Maneuvering in Real-Time Strategy Games , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[26]  Julian Togelius,et al.  Evolving controllers for simulated car racing , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Gerald Tesauro,et al.  Temporal difference learning and TD-Gammon , 1995, CACM.

[28]  Marcus Gallagher,et al.  Reinforcement Learning in First Person Shooter Games , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[29]  Cyril Brom,et al.  Are educational computer micro-games engaging and effective for knowledge acquisition at high-schools? A quasi-experimental study , 2011, Comput. Educ..

[30]  Christian Bauckhage,et al.  Synthesizing Movements for Computer Game Characters , 2004, DAGM-Symposium.

[31]  Gary B. Parker,et al.  The Evolution of Multi-Layer Neural Networks for the Control of Xpilot Agents , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[32]  Clare Bates Congdon,et al.  FRIGHT: A flexible rule-based intelligent ghost team for Ms. Pac-Man , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[33]  Peter J. Bentley,et al.  Optimising the Performance of a Formula One Car Using a Genetic Algorithm , 2004, PPSN.