Imitating human playing styles in Super Mario Bros

Abstract We describe and compare several methods for generating game character controllers that mimic the playing style of a particular human player, or of a population of human players, across video game levels. Similarity in playing style is measured through an evaluation framework, that compares the play trace of one or several human players with the punctuated play trace of an AI player. The methods that are compared are either hand-coded, direct (based on supervised learning) or indirect (based on maximising a similarity measure). We find that a method based on neuroevolution performs best both in terms of the instrumental similarity measure and in phenomenological evaluation by human spectators. A version of the classic platform game “Super Mario Bros” is used as the testbed game in this study but the methods are applicable to other games that are based on character movement in space.

[1]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[2]  Christian Bauckhage,et al.  Learning Human-Like Movement Behavior for Computer Games , 2004 .

[3]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[4]  Julian Togelius,et al.  A procedural procedural level generator generator , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[5]  Philip Hingston,et al.  A new design for a Turing Test for Bots , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[6]  Eric O. Postma,et al.  Adaptive game AI with dynamic scripting , 2006, Machine Learning.

[7]  Christian Bauckhage,et al.  Believability Testing and Bayesian Imitation in Interactive Computer Games , 2006, SAB.

[8]  Monty Newborn,et al.  Kasparov versus Deep Blue - computer chess comes of age , 1996 .

[9]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[10]  Philippe Pasquier,et al.  Towards a Generic Framework for Automated Video Game Level Creation , 2010, EvoApplications.

[11]  Julian Togelius,et al.  The Mario AI Benchmark and Competitions , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[12]  Colin Fyfe,et al.  Improving Artificial Intelligence In a Motocross Game , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[13]  Julian Togelius,et al.  The 2010 Mario AI Championship: Level Generation Track , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[14]  Julian Togelius,et al.  The 2009 Mario AI Competition , 2010, IEEE Congress on Evolutionary Computation.

[15]  Michael Mateas,et al.  Procedural level generation using occupancy-regulated extension , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[16]  Julian Togelius,et al.  Assessing Believability , 2012, Believable Bots.

[17]  Julian Togelius,et al.  Measuring Intelligence through Games , 2011, ArXiv.

[18]  Julian Togelius,et al.  Towards Automatic Personalized Content Generation for Platform Games , 2010, AIIDE.

[19]  Julian Togelius,et al.  Super mario evolution , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[20]  Julian Togelius,et al.  Designer Modeling for Personalized Game Content Creation Tools , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[21]  Anthony Brabazon,et al.  Evolving Behaviour Trees for the Mario AI Competition Using Grammatical Evolution , 2011, EvoApplications.

[22]  H. Berliner.  KASPAROV VERSUS DEEP BLUE : COMPUTER CHESS COMES OF AGE , 1998 .

[23]  Computing Machinery and Intelligence Mind Vol. 59 , 2022 .

[24]  Julian Togelius,et al.  Robust player imitation using multiobjective evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[25]  Philip Hingston,et al.  A Turing Test for Computer Game Bots , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[26]  Larry Bull,et al.  Learning Classifier Systems: A Brief Introduction , 2004 .

[27]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[28]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[29]  Julian Togelius,et al.  Evolving controllers for simulated car racing , 2005, 2005 IEEE Congress on Evolutionary Computation.

[30]  Shane Legg,et al.  Universal Intelligence: A Definition of Machine Intelligence , 2007, Minds and Machines.

[31]  Clare Bates Congdon,et al.  REALM: A rule-based evolutionary computation agent that learns to play Mario , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.