Towards Challenge Balancing for Personalised Game Spaces

This article focuses on games that can tailor the provided game experience to the individual player (personalised games), typically by effectively utilising player models. A particular challenge in this regard, is utilising player models for assessing online (i.e., while the game is being played) and unobtrusively which game adaptations are appropriate. In this article, we propose an approach for personalising the space in which a game is played (i.e., levels) - to the end of tailoring the experienced challenge to the individual player during actual play of the game. Our approach specically considers two persisting design challenges, namely implicit user feedback and high risk of user abandonment. Our contribution to this end is proposing a clear separation between (intelligent) offine exploration and (safety-conscious) online exploitation. We are presently assessing the effectiveness of the developed approach in an actual video game: Infinite Mario Bros. To this end, we have enhanced the game such that its process for procedural-content generation allows the game spaces (i.e., levels) to be personalised during play of the game. We use data from intelligent oine exploration to determine both a model of experienced challenge as well as safe level design parameters for use on new players. Online, we use a gradient ascent algorithm with designer-specified domain knowledge to select the next set of level design parameters.

[1]  Julian Togelius,et al.  The Mario AI Benchmark and Competitions , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[2]  Michael Mateas,et al.  Rhythm-based level generation for 2D platformers , 2009, FDG.

[3]  Kostas Karpouzis,et al.  A Game-Based Corpus for Analysing the Interplay between Game Context and Player Experience , 2011, ACII.

[4]  Julian Togelius,et al.  Mario AI competition , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[5]  Peter Auer,et al.  Using Confidence Bounds for Exploitation-Exploration Trade-offs , 2003, J. Mach. Learn. Res..

[6]  J. Cacioppo,et al.  Issue involvement can increase or decrease persuasion by enhancing message-relevant cognitive responses. , 1979 .

[7]  Adriano J. de O. Cruz,et al.  Online Coevolution for Action Games , 2002, Int. J. Intell. Games Simul..

[8]  Julian Togelius,et al.  The 2009 Mario AI Competition , 2010, IEEE Congress on Evolutionary Computation.

[9]  Robin Hunicke,et al.  AI for Dynamic Difficulty Adjustment in Games , 2004 .

[10]  I. Sprinkhuizen-Kuyper,et al.  DIFFICULTY SCALING OF GAME AI , 2004 .

[11]  Julian Togelius,et al.  Digging Deeper into Platform Game Level Design: Session Size and Sequential Features , 2012, EvoApplications.

[12]  Mark O. Riedl Scalable personalization of interactive experiences through creative automation , 2010, CIE.

[13]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[14]  Julian Togelius,et al.  Towards multiobjective procedural map generation , 2010, PCGames@FDG.

[15]  Chek Tien Tan,et al.  Personalised gaming: a motivation and overview of literature , 2012, IE '12.

[16]  Darryl Charles,et al.  Player-Centred Game Design: Player Modelling and Adaptive Digital Games , 2005 .

[17]  Pieter Spronck,et al.  Player behavioural modelling for video games , 2012, Entertain. Comput..

[18]  Julian Togelius,et al.  Crowdsourcing the Aesthetics of Platform Games , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  H. J. van den Herik,et al.  Opponent Modelling and Commercial Games , 2005 .

[21]  Georgios N. Yannakakis,et al.  Real-time challenge balance in an RTS game using rtNEAT , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[22]  Sander Bakkes,et al.  Generating Missions and Spaces for Adaptable Play Experiences , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[23]  Julian Togelius,et al.  Modeling player experience in Super Mario Bros , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[24]  William K. Darley,et al.  The effect of consumers' emotional reactions on behavioral intention: The moderating role of personal relevance and self‐monitoring , 1992 .

[25]  Johannes Fürnkranz,et al.  Recent Advances in Machine Learning and Game Playing , 2007 .

[26]  Ching-I Teng,et al.  Customization, immersion satisfaction, and online gamer loyalty , 2010, Comput. Hum. Behav..

[27]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[28]  H. Jaap van den Herik,et al.  Rapid and Reliable Adaptation of Video Game AI , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[29]  Georgios N. Yannakakis,et al.  Preference Learning for Cognitive Modeling: A Case Study on Entertainment Preferences , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.