Exploring Game Space of Minimal Action Games via Parameter Tuning and Survival Analysis

Game designers can use computer-aided game design methods to model how players may experience the perceived difficulty of a game. We present methods to generate and analyze the difficulty of a wide variety of minimal action game variants throughout game space, where each point in this abstract design space represents a unique game variant. Focusing on a parameterized version of Flappy Bird, we predict hazard rates and difficulty curves using automatic playtesting, Monte Carlo simulation, a player model based on human motor skills (precision and actions per second), and survival analysis of score histograms. We demonstrate our techniques using simulated game play and actual game data from over 106 million play sessions of a popular online Flappy Bird variant, showing quantitative reasons why balancing a game for a wide range of player skill can be difficult. Some applications of our techniques include searching for a specific difficulty, game space visualization, computational creativity to find unique variants, and tuning game balance to adjust the difficulty curve even when game parameters are time varying, score dependent, or changing based on game progress.

[1]  Anne Sullivan,et al.  An inclusive view of player modeling , 2011, FDG.

[2]  Manuel Próspero dos Santos,et al.  Difficulty in action based challenges: success prediction, players' strategies and profiling , 2014, Advances in Computer Entertainment.

[3]  Nirmal Puwar,et al.  Space invaders , 2004 .

[4]  Julian Togelius,et al.  Computational Game Creativity , 2014, ICCC.

[5]  Camp,et al.  Flappy Bird 早夭的肥鸟 , 2014 .

[6]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[7]  J. Togelius,et al.  Discovering Unique Game Variants , 2015 .

[8]  Simon Colton,et al.  Multi-faceted evolution of simple arcade games , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[9]  W. H. Teichner Recent studies of simple reaction time. , 1954, Psychological bulletin.

[10]  Julian Togelius,et al.  An experiment in automatic game design , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[11]  James R. Lee,et al.  Understanding Game Balance with Quantitative Methods , 2013 .

[12]  Julian Togelius,et al.  Experience-Driven Procedural Content Generation , 2011, IEEE Trans. Affect. Comput..

[13]  Jesse Schell,et al.  The Art of Game Design: A book of lenses , 2019 .

[14]  B. Marx The Visual Display of Quantitative Information , 1985 .

[15]  Andrew Nealen,et al.  Exploring Game Space Using Survival Analysis , 2015, FDG.

[16]  Andy Nealen,et al.  Comparing Player Skill, Game Variants, and Learning Rates Using Survival Analysis , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[17]  Norman E. Lane,et al.  Skill Acquisition Rates and Patterns , 1987 .

[18]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[19]  Terri Gullickson The Creative Mind: Myths and Mechanisms. , 1995 .

[20]  Murray Campbell,et al.  Deep Blue , 2002, Artif. Intell..

[21]  Geraint A. Wiggins,et al.  A preliminary framework for description, analysis and comparison of creative systems , 2006, Knowl. Based Syst..

[22]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[23]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[24]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[25]  Alessandro Canossa,et al.  Towards gameplay analysis via gameplay metrics , 2009, MindTrek '09.

[26]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[27]  R. Hyman Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[28]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[29]  Joe Marks,et al.  Automatic Design of Balanced Board Games , 2007, AIIDE.

[30]  Ron Salmonson,et al.  Space invaders. , 2011, The New York state dental journal.

[31]  Andy Nealen,et al.  Towards minimalist game design , 2011, FDG.

[32]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[33]  Christian Bauckhage,et al.  How players lose interest in playing a game: An empirical study based on distributions of total playing times , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[34]  Stéphane Natkin,et al.  Measuring the level of difficulty in single player video games , 2011, Entertain. Comput..

[35]  Lawrence M Leemis,et al.  Univariate Distribution Relationships , 2008 .

[36]  Michael Mateas,et al.  Procedural Level Design for Platform Games , 2006, AIIDE.

[37]  Andy Nealen,et al.  A Statistical Analysis of Player Improvement and Single-Player High Scores , 2016, DiGRA/FDG.

[38]  Michael Mateas,et al.  Variations Forever: Flexibly generating rulesets from a sculptable design space of mini-games , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[39]  R. Magill Motor learning and control : concepts and applications , 2004 .

[40]  Robin Hunicke,et al.  AI for Dynamic Difficulty Adjustment in Games , 2004 .

[41]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[42]  Elisa Lee,et al.  Statistical Methods for Survival Data Analysis: Lee/Survival Data Analysis , 2003 .

[43]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[44]  Frédéric Maire,et al.  Evolutionary Game Design , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[45]  David Ardia,et al.  DEoptim: An R Package for Global Optimization by Differential Evolution , 2009 .

[46]  Yuichi Sato,et al.  Evaluating Human-like Behaviors of Video-Game Agents Autonomously Acquired with Biological Constraints , 2013, Advances in Computer Entertainment.

[47]  Jeffrey G. Gray,et al.  Learnable programming , 2017, Commun. ACM.

[48]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[49]  Wu-chi Feng,et al.  A traffic characterization of popular on-line games , 2005, IEEE/ACM Transactions on Networking.

[50]  Kenneth O. Stanley,et al.  Exploiting Open-Endedness to Solve Problems Through the Search for Novelty , 2008, ALIFE.

[51]  Mark O. Riedl,et al.  Automatic playtesting for game parameter tuning via active learning , 2019, FDG.

[52]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[53]  Mark J. Nelson Game Metrics Without Players: Strategies for Understanding Game Artifacts , 2011, Artificial Intelligence in the Game Design Process.

[54]  Georgios N. Yannakakis,et al.  Real-Time Game Adaptation for Optimizing Player Satisfaction , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[55]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[56]  Thomas Gärtner,et al.  Player Modeling for Intelligent Difficulty Adjustment , 2009, LWA.

[57]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[58]  Eric O. Postma,et al.  Adaptive game AI with dynamic scripting , 2006, Machine Learning.

[59]  Robert E. Mercer,et al.  A methodological approach to identifying and quantifying video game difficulty factors , 2014, Entertain. Comput..

[60]  Julian Togelius,et al.  Towards Automatic Personalized Content Generation for Platform Games , 2010, AIIDE.

[61]  Antonios Liapis,et al.  Mixed-initiative co-creativity , 2014, FDG.