Personalized procedural map generation in games via evolutionary algorithms

In digital games, the map (sometimes referred to as the level) is the virtual environment that outlines the boundaries of play, aids in establishing rule systems, and supports the narrative. It also directly influences the challenges that a player will experience and the pace of gameplay, a property that has previously been linked to a player's enjoyment of a game [1]. In most industry leading games, creating maps is a lengthy manual process conducted by highly trained teams of designers. However, for many decades procedural content generation (PCG) techniques have posed as an alternative to provide players with a larger range of experiences than would normally be possible. In recent years, PCG has even been proposed as a means of tailoring game content to meet the preferences and skills of a specific player, in what has been termed Experience-driven PCG (EDPCG) [2].

[1]  Bracha Shapira,et al.  Recommender Systems Handbook , 2015, Springer US.

[2]  Ben Medler,et al.  Using Recommendation Systems to Adapt Gameplay , 2009, Int. J. Gaming Comput. Mediat. Simulations.

[3]  Georgios N. Yannakakis,et al.  Global search for occlusion minimisation in virtual camera control , 2010, IEEE Congress on Evolutionary Computation.

[4]  Carlos Cotta,et al.  Evolution of artificial terrains for video games based on obstacles edge length , 2010, IEEE Congress on Evolutionary Computation.

[5]  Xiaodong Li,et al.  A survey of procedural terrain generation techniques using evolutionary algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[6]  James M. Rehg,et al.  Terrain Synthesis from Digital Elevation Models , 2007, IEEE Transactions on Visualization and Computer Graphics.

[7]  Julian Togelius,et al.  Experience-Driven Procedural Content Generation , 2011, IEEE Transactions on Affective Computing.

[8]  Daniel A. Ashlock,et al.  Search-Based Procedural Generation of Maze-Like Levels , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[9]  Andrew Lim,et al.  Evolving 3D Buildings for the Prototype Video Game Subversion , 2010, EvoApplications.

[10]  Manolya Kavakli,et al.  The Game Master , 2005 .

[11]  Adam M. Smith,et al.  An Inclusive Taxonomy of Player Modeling , 2011 .

[12]  Samir Akkouche,et al.  Feature based terrain generation using diffusion equation , 2010, Comput. Graph. Forum.

[13]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[14]  Michael Buro,et al.  RTS Games and Real-Time AI Research , 2003 .

[15]  Michael J. Pazzani,et al.  User Modeling for Adaptive News Access , 2000, User Modeling and User-Adapted Interaction.

[16]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[17]  Chek Tien Tan,et al.  Personalised gaming: a motivation and overview of literature , 2012, IE '12.

[18]  Jenova Chen,et al.  Flow in games (and everything else) , 2007, CACM.

[19]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[20]  Hugh McCabe,et al.  A Survey of Procedural Techniques for City Generation , 2006 .

[21]  Ian Parberry,et al.  Computerized Clutter : How to Make a Virtual Room Look Lived-in , 2010 .

[22]  Ian Horswill,et al.  Fast Procedural Level Population with Playability Constraints , 2012, AIIDE.

[23]  James Bennett,et al.  The Netflix Prize , 2007 .

[24]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[25]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[26]  Sander Bakkes,et al.  Generating Missions and Spaces for Adaptable Play Experiences , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[27]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[28]  Kenneth O. Stanley,et al.  Exploiting Open-Endedness to Solve Problems Through the Search for Novelty , 2008, ALIFE.

[29]  Carlos Cotta,et al.  Breeding Terrains with Genetic Terrain Programming: The Evolution of Terrain Generators , 2009, Int. J. Comput. Games Technol..

[30]  Risto Miikkulainen,et al.  Real-Time Evolution of Neural Networks in the NERO Video Game , 2006, AAAI.

[31]  Rafael Bidarra,et al.  A Proposal for a Procedural Terrain Modelling Framework , 2008, EGVE.

[32]  Xiaodong Li,et al.  Neuroevolution of content layout in the PCG: Angry bots video game , 2013, 2013 IEEE Congress on Evolutionary Computation.

[33]  Kenneth O. Stanley,et al.  Evolving content in the Galactic Arms Race video game , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[34]  Daniele Loiacono,et al.  Interactive evolution for the procedural generation of tracks in a high-end racing game , 2011, GECCO '11.

[35]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[36]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[37]  Ares Lagae,et al.  Geometry synthesis by example , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[38]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: The (, )-Theory , 1994, Evolutionary Computation.

[39]  J. Olsen Realtime Procedural Terrain Generation , 2004 .

[40]  David W. Aha,et al.  Automatically Acquiring Domain Knowledge For Adaptive Game AI Using Evolutionary Learning , 2005, AAAI.

[41]  Ian Parberry,et al.  Controlled Procedural Terrain Generation Using Software Agents , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[42]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[43]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[44]  Noah Wardrip-Fruin,et al.  Polymorph: dynamic difficulty adjustment through level generation , 2010, PCGames@FDG.

[45]  Michael Mateas,et al.  Launchpad: A Rhythm-Based Level Generator for 2-D Platformers , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[46]  Nilanjan Sarkar,et al.  Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback , 2005 .

[47]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[48]  Julian Togelius,et al.  Modeling player experience in Super Mario Bros , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[49]  Masataka Goto,et al.  An Efficient Hybrid Music Recommender System Using an Incrementally Trainable Probabilistic Generative Model , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[50]  Julian Togelius,et al.  Adapting Models of Visual Aesthetics for Personalized Content Creation , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[51]  Carlos Cotta,et al.  Bio-inspired Combinatorial Optimization: Notes on Reactive and Proactive Interaction , 2011, IWANN.

[52]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[53]  Robin Hunicke,et al.  The case for dynamic difficulty adjustment in games , 2005, ACE '05.

[54]  Julian Togelius,et al.  An experiment in automatic game design , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[55]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[56]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[57]  Philippe Pasquier,et al.  Towards a Generic Framework for Automated Video Game Level Creation , 2010, EvoApplications.

[58]  Chinchen Chang,et al.  TERRAIN SYNTHESIS : AN INTERACTIVE APPROACH , 2004 .

[59]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[60]  Sandra Lowe,et al.  Measurement And Assessment In Teaching , 2016 .

[61]  Hong Yu,et al.  A sequential recommendation approach for interactive personalized story generation , 2012, AAMAS.

[62]  Shlomo Berkovsky,et al.  Recommender algorithms in activity motivating games , 2010, RecSys '10.

[63]  Rafael Bidarra,et al.  A Survey of Procedural Methods for Terrain Modelling , 2009 .

[64]  David Thue,et al.  Interactive Storytelling: A Player Modelling Approach , 2007, AIIDE.

[65]  C. Cotta,et al.  Adding Zoom Feature to Terrain Programmes , 2008 .

[66]  Thomas Hofmann,et al.  TrueSkill™: A Bayesian Skill Rating System , 2007 .

[67]  Raymond J. Mooney,et al.  Content-boosted collaborative filtering for improved recommendations , 2002, AAAI/IAAI.

[68]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[69]  S. Jamieson Likert scales: how to (ab)use them , 2004, Medical education.

[70]  R. Grissom,et al.  Effect Sizes for Research : Univariate and Multivariate Applications, Second Edition , 2005 .

[71]  David M. Pennock,et al.  Probabilistic Models for Unified Collaborative and Content-Based Recommendation in Sparse-Data Environments , 2001, UAI.

[72]  Pedro M. Domingos,et al.  Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier , 1996, ICML.

[73]  Michael Nitsche Designing Procedural Game Spaces : A Case Study , 2006 .

[74]  Paul Merrell,et al.  Example-based model synthesis , 2007, SI3D.

[75]  Rafael Bidarra,et al.  Interactive GPU-based procedural heightfield brushes , 2009, FDG.

[76]  Georgios N. Yannakakis,et al.  Correlation between heart rate, electrodermal activity and player experience in first-person shooter games , 2010, Sandbox '10.

[77]  Xiaodong Li,et al.  Evolving patch-based terrains for use in video games , 2011, GECCO '11.

[78]  Luiz Chaimowicz,et al.  Player modeling: Towards a common taxonomy , 2011, 2011 16th International Conference on Computer Games (CGAMES).

[79]  Donald S. Fussell,et al.  Computer rendering of stochastic models , 1982, Commun. ACM.

[80]  Elaine Rich,et al.  User Modeling via Stereotypes , 1998, Cogn. Sci..

[81]  Carlos Cotta,et al.  Evolution of Artificial Terrains for Video Games Based on Accessibility , 2010, EvoApplications.

[82]  Greg Turk,et al.  Geometric texture synthesis by example , 2004, SGP '04.

[83]  Edward Byrne Game Level Design , 2004 .

[84]  A. Lindenmayer Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[85]  Eric Galin,et al.  Arches: a Framework for Modeling Complex Terrains , 2009, Comput. Graph. Forum.

[86]  Nathaniel Good,et al.  Naïve filterbots for robust cold-start recommendations , 2006, KDD '06.

[87]  Julian Togelius,et al.  Enhancements to constrained novelty search: two-population novelty search for generating game content , 2013, GECCO '13.

[88]  Carlos Cotta,et al.  Modelling Video Games' Landscapes by Means of Genetic Terrain Programming - A New Approach for Improving Users' Experience , 2008, EvoWorkshops.

[89]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[90]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[91]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[92]  Sanford Labovitz,et al.  Some Observations on Measurement and Statistics , 1967 .

[93]  Ryan Saunders,et al.  Terrain generation using genetic algorithms , 2005, GECCO '05.

[94]  M. Csíkszentmihályi,et al.  Beyond Boredom and Anxiety: The Experience of Play in Work and Games. , 1977 .

[95]  Victor Ciesielski,et al.  Evolving images for entertainment , 2007, IE '07.

[96]  E. James Whitehead,et al.  Design patterns in FPS levels , 2010, FDG.

[97]  Daniel G. Aliaga,et al.  Interactive example-based urban layout synthesis , 2008, SIGGRAPH 2008.

[98]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[99]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[100]  Nicholas J. Belkin,et al.  Information filtering and information retrieval: two sides of the same coin? , 1992, CACM.

[101]  Gillian Smith,et al.  Analyzing the expressive range of a level generator , 2010, PCGames@FDG.

[102]  Ute Fischer,et al.  Supporting wayfinding through patterns within procedurally generated virtual environments , 2008, Sandbox '08.

[103]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[104]  K. Raiyan Kamal,et al.  Parametrically controlled terrain generation , 2007, GRAPHITE '07.

[105]  D. Ashlock,et al.  Embryogenesis of Artificial Landscapes , 2008 .

[106]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[107]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[108]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[109]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[110]  Julian Togelius,et al.  Evolving Interesting Maps for a First Person Shooter , 2011, EvoApplications.

[111]  Stefan Greuter,et al.  Real-time procedural generation of `pseudo infinite' cities , 2003, GRAPHITE '03.

[112]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[113]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[114]  David Thue,et al.  Learning Player Preferences to Inform Delayed Authoring , 2007, AAAI Fall Symposium: Intelligent Narrative Technologies.

[115]  Robin Hunicke,et al.  AI for Dynamic Difficulty Adjustment in Games , 2004 .

[116]  Holger Breithaupt,et al.  Beyond the horizon , 2003, EMBO reports.

[117]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[118]  Rafael Bidarra,et al.  In Press: Ieee Transactions on Computational Intelligence and Ai in Games Adaptivity Challenges in Games and Simulations: a Survey , 2022 .

[119]  Philip Hingston,et al.  A new design for a Turing Test for Bots , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[120]  DAVID G. KENDALL,et al.  Introduction to Mathematical Statistics , 1947, Nature.

[121]  Arnav Jhala,et al.  Applying Goal-Driven Autonomy to StarCraft , 2010, AIIDE.

[122]  Toby Howard,et al.  Introducing Clutter Into Virtual Environments , .

[123]  Mark O. Riedl,et al.  A Temporal Data-Driven Player Model for Dynamic Difficulty Adjustment , 2012, AIIDE.

[124]  Michael J. Pazzani,et al.  Learning and Revising User Profiles: The Identification of Interesting Web Sites , 1997, Machine Learning.

[125]  Paul Walsh,et al.  The use of an aesthetic measure for the evolution of fractal landscapes , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[126]  Daniel A. Ashlock,et al.  Evolution of L-systems for compact virtual landscape generation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[127]  H. Cramér Mathematical Methods of Statistics (PMS-9), Volume 9 , 1946 .

[128]  Guillaume Chanel,et al.  Boredom, engagement and anxiety as indicators for adaptation to difficulty in games , 2008, MindTrek '08.

[129]  Thomas W. Malone,et al.  What Makes Things Fun to Learn? A Study of Intrinsically Motivating Computer Games. , 1981 .

[130]  F. Kenton Musgrave,et al.  The synthesis and rendering of eroded fractal terrains , 1989, SIGGRAPH.

[131]  William W. Cohen,et al.  Recommendation as Classification: Using Social and Content-Based Information in Recommendation , 1998, AAAI/IAAI.

[132]  Lars Schmidt-Thieme,et al.  Learning optimal ranking with tensor factorization for tag recommendation , 2009, KDD.