Experience-Driven Procedural Content Generation

Procedural content generation (PCG) is an increasingly important area of technology within modern human-computer interaction (HCI) design. Personalization of user experience via affective and cognitive modeling, coupled with real-time adjustment of the content according to user needs and preferences are important steps toward effective and meaningful PCG. Games, Web 2.0, interface, and software design are among the most popular applications of automated content generation. The paper provides a taxonomy of PCG algorithms and introduces a framework for PCG driven by computational models of user experience. This approach, which we call Experience-Driven Procedural Content Generation (EDPCG), is generic and applicable to various subareas of HCI. We employ games as an example indicative of rich HCI and complex affect elicitation, and demonstrate the approach's effectiveness via dissimilar successful studies.

[1]  Loïc Kessous,et al.  Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis , 2010, Journal on Multimodal User Interfaces.

[2]  Noël Carroll,et al.  Mimesis as Make-Beleive@@@Mimesis as Make-Believe: On the Foundations of the Representational Arts. , 1995 .

[3]  Katherine Isbister,et al.  Game Usability: Advancing the Player Experience , 2008 .

[4]  Franz Rothlauf,et al.  Representations for genetic and evolutionary algorithms , 2002, Studies in Fuzziness and Soft Computing.

[5]  Peter J. Bentley,et al.  Three Ways to Grow Designs: A Comparison of Embryogenies for an Evolutionary Design Problem , 1999, GECCO.

[6]  Georgios N. Yannakakis,et al.  Real-time challenge balance in an RTS game using rtNEAT , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[7]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[8]  Elisabeth André,et al.  Emotion Recognition Using Physiological and Speech Signal in Short-Term Observation , 2006, PIT.

[9]  Kenneth O. Stanley,et al.  Evolving content in the Galactic Arms Race video game , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[10]  Julian Togelius,et al.  Multiobjective exploration of the StarCraft map space , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[11]  Julian Togelius,et al.  Search-Based Procedural Content Generation , 2010, EvoApplications.

[12]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[13]  Vincent Corruble,et al.  Extending Reinforcement Learning to Provide Dynamic Game Balancing , 2005 .

[14]  Eyke Hllermeier,et al.  Preference Learning , 2010 .

[15]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[16]  Andrew Lim,et al.  Evolving 3D Buildings for the Prototype Video Game Subversion , 2010, EvoApplications.

[17]  Petra Sundström,et al.  Exploring the Affective Loop , 2005 .

[18]  Guillaume Chanel,et al.  Boredom, engagement and anxiety as indicators for adaptation to difficulty in games , 2008, MindTrek '08.

[19]  Ana Paiva,et al.  An Affectively Driven Planner for Synthetic Characters , 2006, ICAPS.

[20]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[21]  Kostas Karpouzis,et al.  A Neuro-fuzzy Approach to User Attention Recognition , 2008, ICANN.

[22]  C.G. Pereira,et al.  Creativity and Artificial Intelligence: A Conceptual Blending Approach , 2007 .

[23]  Eva Hudlicka,et al.  Affective game engines: motivation and requirements , 2009, FDG.

[24]  Cameron Browne,et al.  Automatic generation and evaluation of recombination games , 2008 .

[25]  L. Feldman.  Valence Focus and Arousal Focus: Individual Differences in the Structure of Affective Experience , 1995 .

[26]  Philippe Pasquier,et al.  Towards a Generic Framework for Automated Video Game Level Creation , 2010, EvoApplications.

[27]  A. Lindenmayer.  Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[28]  Matthias Rauterberg,et al.  Difficulty Scaling through Incongruity , 2008, AIIDE.

[29]  M. Pantic,et al.  Image and Video Processing for Affective Applications , 2011 .

[30]  Georgios N. Yannakakis,et al.  Towards affective camera control in games , 2010, User Modeling and User-Adapted Interaction.

[31]  Andrea Bonarini,et al.  Modeling enjoyment preference from physiological responses in a car racing game , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[32]  Julian Togelius,et al.  Modeling player experience in Super Mario Bros , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[33]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[34]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[35]  Mark O. Riedl,et al.  Story Planning with Vignettes: Toward Overcoming the Content Production Bottleneck , 2008, ICIDS.

[36]  Regan L. Mandryk,et al.  Physiological indicators for the evaluation of co-located collaborative play , 2004, CSCW.

[37]  Georgios N. Yannakakis,et al.  Real-Time Game Adaptation for Optimizing Player Satisfaction , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[38]  K. Scherer.  Studying the emotion-antecedent appraisal process: An expert system approach , 1993 .

[39]  Michael Mateas,et al.  A data mining approach to strategy prediction , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[40]  James C. Lester,et al.  Predicting User Physiological Response for Interactive Environments: An Inductive Approach , 2006, AIIDE.

[41]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[42]  T. L. Taylor,et al.  Book Review: T.L. Taylor, Play Between WorldS: Exploring Online Game Culture. Cambridge, MA: MIT Press, 2006. vii+197 pp. ISBN 0262201631, $29.95 hbk , 2007, New Media Soc..

[43]  Armando Barreto,et al.  Non-intrusive Physiological Monitoring for Automated Stress Detection in Human-Computer Interaction , 2007, ICCV-HCI.

[44]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[45]  David Thue,et al.  Interactive Storytelling: A Player Modelling Approach , 2007, AIIDE.

[46]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[47]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[49]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[50]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Michael Mateas,et al.  Authoring Interactive Narratives with Declarative Optimization-Based Drama Management , 2006, AIIDE.

[52]  Georgios N. Yannakakis,et al.  Correlation between heart rate, electrodermal activity and player experience in first-person shooter games , 2010, Sandbox '10.

[53]  Daniel A. Ashlock,et al.  Automatic generation of game elements via evolution , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[54]  Rafael Bidarra,et al.  Integrating procedural generation and manual editing of virtual worlds , 2010, PCGames@FDG.

[55]  Gregory S. Hornby,et al.  The advantages of generative grammatical encodings for physical design , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[56]  Rosalind W. Picard.  Affective Computing , 1997 .

[57]  C. Pelachaud,et al.  Emotion-Oriented Systems: The Humaine Handbook , 2011 .

[58]  Georgios N. Yannakakis,et al.  Fantasy, curiosity and challenge as adaptation indicators in multimodal dialogue systems for preschoolers , 2009, WOCCI.

[59]  Anton Nijholt,et al.  BCI for Games: A 'State of the Art' Survey , 2008, ICEC.

[60]  Patrick G. Xavier,et al.  Preparing for the aftermath: Using emotional agents in game-based training for disaster response , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[61]  Gavin S. P. Miller,et al.  The definition and rendering of terrain maps , 1986, SIGGRAPH.

[62]  Julian Togelius,et al.  Towards Automatic Personalized Content Generation for Platform Games , 2010, AIIDE.

[63]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[64]  Alessandro Canossa,et al.  Towards gameplay analysis via gameplay metrics , 2009, MindTrek '09.

[65]  Lennart E. Nacke,et al.  The neurobiology of play , 2010, Future Play.

[66]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[67]  Julian Togelius,et al.  Siren: Towards adaptive serious games for teaching conflict resolution , 2010 .

[68]  Jon Doyle,et al.  Prospects for Preferences , 2004, Comput. Intell..

[69]  Georgios N. Yannakakis,et al.  Investigating the Interplay between Camera Viewpoints, Game Information, and Challenge , 2009, AIIDE.

[70]  Georgios N. Yannakakis,et al.  TOWARDS OPTIMIZING ENTERTAINMENT IN COMPUTER GAMES , 2007, Appl. Artif. Intell..

[71]  Stacy Marsella,et al.  Evaluating a Computational Model of Emotion , 2005, Autonomous Agents and Multi-Agent Systems.

[72]  Georgios N. Yannakakis,et al.  Analyzing the impact of camera viewpoint on player psychophysiology , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[73]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[74]  Joe Marks,et al.  Automatic Design of Balanced Board Games , 2007, AIIDE.

[75]  Georgios N. Yannakakis,et al.  Player Modeling Impact on Player's Entertainment in Computer Games , 2005, User Modeling.

[76]  Georgios N. Yannakakis,et al.  Towards Capturing and Enhancing Entertainment in Computer Games , 2006, SETN.

[77]  Hiroyuki Iida,et al.  A metric for entertainment of boardgames: its implication for evolution of chess variants , 2002, IWEC.

[78]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[79]  Thomas Gärtner,et al.  Player Modeling for Intelligent Difficulty Adjustment , 2009, LWA.

[80]  Georgios N. Yannakakis.  Preference learning for affective modeling , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[81]  Georgios N. Yannakakis,et al.  Preference Learning for Cognitive Modeling: A Case Study on Entertainment Preferences , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[82]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[83]  Julian Togelius,et al.  Towards multiobjective procedural map generation , 2010, PCGames@FDG.

[84]  Georgios N. Yannakakis,et al.  Entertainment capture through heart rate activity in physical interactive playgrounds , 2008, User Modeling and User-Adapted Interaction.

[85]  Przemyslaw Prusinkiewicz,et al.  Graphical applications of L-systems , 1986 .

[86]  Yun-Gyung Cheong,et al.  A Computational Model of Narrative Generation for Suspense , 2006, AAAI.

[87]  Christian Bauckhage,et al.  Learning Human-Like Movement Behavior for Computer Games , 2004 .

[88]  Kristina Höök,et al.  In situ informants exploring an emotional mobile messaging system in their everyday practice , 2007, Int. J. Hum. Comput. Stud..

[89]  Georgios N. Yannakakis,et al.  Genetic search feature selection for affective modeling: a case study on reported preferences , 2010, AFFINE '10.

[90]  Changchun Liu,et al.  An empirical study of machine learning techniques for affect recognition in human–robot interaction , 2006, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[91]  Georgios N. Yannakakis,et al.  Towards procedural level generation for rehabilitation , 2010, PCGames@FDG.

[92]  Stefanos Kollias,et al.  A natural head pose and eye gaze dataset , 2009, AFFINE '09.

[93]  Michael Mateas,et al.  Variations Forever: Flexibly generating rulesets from a sculptable design space of mini-games , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[94]  Carlos Martinho,et al.  Closing the loop: from affect recognition to empathic interaction , 2010, AFFINE '10.

[95]  Thomas W. Malone,et al.  What makes things fun to learn? heuristics for designing instructional computer games , 1980, SIGSMALL '80.

[96]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[97]  Nilanjan Sarkar,et al.  Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback , 2005 .

[98]  Julian Togelius,et al.  An experiment in automatic game design , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[99]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[100]  Jesper Juul,et al.  A Casual Revolution: Reinventing Video Games and Their Players , 2009 .

[101]  Ruck Thawonmas,et al.  Clustering of Online Game Users Based on Their Trails Using Self-organizing Map , 2006, ICEC.

[102]  Chris Bateman,et al.  21st Century Game Design , 2005 .