Player Modeling

Player modeling is the study of computational models of players in games. This includes the detection, modeling, prediction and expression of human player characteristics which are manifested through cognitive, affective and behavioral patterns. This chapter introduces a holistic view of player modeling and provides a high level taxonomy and discussion of the key components of a player’s model. The discussion focuses on a taxonomy of approaches for constructing a player model, the available types of data for the model’s input and a proposed classification for the model’s output. The chapter provides also a brief overview of some promising applications and a discussion of the key challenges player modeling is currently facing which are linked to the input, the output and the computational model. 1998 ACM Subject Classification I.2.1 Applications and Expert Systems: Games

[1]  Jenova Chen,et al.  Flow in games (and everything else) , 2007, CACM.

[2]  Christian Bauckhage,et al.  Learning Human-Like Movement Behavior for Computer Games , 2004 .

[3]  Julian Togelius,et al.  Search-Based Procedural Content Generation , 2010, EvoApplications.

[4]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[5]  I. Sprinkhuizen-Kuyper,et al.  DIFFICULTY SCALING OF GAME AI , 2004 .

[6]  Philippe Pasquier,et al.  Towards a Generic Framework for Automated Video Game Level Creation , 2010, EvoApplications.

[7]  Ruck Thawonmas,et al.  Clustering of Online Game Users Based on Their Trails Using Self-organizing Map , 2006, ICEC.

[8]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[9]  H. Jaap van den Herik,et al.  Games as personality profiling tools , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[10]  Julian Togelius,et al.  Imitating human playing styles in Super Mario Bros , 2013, Entertain. Comput..

[11]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[12]  Daniele Loiacono,et al.  Automatic Track Generation for High-End Racing Games Using Evolutionary Computation , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[13]  Georgios N. Yannakakis,et al.  TOWARDS OPTIMIZING ENTERTAINMENT IN COMPUTER GAMES , 2007, Appl. Artif. Intell..

[14]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[15]  H. Jaap van den Herik,et al.  Opponent modelling for case-based adaptive game AI , 2009, Entertain. Comput..

[16]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[17]  M. Pantic,et al.  Image and Video Processing for Affective Applications , 2011 .

[18]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .

[19]  Katherine Isbister,et al.  Game Usability: Advancing the Player Experience , 2008 .

[20]  K. Scherer.  Studying the emotion-antecedent appraisal process: An expert system approach , 1993 .

[21]  Georgios N. Yannakakis,et al.  Real-time challenge balance in an RTS game using rtNEAT , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[22]  Michael Mateas,et al.  A data mining approach to strategy prediction , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[23]  Risto Miikkulainen,et al.  Believable Bot Navigation via Playback of Human Traces , 2012, Believable Bots.

[24]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[25]  David Thue,et al.  Interactive Storytelling: A Player Modelling Approach , 2007, AIIDE.

[26]  Araceli Sanchis,et al.  Towards Imitation of Human Driving Style in Car Racing Games , 2012, Believable Bots.

[27]  Georgios N. Yannakakis,et al.  Game and Player Feature Selection for Entertainment Capture , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[28]  Georgios N. Yannakakis.  Preference learning for affective modeling , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[29]  Georgios N. Yannakakis,et al.  Towards affective camera control in games , 2010, User Modeling and User-Adapted Interaction.

[30]  Andrea Bonarini,et al.  Modeling enjoyment preference from physiological responses in a car racing game , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[31]  G. Calleja.  In-Game: From Immersion to Incorporation , 2011 .

[32]  Jonathan Frome,et al.  Eight Ways Videogames Generate Emotion , 2007, DiGRA Conference.

[33]  Thomas W. Malone,et al.  What makes things fun to learn? heuristics for designing instructional computer games , 1980, SIGSMALL '80.

[34]  Georgios N. Yannakakis,et al.  Player Modeling Impact on Player's Entertainment in Computer Games , 2005, User Modeling.

[35]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[36]  Nilanjan Sarkar,et al.  Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback , 2005 .

[37]  Julian Togelius,et al.  Adapting Models of Visual Aesthetics for Personalized Content Creation , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[38]  Kenneth O. Stanley,et al.  Evolving content in the Galactic Arms Race video game , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[39]  Vincent Corruble,et al.  Extending Reinforcement Learning to Provide Dynamic Game Balancing , 2005 .

[40]  Hiroyuki Iida,et al.  A metric for entertainment of boardgames: its implication for evolution of chess variants , 2002, IWEC.

[41]  Craig A. Smith,et al.  From appraisal to emotion: Differences among unpleasant feelings , 1988 .

[42]  Julian Togelius,et al.  Predicting player behavior in Tomb Raider: Underworld , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[43]  J. Stainer,et al.  The Emotions , 1922, Nature.

[44]  Thomas Gärtner,et al.  Player Modeling for Intelligent Difficulty Adjustment , 2009, LWA.

[45]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[46]  Georgios N. Yannakakis.  Game AI revisited , 2012, CF '12.

[47]  John Feo,et al.  Proceedings of the 9th conference on Computing Frontiers , 2012 .

[48]  Anne Sullivan,et al.  An inclusive view of player modeling , 2011, FDG.

[49]  A. Ram,et al.  Player Modeling Evaluation for Interactive Fiction , 2007 .

[50]  Stacy Marsella,et al.  Evaluating a Computational Model of Emotion , 2005, Autonomous Agents and Multi-Agent Systems.

[51]  R. Houle.  Player Modeling for Adaptive Games , 2006 .

[52]  Julian Togelius,et al.  Multiobjective exploration of the StarCraft map space , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[53]  H. Jaap van den Herik,et al.  PsyOps: Personality assessment through gaming behavior , 2013, FDG.

[54]  Julian Togelius,et al.  Experience-Driven Procedural Content Generation , 2011, IEEE Transactions on Affective Computing.

[55]  Homayoun Najjaran,et al.  The EMPATHY MACHINE , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[56]  David Thue,et al.  Learning Player Preferences to Inform Delayed Authoring , 2007, AAAI Fall Symposium: Intelligent Narrative Technologies.

[57]  P. Costa,et al.  Domains and facets: hierarchical personality assessment using the revised NEO personality inventory. , 1995, Journal of personality assessment.

[58]  Ana Paiva,et al.  FearNot! - An Experiment in Emergent Narrative , 2005, IVA.

[59]  Darryl Charles,et al.  Dynamic Player Modelling: A Framework for Player-Centered Digital Games , 2004 .

[60]  Kostas Karpouzis,et al.  A Neuro-fuzzy Approach to User Attention Recognition , 2008, ICANN.

[61]  L. Feldman.  Valence Focus and Arousal Focus: Individual Differences in the Structure of Affective Experience , 1995 .

[62]  Julian Togelius,et al.  Game Data Mining , 2013, Game Analytics, Maximizing the Value of Player Data.

[63]  Jussi Holopainen,et al.  Emotional response patterns and sense of presence during video games: potential criterion variables for game design , 2004, NordiCHI '04.

[64]  Armando Barreto,et al.  Non-intrusive Physiological Monitoring for Automated Stress Detection in Human-Computer Interaction , 2007, ICCV-HCI.

[65]  Tim Fields,et al.  Social Game Design: Monetization Methods and Mechanics , 2011 .

[66]  Matthias Rauterberg,et al.  Difficulty Scaling through Incongruity , 2008, AIIDE.

[67]  Georgios N. Yannakakis,et al.  Ranking vs. Preference: A Comparative Study of Self-reporting , 2011, ACII.

[68]  A. Kobsa.  User Modeling : Recent Work , Prospects and Hazards , 1993 .

[69]  Nadia Bianchi-Berthouze,et al.  Continuous Recognition of Player's Affective Body Expression as Dynamic Quality of Aesthetic Experience , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[70]  Christian Bauckhage,et al.  Guns, swords and data: Clustering of player behavior in computer games in the wild , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[71]  Kostas Karpouzis,et al.  Does your profile say it all? Using demographics to predict expressive head movement during gameplay , 2012, UMAP Workshops.

[72]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[74]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[75]  Pieter Spronck,et al.  Quantifying individual player differences , 2008 .

[76]  Kostas Karpouzis,et al.  A Game-Based Corpus for Analysing the Interplay between Game Context and Player Experience , 2011, ACII.

[77]  C. Pelachaud,et al.  Emotion-Oriented Systems: The Humaine Handbook , 2011 .

[78]  Anton Nijholt,et al.  BCI for Games: A 'State of the Art' Survey , 2008, ICEC.

[79]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..