Real-time rule-based classification of player types in computer games

The power of using machine learning to improve or investigate the experience of play is only beginning to be realised. For instance, the experience of play is a psychological phenomenon, yet common psychological concepts such as the typology of temperaments have not been widely utilised in game design or research. An effective player typology provides a model by which we can analyse player behaviour. We present a real-time classifier of player type, implemented in the test-bed game Pac-Man. Decision Tree algorithms CART and C5.0 were trained on labels from the DGD player typology (Bateman and Boon, 21st century game design, vol. 1, 2005). The classifier is then built by selecting rules from the Decision Trees using a rule- performance metric, and experimentally validated. We achieve ~70% accuracy in this validation testing. We further analyse the concept descriptions learned by the Decision Trees. The algorithm output is examined with respect to a set of hypotheses on player behaviour. A set of open questions is then posed against the test data obtained from validation testing, to illustrate the further insights possible from extended analysis.

[1]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[2]  David Sklansky,et al.  Hold'Em Poker for Advanced Players , 1999 .

[3]  Eunjung Han,et al.  Human-centered modeling for style-based adaptive games , 2009 .

[4]  R. Caillois,et al.  Man, Play and Games , 1958 .

[5]  Cristina Conati,et al.  Inferring user goals from personality and behavior in a causal model of user affect , 2003, IUI '03.

[6]  Lennart E. Nacke,et al.  Player Typology in Theory and Practice , 2011, DiGRA Conference.

[7]  Thomas W. Malone,et al.  What makes things fun to learn? heuristics for designing instructional computer games , 1980, SIGSMALL '80.

[8]  Steve Rabin,et al.  AI Game Programming Wisdom , 2002 .

[9]  Thomas Hofmann,et al.  TrueSkill™: A Bayesian Skill Rating System , 2007 .

[10]  Ben Cowley,et al.  Learning principles and interaction design for 'Green My Place': A massively multiplayer serious game , 2011, Entertain. Comput..

[11]  Colin Fyfe,et al.  Improving Artificial Intelligence In a Motocross Game , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[12]  Timo Kaukoranta,et al.  Role of Pattern Recognition in Computer Games , 2002 .

[13]  Michaela M. Black,et al.  Maintaining the performance of a learned classifier under concept drift , 1999, Intell. Data Anal..

[14]  D. Keirsey,et al.  Please Understand Me: Character and Temperament Types , 1978 .

[15]  Darryl Charles,et al.  Enhancing E-Learning Engagement Using Design Patterns from Computer Games , 2008, First International Conference on Advances in Computer-Human Interaction.

[16]  Lars Niklasson,et al.  The Truth is In There - Rule Extraction from Opaque Models Using Genetic Programming , 2004, FLAIRS.

[17]  Chris Bateman,et al.  21st Century Game Design , 2005 .

[18]  Stéphane Marchand-Maillet,et al.  Can feature information interaction help for information fusion in multimedia problems? , 2009, Multimedia Tools and Applications.

[19]  David J. Pittenger,et al.  The Utility of the Myers-Briggs Type Indicator , 1993 .

[20]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[21]  Jana Kludas,et al.  Information fusion for multimedia: exploiting feature interactions for semantic feature selection and construction , 2010 .

[22]  F. J. Anscombe,et al.  Graphs in Statistical Analysis , 1973 .

[23]  Amund Tveit,et al.  Game Usage Mining: Information Gathering for Knowledge Discovery in Massive Multiplayer Games , 2002, International Conference on Internet Computing.

[24]  Matthew N. Anyanwu,et al.  Comparative Analysis of Serial Decision Tree Classification Algorithms , 2009 .

[25]  Stphane Tuffry,et al.  Data Mining and Statistics for Decision Making , 2011 .

[26]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[27]  Johannes Fürnkranz,et al.  Machine Learning and Game Playing , 2010, Encyclopedia of Machine Learning and Data Mining.

[28]  Loren G. Terveen,et al.  Does an Individual's Myers-Briggs Type Indicator Preference Influence Task-Oriented Technology Use? , 2003, INTERACT.

[29]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[30]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[31]  Stéphane Tufféry,et al.  Data Mining and Statistics for Decision Making: Tufféry/Data Mining and Statistics for Decision Making , 2011 .

[32]  Eun-Ok Baek,et al.  User-Centered Design and Development , 2007 .

[33]  Julian Togelius,et al.  Making Racing Fun Through Player Modeling and Track Evolution , 2006 .

[34]  Ruck Thawonmas,et al.  Classification of Online Game Players Using Action Transition Probability and Kullback Leibler Entropy , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[35]  Johannes Fürnkranz,et al.  Machine learning and games , 2006, Machine Learning.

[36]  Víctor Parada,et al.  People Efficiently Explore the Solution Space of the Computationally Intractable Traveling Salesman Problem to Find Near-Optimal Tours , 2010, PloS one.

[37]  Bernadette Bouchon-Meunier,et al.  Characterizing player's experience from physiological signals using fuzzy decision trees , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[38]  J. Huizinga Homo Ludens: A Study of the Play-Element in Culture , 1938 .

[39]  P. Costa,et al.  Reinterpreting the Myers-Briggs Type Indicator from the perspective of the five-factor model of personality. , 1989, Journal of personality.

[40]  Darryl Charles,et al.  Machine learning in digital games: a survey , 2008, Artificial Intelligence Review.

[41]  Andrew Hunter,et al.  Polynomial-fuzzy decision tree structures for classifying medical data , 2003, Knowl. Based Syst..

[42]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[43]  Pavel Curtis,et al.  Mudding: Social phenomena in text-based virtual realities. , 1997 .

[44]  Lars Niklasson,et al.  Explaining Winning Poker--A Data Mining Approach , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[45]  David L. Westbrook,et al.  Intelligent modeling of the user in interactive entertainment , 2002 .

[46]  Benjamin Geisler,et al.  An Empirical Study of Machine Learning Algorithms Applied to Modeling Player Behavior in a "First Person Shooter" Video Game , 2002 .

[47]  Xing Zhang,et al.  A new approach to classification based on association rule mining , 2006, Decis. Support Syst..