Towards Automated Player Experience Detection With Computer Vision Techniques

Copyright is held by the author/owner(s). CHI’12, May 5–10, 2012, Austin, Texas, USA. ACM 978-1-4503-1016-1/12/05. Abstract There has been an increasing number of quantitative methods to measure and evaluate player experiences. However, current methods either focus on telemetry approaches, which are insufficient to capture real life responses, or psychophysiological methods, which are intrusive and more suited to controlled laboratory environments. This paper presents the position that computer vision techniques can provide a less intrusive and more versatile solution for automatic evaluation of game user experiences. A conceptual framework to automatically infer flow intensity is presented and a work-in-progress study is included to demonstrate the feasibility of this research direction.

[1]  Enrique Muñoz,et al.  Recognising facial expressions in video sequences , 2007, Pattern Analysis and Applications.

[2]  Bieke Zaman,et al.  The FaceReader: measuring instant fun of use , 2006, NordiCHI '06.

[3]  E M Critchley,et al.  The human face. , 1985, British medical journal.

[4]  G. Cottrell,et al.  EMPATH: A Neural Network that Categorizes Facial Expressions , 2002, Journal of Cognitive Neuroscience.

[5]  Chek Tien Tan,et al.  Towards a Non-Disruptive, Practical and Objective Automated Playtesting Process , 2011, IDP@AIIDE.

[6]  Christopher D. Shaw,et al.  Visualizing and understanding players' behavior in video games: discovering patterns and supporting aggregation and comparison , 2011, Sandbox '11.

[7]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[8]  Michael John,et al.  Data cracker: developing a visual game analytic tool for analyzing online gameplay , 2011, CHI.

[9]  Lennart E. Nacke,et al.  Flow and immersion in first-person shooters: measuring the player's gameplay experience , 2008, Future Play.

[10]  Lennart E. Nacke,et al.  More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game , 2010, Interact. Comput..

[11]  S. Jackson,et al.  The flow experience: a Rasch analysis of Jackson's Flow State Scale. , 1999, Journal of outcome measurement.

[12]  Magy Seif El-Nasr,et al.  A Deeper Look at the Use of Telemetry for Analysis of Player Behavior in RTS Games , 2011, ICEC.

[13]  Mark Pauly,et al.  Realtime performance-based facial animation , 2011, ACM Trans. Graph..

[14]  Georgios N. Yannakakis,et al.  Correlation between heart rate, electrodermal activity and player experience in first-person shooter games , 2010, Sandbox '10.

[15]  Magy Seif El-Nasr,et al.  Exploring Quantitative Methods for Evaluating Sports Games , 2010 .