Comparing Player Responses to Choice-Based Interactive Narratives Using Facial Expression Analysis

Interactive storytelling balances the desire to create dynamic, engaging experiences around characters and situations with the practical considerations of the cost of producing content. We describe a method for assessing player experience by analyzing player facial expressions following key content events in The Wolf Among Us by Telltale Games. Two metrics, engagement and valence, are extracted for six participants who play the first episode of the game. An analysis of the variance and distribution of responses relative to emotionally charged content events and choices suggests that content is designed around events that serve to anchor player emotions while providing the freedom to respond through emotionally-motivated choice selections and content elicitors.

[1]  Ana Paiva,et al.  Using Interactive Storytelling to Identify Personality Traits , 2017, ICIDS.

[2]  Jussi Holopainen,et al.  The Psychophysiology of Video Gaming: Phasic Emotional Responses to Game Events , 2005, DiGRA Conference.

[3]  Lennart E. Nacke,et al.  An Introduction to Physiological Player Metrics for Evaluating Games , 2013, Game Analytics, Maximizing the Value of Player Data.

[4]  Vincenzo Lombardo,et al.  Narrative Annotation and Editing of Video , 2010, ICIDS.

[5]  Katherine Isbister,et al.  All the Feels: Introducing Biometric Data to Online Gameplay Streams , 2016, CHI PLAY.

[6]  Michael John,et al.  Data cracker: developing a visual game analytic tool for analyzing online gameplay , 2011, CHI.

[7]  Maja Pantic,et al.  Automatic Analysis of Facial Actions: A Survey , 2019, IEEE Transactions on Affective Computing.

[8]  Henrik Schoenau-Fog,et al.  Hooked! - Evaluating Engagement as Continuation Desire in Interactive Narratives , 2011, ICIDS.

[9]  Pejman Mirza-Babaei,et al.  Vixen: interactive visualization of gameplay experiences , 2017, FDG.

[10]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[11]  Pejman Mirza-Babaei,et al.  Biometric storyboards : a games user research approach for improving qualitative evaluations of player experience , 2014 .

[12]  Nicolas Szilas,et al.  Objective Metrics for Interactive Narrative , 2014, ICIDS.

[13]  Luis Emilio Bruni,et al.  Narrative Cognition in Interactive Systems: Suspense-Surprise and the P300 ERP Component , 2014, ICIDS.

[14]  Bruce Phillips,et al.  Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems , 2008, CHI.

[15]  Michael Mateas,et al.  Getting the GISST: a toolkit for the creation, analysis and reference of game studies resources , 2017, FDG.

[16]  Lennart E. Nacke,et al.  Affective Ludology, Flow and Immersion in a First- Person Shooter: Measurement of Player Experience , 2009, ArXiv.

[17]  Christoph Klimmt,et al.  Measuring User Responses to Interactive Stories: Towards a Standardized Assessment Tool , 2010, ICIDS.

[18]  P. Ekman.  An argument for basic emotions , 1992 .

[19]  S. Puttonen,et al.  The psychophysiology of James Bond: phasic emotional responses to violent video game events. , 2008, Emotion.

[20]  Erik Cambria,et al.  A review of affective computing: From unimodal analysis to multimodal fusion , 2017, Inf. Fusion.

[21]  Daniel McDuff,et al.  AFFDEX SDK: A Cross-Platform Real-Time Multi-Face Expression Recognition Toolkit , 2016, CHI Extended Abstracts.

[22]  Lennart E. Nacke,et al.  Affective Ludology: Scientific Measurement of User Experience in Interactive Entertainment , 2009 .

[23]  Katherine Isbister,et al.  "You're Giving Me Mixed Signals!": A Comparative Analysis of Methods that Capture Players' Emotional Response to Games , 2018, CHI Extended Abstracts.

[24]  Lennart E. Nacke,et al.  Introducing the biometric storyboards tool for games user research , 2014, 2014 IEEE Games Media Entertainment.

[25]  Stefan Rank,et al.  Exit 53: Physiological Data for Improving Non-player Character Interaction , 2016, ICIDS.