See, Feel, Move: Player Behaviour Analysis through Combined Visualization of Gaze, Emotions, and Movement

Playtesting of games often relies on a mixed-methods approach to obtain more holistic insights about and, in turn, improve the player experience. However, triangulating the different data sources and visualizing them in an integrated manner such that they contextualize each other still proves challenging. Despite its potential value for gauging player behaviour, this area of research continues to be underexplored. In this paper, we propose a visualization approach that combines commonly tracked movement data with - from a visualization perspective rarely considered - gaze behaviour and emotional responses. We evaluated our approach through a qualitative expert study with five professional game developers. Our results show that both the individual visualization of gaze, emotions, and movement but especially their combination are valuable to understand and form hypotheses about player behaviour. At the same time, our results stress that careful attention needs to be paid to ensure that the visualization remains legible and does not obfuscate information.

[1]  Klaus Opwis,et al.  “An Odd Kind of Pleasure”: Differentiating Emotional Challenge in Digital Games , 2018, CHI.

[2]  Lennart E. Nacke,et al.  How does it play better?: exploring user testing and biometric storyboards in games user research , 2013, CHI.

[3]  Veronica Sundstedt,et al.  Simplifying game mechanics: gaze as an implicit interaction method , 2017, SIGGRAPH Asia Technical Briefs.

[4]  Pierre-Majorique Léger,et al.  Physiological heatmaps: a tool for visualizing users’ emotional reactions , 2017, Multimedia Tools and Applications.

[5]  Magy Seif El-Nasr,et al.  Visual attention in 3D video games , 2006, ACE '06.

[6]  Naeem Moosajee,et al.  Playtesting for indie studios , 2016, MindTrek.

[7]  Ganesh S. Oak Information Visualization Introduction , 2022 .

[8]  Hans-Werner Gellersen,et al.  Gaze-Supported Gaming: MAGIC Techniques for First Person Shooters , 2015, CHI PLAY.

[9]  Eva Cerezo,et al.  The Emotracker: Visualizing Contents, Gaze and Emotions at a Glance , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[10]  Lennart E. Nacke,et al.  Gameplay experience in a gaze interaction game , 2010, ArXiv.

[11]  Michael Mateas,et al.  Visualizing the strategic landscape of arbitrary games , 2018, Inf. Vis..

[12]  Regan L. Mandryk,et al.  Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts , 2016, CHI PLAY.

[13]  Manfred Tscheligi,et al.  Where the eyes meet: Lessons learned from shared gaze-based interactions in cooperative and competitive online games , 2018, Entertain. Comput..

[14]  Maneesh Agrawala,et al.  Visualizing competitive behaviors in multi-user virtual environments , 2004, IEEE Visualization 2004.

[15]  Kwan-Liu Ma,et al.  Big-Data Visualization , 2013, IEEE Computer Graphics and Applications.

[16]  Hans-Werner Gellersen,et al.  EyePlay Revisited: Past, Present and Future Challenges for Eye-Based Interaction in Games , 2018, CHI PLAY.

[17]  R. Plutchik Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice , 2016 .

[18]  Manfred Tscheligi,et al.  Using emotion in games: emotional flowers , 2007, ACE '07.

[19]  Truong-Huy D. Nguyen,et al.  G-Player: Exploratory Visual Analytics for Accessible Knowledge Discovery , 2016, DiGRA/FDG.

[20]  Clark Verbrugge,et al.  Clustering Player Paths , 2015, FDG.

[21]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[22]  John Stasko,et al.  BEST PAPER: A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations , 2004 .

[23]  R. Plutchik The Nature of Emotions , 2001 .

[24]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[25]  Hans-Werner Gellersen,et al.  GazeArchers: playing with individual and shared attention in a two-player look&shoot tabletop game , 2016, MUM.

[26]  Andrew T. Duchowski,et al.  Serious gaze , 2017, 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games).

[27]  P. Ekman,et al.  Emotion in the Human Face: Guidelines for Research and an Integration of Findings , 1972 .

[28]  Jarke J. van Wijk,et al.  Interactive visualization of multivariate trajectory data with density maps , 2011, 2011 IEEE Pacific Visualization Symposium.

[29]  Günter Wallner,et al.  Aggregated Visualization of Playtesting Data , 2019, CHI.

[30]  Licinio Roque,et al.  The Eyes and Games: A Survey of Visual Attention and Eye Tracking Input in Video Games , 2011 .

[31]  Raimund Dachselt,et al.  Trends and Techniques in Visual Gaze Analysis , 2010, ArXiv.

[32]  Lennart E. Nacke,et al.  Unified visualization of quantitative and qualitative playtesting data , 2014, CHI Extended Abstracts.

[33]  Steffen Staab,et al.  Schau genau ! A Gaze-Controlled 3 D Game for Entertainment and Education , 2022 .

[34]  David H. Laidlaw,et al.  An insight- and task-based methodology for evaluating spatiotemporal visual analytics , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[35]  Heidrun Schumann,et al.  A Design Space of Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[36]  Jürgen Bernard,et al.  Visual‐interactive Exploration of Interesting Multivariate Relations in Mixed Research Data Sets , 2014, Comput. Graph. Forum.

[37]  Günter Wallner,et al.  An introduction to gameplay data visualization , 2015 .

[38]  Daniel A. Keim,et al.  Visual Analytics: Definition, Process, and Challenges , 2008, Information Visualization.

[39]  Gennady L. Andrienko,et al.  Spatial Generalization and Aggregation of Massive Movement Data , 2011, IEEE Transactions on Visualization and Computer Graphics.

[40]  Günter Wallner,et al.  Visualization-based analysis of gameplay data - A review of literature , 2013, Entertain. Comput..

[41]  Gennady L. Andrienko,et al.  Spatio-temporal aggregation for visual analysis of movements , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[42]  Günter Wallner,et al.  Game user telemetry in practice: a case study , 2014, Advances in Computer Entertainment.

[43]  Bernhard Maurer,et al.  Eye Contact: Gaze as a Connector Between Spectators and Players in Online Games , 2017, ICEC.

[44]  Jimmy Johansson,et al.  Visual analysis of mixed data sets using interactive quantification , 2010, SKDD.

[45]  Michael Batty,et al.  Visualizing aggregate movement in cities , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[46]  Anders Drachen,et al.  Spatial game analytics and visualization , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[47]  Frank Vetere,et al.  Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games , 2017, CHI PLAY.

[48]  Lennart E. Nacke,et al.  Affective Ludology, Flow and Immersion in a First- Person Shooter: Measurement of Player Experience , 2009, ArXiv.

[49]  Regina Bernhaupt,et al.  Evaluating User Experience in Games - Concepts and Methods , 2010, Human-Computer Interaction Series.

[50]  Ioanna Iacovides,et al.  Designing for Emotional Complexity in Games: The Interplay of Positive and Negative Affect , 2016, CHI PLAY.

[51]  Zoran Popovic,et al.  Feature-based projections for effective playtrace analysis , 2011, FDG.

[52]  Nirvana Meratnia,et al.  Aggregation and comparison of trajectories , 2002, GIS '02.

[53]  Menno-Jan Kraak,et al.  The space - time cube revisited from a geovisualization perspective , 2003 .

[54]  E. Catmull,et al.  A CLASS OF LOCAL INTERPOLATING SPLINES , 1974 .

[55]  Pejman Mirza-Babaei,et al.  Vixen: interactive visualization of gameplay experiences , 2017, FDG.

[56]  Bruce Phillips,et al.  Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems , 2008, CHI.

[57]  Erik Reinhard,et al.  Visual Attention and Gaze Behavior in Games: An Object-Based Approach , 2013, Game Analytics, Maximizing the Value of Player Data.

[58]  BEN MEDLER,et al.  Analytics of Play : Using Information Visualization and Gameplay Practices for Visualizing Video Game Data , 2011 .

[59]  Pedro Santana,et al.  A study on the use of eye tracking to adapt gameplay and procedural content generation in first-person shooter games , 2018, Multimodal Technol. Interact..