Analysis of telemetry data from a real-time strategy game: A case study

This article describes the analysis of a simple, free-to-play real-time strategy (RTS) game called Pixel Legions. In developing this analysis, we worked with the developer to instrument, collect, and analyze telemetry data. The game design questions examined constitute macro- and micro-level analysis. We used pre-existing statistical and visualization tools to examine the macro-level questions. However, micro-level analysis was more game-specific, which required us to develop a novel visualization system to answer these questions in a way that is easy for the designer to understand. Our contribution constitutes the system we built and the analysis we developed to answer the questions imposed by the designer.

[1]  William Wright,et al.  GeoTime Information Visualization , 2004, IEEE Symposium on Information Visualization.

[2]  Paul Coulton,et al.  PAC-LAN: mixed-reality gaming with RFID-enabled mobile phones , 2006, CIE.

[3]  Scott E. Caplan,et al.  Looking for Gender: Gender Roles and Behaviors Among Online Gamers , 2009 .

[4]  Magy Seif El-Nasr,et al.  Exploring Quantitative Methods for Evaluating Sports Games , 2010 .

[5]  Keith Cheverst,et al.  3D Space-Time Visualization of Player Behaviour in Pervasive Location-Based Games , 2008, Int. J. Comput. Games Technol..

[6]  Magy Seif El-Nasr,et al.  A Deeper Look at the Use of Telemetry for Analysis of Player Behavior in RTS Games , 2011, ICEC.

[7]  William Wright,et al.  GeoTime Information Visualization , 2004 .

[8]  Bruce Phillips,et al.  Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems , 2008, CHI.

[9]  Lorna Heaton,et al.  Design Research: Methods and Perspectives , 2006 .

[10]  Brenda Laurel,et al.  Design Research: Methods and Perspectives , 2003 .

[11]  Christian Bauckhage,et al.  Analyzing the Evolution of Social Groups in World of Warcraft® , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[12]  Scott E. Caplan,et al.  Who plays, how much, and why? Debunking the stereotypical gamer profile , 2008, J. Comput. Mediat. Commun..

[13]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[14]  Alessandro Canossa,et al.  Evaluating motion: spatial user behaviour in virtual environments , 2011, Int. J. Arts Technol..

[15]  Alessandro Canossa,et al.  Defining personas in games using metrics , 2008, Future Play.

[16]  Katherine Isbister,et al.  Game Usability: Advancing the Player Experience , 2008 .

[17]  Alessandro Canossa,et al.  Analyzing spatial user behavior in computer games using geographic information systems , 2009, MindTrek '09.

[18]  Maneesh Agrawala,et al.  Visualizing competitive behaviors in multi-user virtual environments , 2004, IEEE Visualization 2004.

[19]  Manfred Tscheligi,et al.  Evaluating user experiences in games , 2008, CHI Extended Abstracts.

[20]  Ruck Thawonmas,et al.  Visualization of Online-Game Players Based on Their Action Behaviors , 2008, Int. J. Comput. Games Technol..

[21]  Anders Drachen,et al.  Introducing Archetypal Analysis for Player Classification in Games , 2011 .

[22]  Luca Chittaro,et al.  VU-Flow: A Visualization Tool for Analyzing Navigation in Virtual Environments , 2006, IEEE Transactions on Visualization and Computer Graphics.

[23]  Bruce Phillips,et al.  Chapter 15 – TRUE Instrumentation: Tracking Real-Time User Experience in Games , 2008 .