Measuring Video Game Engagement Through Gameplay Reviews

Aim. In this article, we develop a method, that we call the gameplay review method, for measuring players’ engagement with digital games through players’ interactions with video recordings of their own gameplay. Method. The gameplay review method arose from a microsociological study of the gameplay of eight young adults who each played approximately 20 hours of WORLD OF WARCRAFT over a 3-month period in 2012. Using data from in-depth interviews and audiovisual recordings of one of the eight participants, this article focuses on how the method leveraged participants’ knowledge of their experiences and ties that knowledge to measures of engagement. We outline the method’s four-step process (producing Level I data, analyzing Level I data, producing Level II data, analyzing Level II data) to guide the generation and analysis of rich video data. The method involves focused discussions on selected recorded segments of participants’ gameplay and is a means of connecting game design with both empirical and interpretive data. Results. We show how, as participants progress, they learn about game design features and deepen their understanding of games. We found that participants’ developing perceptions of, and relationships to, design features affect their engagement with digital games. Conclusion. The gameplay review method is significant in its ability to measure engagement by dealing explicitly with empirical and interpretive data.

[1]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[2]  Michele D. Dickey Game design and learning: a conjectural analysis of how massively multiple online role-playing games (MMORPGs) foster intrinsic motivation , 2007 .

[3]  T. D. Wilson,et al.  Review of: Berg, Bruce L. Qualitative research methods for the social sciences, 6th ed. Boston, MA: Allyn and Bacon, 2007 , 2008, Inf. Res..

[4]  J. Williams,et al.  The Players' Realm: Studies on the Culture of Video Games and Gaming , 2007 .

[5]  Eviatar Zerubavel,et al.  The fine line : making distinctions in everyday life , 1993 .

[6]  Maarten van Someren,et al.  The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes , 1994 .

[7]  Panayiotis Zaphiris,et al.  Computer Games and Sociocultural Play: An Activity Theoretical Perspective , 2010, Games Cult..

[8]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[9]  M. Csíkszentmihályi Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[10]  Charles F. Petranek Written Debriefing: The Next Vital Step in Learning with Simulations , 2000 .

[11]  Elisabeth R. Hayes,et al.  Making Computer Games and Design Thinking , 2008, Games Cult..

[12]  Kristine Jørgensen,et al.  Players as Coresearchers , 2012 .

[13]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[14]  David Kirschner,et al.  Experts and Novices or Expertise? Positioning Players through Gameplay Reviews , 2013, DiGRA Conference.

[15]  J. Sandberg,et al.  The think aloud method , 1994 .

[16]  Elaine M. Raybourn,et al.  HONING INTERCULTURAL ENGAGEMENT SKILLS FOR STABILITY OPERATIONS WITH DARWARS AMBUSH! NK GAME-BASED TRAINING. , 2008 .

[17]  D. Laplane Thought and language. , 1992, Behavioural neurology.

[18]  Robert J. Moore,et al.  Virtual “Third Places”: A Case Study of Sociability in Massively Multiplayer Games , 2007, Computer Supported Cooperative Work (CSCW).

[19]  Wannes Ribbens,et al.  Researching player experiences through the use of different qualitative methods , 2009, DiGRA Conference.

[20]  M. Commeyras Drax's Reading in Neverwinter Nights: With a Tutor as Henchman , 2009 .

[21]  N. Whitton Game Engagement Theory and Adult Learning , 2011 .

[22]  Kristine Jørgensen,et al.  Researching Players to Understand the Game , 2008 .

[23]  P. Callero :Social Mindscapes: An Invitation to Cognitive Sociology , 1999 .

[24]  Melissa S. Cook,et al.  ‘‘Blacks Deserve Bodies Too!’’: Design and Discussion About Diversity and Race in a Tween Virtual World , 2010 .

[25]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[26]  Casper Harteveld,et al.  Design for Engaging Experience and Social Interaction , 2011 .

[27]  Todd J. Hostager,et al.  Cooperation as communicative accomplishment: A symbolic interaction analysis of an improvised Jazz Concert , 1992 .

[28]  Alice Dreger The Trashing of Margaret Mead: Anatomy of an Anthropological Controversy , 2011 .

[29]  H. Blumer,et al.  Symbolic Interactionism: Perspective and Method , 1988 .

[30]  Thomas W. Malone,et al.  What Makes Things Fun to Learn? A Study of Intrinsically Motivating Computer Games. , 1981 .

[31]  D. Crookall Serious Games, Debriefing, and Simulation/Gaming as a Discipline , 2010 .

[32]  B. Berg Qualitative Research Methods for the Social Sciences , 1989 .