A Practical Guide to Using Digital Games as an Experiment Stimulus

Digital games offer rich media content and engaging action, accessible individually or in groups collaborating or competing against each other. This makes them promising for use as a stimulus in research settings. This paper examines the advantages and challenges of using games in experimental research with particular focus on strict stimulus control through the following four areas: (1) matching and regulating task type, (2) data segmentation and event coding, (3) compatibility between participants, and (4) planning and conducting data collection. This contribution provides a breakdown of the steps necessary for using a digital game in experimental studies, along with a checklist for researchers illustrating variables that potentially affect the reliability and validity of experiments. We also offer a study example to illustrate how these considerations apply to practice. The aim is to provide support to researchers planning and conducting empirical experiments involving games, and also to those evaluating the works of others.

[1]  Maria V. Sanchez-Vives,et al.  A Virtual Reprise of the Stanley Milgram Obedience Experiments , 2006, PloS one.

[2]  Damian Schofield,et al.  Playing with evidence: Using video games in the courtroom , 2011, Entertain. Comput..

[3]  Tony Manninen,et al.  RICH INTERACTION MODEL FOR GAME AND VIRTUAL ENVIRONMENT DESIGN , 2004 .

[4]  Martin R. Gibbs,et al.  Taxonomy of exertion games , 2008, OZCHI.

[5]  Joe Grant Bell,et al.  Unreal Tournament 2003 , 2002 .

[6]  Juho Karvinen,et al.  Pelaajabarometri 2011: Pelaamisen muutos , 2011 .

[7]  Jussi Holopainen,et al.  Spatial Presence and Emotional Responses to Success in a Video Game: A Psychophysiological Study , 2004 .

[8]  R. Krauss,et al.  The effect of threat upon interpersonal bargaining. , 1960, Journal of abnormal and social psychology.

[9]  Craig A. Lindley,et al.  Game Taxonomies: A High Level Framework for Game Analysis and Design , 2003 .

[10]  K. Kallinen,et al.  Phasic Emotional Reactions to Video Game Events: A Psychophysiological Investigation , 2006 .

[11]  Eric D. Ragan,et al.  Considerations for the use of commercial video games in controlled experiments , 2011, Entertain. Comput..

[12]  Paul J. C. Adachi,et al.  The Effect of Video Game Competition and Violence on Aggressive Behavior: Which Characteristic Has the Greatest Influence? , 2011 .

[13]  Shu-Fang Lin,et al.  Effect of Opponent Type on Moral Emotions and Responses to Video Game Play , 2011, Cyberpsychology Behav. Soc. Netw..

[14]  Ann-Carita Evaldsson Play and games , 2009 .

[15]  J. Matias,et al.  Review on psychophysiological methods in game research , 2010 .

[16]  S. Puttonen,et al.  The psychophysiology of James Bond: phasic emotional responses to violent video game events. , 2008, Emotion.

[17]  Nicola Whitton,et al.  Learning with digital games : a practical guide to engaging students in higher education , 2009 .

[18]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[19]  Espen Aarseth,et al.  Game Classification as Game Design: Construction Through Critical Analysis , 2005, DiGRA Conference.

[20]  M. Ballard,et al.  Mortal Kombat (tm): The Effects of Violent Videogame Play on Males' Hostility and Cardiovascular Responding , 1996 .

[21]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[22]  Ben Cowley,et al.  Cardiovascular physiology predicts learning effects in a serious game activity , 2013, Comput. Educ..

[23]  Sus Lundgren,et al.  Game Mechanics : Describing Computer-Augmented Games in Terms of Interaction , 2002 .

[24]  Frithjof Staude-Müller,et al.  Hostile and Hardened? An Experimental Study on (De-)Sensitization to Violence and Suffering Through Playing Video Games , 2008 .

[25]  Staffan Björk,et al.  Patterns In Game Design , 2004 .

[26]  Johannes Hartig,et al.  The use of virtual environments based on a modification of the computer game Quake III Arena® in psychological experimenting , 2007, Comput. Hum. Behav..

[27]  S. Milgram BEHAVIORAL STUDY OF OBEDIENCE. , 1963, Journal of abnormal psychology.

[28]  C. Anderson,et al.  Violent Video Games and Hostile Expectations: A Test of the General Aggression Model , 2002 .

[29]  J. Tedeschi,et al.  Matrix values and cooperative behavior in the Prisoner's Dilemma game. , 1968, Journal of personality and social psychology.

[30]  D. Washburn The games psychologists play (and the data they provide) , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[31]  R. Caillois,et al.  Man, Play and Games , 1958 .

[32]  N. Ravaja,et al.  Physiological Linkage of Dyadic Gaming Experience , 2014 .

[33]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.