Challenge and Retention in Games.

Author(s): Debeauvais, Thomas | Advisor(s): Lopes, Cristina V | Abstract: Game designers and researchers agree that the main motivation for starting playing a game is challenge. It is only a small step to say that when the game becomes too difficult, players can become frustrated and quit. While extensive work shows that challenge is central in player enjoyment, its influence on player retention has received little attention. Establishing this influence is difficult for several reasons: (i) Definitions of challenge tend to be game- or genre-specific. (ii) Measuring retention accurately requires real-life data, which is often hard to access. (iii) Challenge can be intertwined with other factors, such as social interactions in multi-player games.Addressing these three limitations requires a mixed-method, holistic, and cross-game approach paying close attention to the game mechanics. Therefore, we use a diverse mix of data sources, ranging from interviews to online questionnaires and telemetry logs, to explore player behavior in five games: Ragnarok Online, World of Warcraft, Forza Motorsport 4, Jelly Splash, and an undisclosed commercial mobile game.This work provides empirical evidence that challenge does influence retention, and that many contextual factors, namely player segments, social interactions, time, and money, nuance and mediate this influence.These findings may help game developers make better games, expand our knowledge of challenge, retention, and their relationship, and improve the bottom-line of game companies by making games more engaging and players stay longer.

[1]  Clark Verbrugge,et al.  Measuring cooperative gameplay pacing in World of Warcraft , 2011, FDG.

[2]  Christopher A. Paul Welfare Epics? The Rhetoric of Rewards in World of Warcraft , 2010, Games Cult..

[3]  Jinwoo Kim,et al.  Why People Continue to Play Online Games: In Search of Critical Design Factors to Increase Customer Loyalty to Online Contents , 2004, Cyberpsychology Behav. Soc. Netw..

[4]  Gifford Cheung,et al.  Starcraft from the stands: understanding the game spectator , 2011, CHI.

[5]  Bonnie A. Nardi,et al.  If you build it they might stay: retention mechanisms in World of Warcraft , 2011, FDG.

[6]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[7]  Carl Gutwin,et al.  The effects of local lag on tightly-coupled interaction in distributed groupware , 2008, CSCW.

[8]  Bonnie A. Nardi,et al.  My Life as a Night Elf Priest: An Anthropological Account of World of Warcraft: Excerpts , 2010, First Monday.

[9]  Henrik Schoenau-Fog,et al.  The Player Engagement Process - An Exploration of Continuation Desire in Digital Games , 2011, DiGRA Conference.

[10]  Bob De Schutter,et al.  Never Too Old to Play: The Appeal of Digital Games to an Older Audience , 2011, Games Cult..

[11]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[12]  Julian Dibbell The Life of the Chinese Gold Farmer , 2007 .

[13]  Mia Consalvo,et al.  Using your friends: social mechanics in social games , 2011, FDG.

[14]  Robert J. Moore,et al.  The life and death of online gaming communities: a look at guilds in world of warcraft , 2007, CHI.

[15]  Christian Bauckhage,et al.  How players lose interest in playing a game: An empirical study based on distributions of total playing times , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[16]  Peng Gao,et al.  Churn prediction for high-value players in casual social games , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[17]  Juho Hamari,et al.  Meta-synthesis of player typologies , 2012 .

[18]  Carl Gutwin,et al.  Target assistance for subtly balancing competitive play , 2011, CHI.

[19]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs Using Player Motivation Theories and an Ensemble Approach , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[20]  C. Pearce,et al.  Author's Note: Special Thanks for Their Support to Emily Morganti and Heather Logas of Telltale Games; Games and Culture Volume Xx Number X Month Xxxx Xx-xx the Truth about Baby Boomer Gamers a Study of Over-forty Computer Game Players , 2022 .

[21]  George E. Tita,et al.  Human group formation in online guilds and offline gangs driven by a common team dynamic. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  T. Long Play: How it Shapes the Brain, Opens the Imagination, and Invigorates the Soul , 2009 .

[23]  Regan L. Mandryk,et al.  BrainHex: A neurobiological gamer typology survey , 2014, Entertain. Comput..

[24]  Martial Van der Linden,et al.  Why do you play World of Warcraft? An in-depth exploration of self-reported motivations to play online and in-game behaviours in the virtual world of Azeroth , 2013, Comput. Hum. Behav..

[25]  Bonnie A. Nardi,et al.  Learning Conversations in World of Warcraft , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[26]  Mark O. Riedl,et al.  A Temporal Data-Driven Player Model for Dynamic Difficulty Adjustment , 2012, AIIDE.

[27]  Julian Togelius,et al.  Game Data Mining , 2013, Game Analytics, Maximizing the Value of Player Data.

[28]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[29]  Yun-En Liu,et al.  The impact of tutorials on games of varying complexity , 2012, CHI.

[30]  Christian Bauckhage,et al.  Behavior evolution in Tomb Raider Underworld , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[31]  Yu-Hao Lee,et al.  Are there cultural differences in how we play? Examining cultural effects on playing social network games , 2012, Comput. Hum. Behav..

[32]  Christoph Klimmt,et al.  Effectance and Control as Determinants of Video Game Enjoyment , 2007, Cyberpsychology Behav. Soc. Netw..

[33]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[34]  Nick Yee,et al.  The Demographics, Motivations, and Derived Experiences of Users of Massively Multi-User Online Graphical Environments , 2006, PRESENCE: Teleoperators and Virtual Environments.

[35]  Christian Bauckhage,et al.  Predicting Purchase Decisions in Mobile Free-to-Play Games , 2015, AIIDE.

[36]  Les Nelson,et al.  Introverted elves & conscientious gnomes: the expression of personality in world of warcraft , 2011, CHI.

[37]  Nachiappan Nagappan,et al.  What Drives People: Creating Engagement Profiles of Players from Game Log Data , 2015, CHI PLAY.

[38]  Alessandro Canossa,et al.  Arrrgghh!!!: blending quantitative and qualitative methods to detect player frustration , 2011, FDG.

[39]  Rabindra A. Ratan,et al.  The Trojan Player Typology: A cross-genre, cross-cultural, behaviorally validated scale of video game play motivations , 2015, Comput. Hum. Behav..

[40]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[41]  Thomas W. Malone,et al.  Toward a Theory of Intrinsically Motivating Instruction , 1981, Cogn. Sci..

[42]  Elise van den Hoven,et al.  Balancing Skills to Optimize Fun in Interactive Board Games , 2009, INTERACT.

[43]  Steven Boyer L337 Soccer Moms: Conceptions of "Hardcore" and "Casual" in the Digital Games Medium , 2009 .

[44]  Cristina V. Lopes,et al.  10,000 gold for 20 dollars: an exploratory study of World of Warcraft gold buyers , 2012, FDG.

[45]  Brent E. Harrison,et al.  Analytics-driven dynamic game adaption for player retention in Scrabble , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[46]  Nachiappan Nagappan,et al.  Off with their assists: An empirical study of driving skill in Forza Motorsport 4 , 2014, FDG.

[47]  Juho Hamari,et al.  Building Customer Relationship through Game Mechanics in Social Games , 2011 .

[48]  Jesper Juul,et al.  A Casual Revolution: Reinventing Video Games and Their Players , 2009 .

[49]  Elizabeth Boyle,et al.  The differences in motivations of online game players and offline game players: A combined analysis of three studies at higher education level , 2011, Comput. Educ..

[50]  Chris Bateman,et al.  21st Century Game Design , 2005 .

[51]  W. Rice ANALYZING TABLES OF STATISTICAL TESTS , 1989, Evolution; international journal of organic evolution.

[52]  Bruce Phillips,et al.  Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems , 2008, CHI.

[53]  Edward Castronova,et al.  As real as real? Macroeconomic behavior in a large-scale virtual world , 2009, New Media Soc..

[54]  Ming-Hui Wen,et al.  Body and mind: a study of avatar personalization in three virtual worlds , 2009, CHI.

[55]  James Paul Gee,et al.  Learning by Design: Good Video Games as Learning Machines , 2005 .

[56]  Jaideep Srivastava,et al.  User Behavior Modelling Approach for Churn Prediction in Online Games , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[57]  Randy J. Pagulayan,et al.  A survey method for assessing perceptions of a game: The consumer playtest in game design , 2019, Game Stud..

[58]  Magy Seif El-Nasr,et al.  Exploring Quantitative Methods for Evaluating Sports Games , 2010 .

[59]  Bonnie A. Nardi,et al.  Strangers and friends: collaborative play in world of warcraft , 2006, CSCW '06.

[60]  Jeffrey Nichols,et al.  Come meet me at Ulduar: progression raiding in world of warcraft , 2012, CSCW.

[61]  Baltasar Fernández-Manjón,et al.  An instrument to build a gamer clustering framework according to gaming preferences and habits , 2016, Comput. Hum. Behav..

[62]  Jesper Juul The Art of Failure: An Essay on the Pain of Playing Video Games , 2013 .

[63]  Donghee Yvette Wohn,et al.  Spending real money: purchasing patterns of virtual goods in an online social game , 2014, CHI.

[64]  Juho Hamari,et al.  Why Do People Play Games? A Review of Studies on Adoption and Use , 2015, 2015 48th Hawaii International Conference on System Sciences.

[65]  Laura Welch,et al.  If you build it, they might come , 2009, Nature Reviews Microbiology.

[66]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs: A Social Influence Based Approach , 2009, 2009 International Conference on Computational Science and Engineering.

[67]  Mia Consalvo Hardcore casual: game culture Return(s) to Ravenhearst , 2009, FDG.

[68]  Elke E. Mattheiss,et al.  Player Type Models: Towards Empirical Validation , 2016, CHI Extended Abstracts.

[69]  Barry A. T. Brown,et al.  Experts at Play , 2009 .

[70]  Bonnie A. Nardi,et al.  A new look at World of Warcraft's social landscape , 2011, FDG.

[71]  James M. Boyle,et al.  Engagement in digital entertainment games: A systematic review , 2012, Comput. Hum. Behav..

[72]  Vili Lehdonvirta,et al.  A History of the Digitalization of Consumer Culture: From Amazon Through Pirate Bay to Farmville , 2013 .

[73]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[74]  Mitchell Tan,et al.  Social gaming: what attracts the most attention?: an investigation using an improved diary method , 2008, ACE '08.

[75]  Panayiotis Zaphiris,et al.  Social learning in MMOG: an activity theoretical perspective , 2008, Interact. Technol. Smart Educ..

[76]  Diego Klabjan,et al.  Going out of business: Auction house behavior in the Massively Multi-player Online Game Glitch , 2014, Entertain. Comput..

[77]  Gail E. Kaiser,et al.  A large-scale, longitudinal study of user profiles in world of warcraft , 2013, WWW.

[78]  Brent E. Harrison,et al.  Using sequential observations to model and predict player behavior , 2011, FDG.

[79]  Shaowen Bardzell,et al.  The rogue in the lovely black dress: intimacy in world of warcraft , 2010, CHI.

[80]  M. Csíkszentmihályi Beyond boredom and anxiety , 1975 .

[81]  Cristina V. Lopes,et al.  Gate Me If You Can: The Impact of Gating Mechanics on Retention and Revenues in Jelly Splash , 2015, FDG.

[82]  Nachiappan Nagappan,et al.  Mastering the art of war: how patterns of gameplay influence skill in Halo , 2013, CHI.

[83]  T. L. Taylor,et al.  Power games just want to have fun?: instrumental play in a MMOG , 2003, DiGRA Conference.

[84]  T. L. Taylor,et al.  Book Review: T.L. Taylor, Play Between WorldS: Exploring Online Game Culture. Cambridge, MA: MIT Press, 2006. vii+197 pp. ISBN 0262201631, $29.95 hbk , 2007, New Media Soc..

[85]  Cristina V. Lopes,et al.  Retention and progression: Seven months in World of Warcraft , 2014, FDG.

[86]  Les Nelson,et al.  Do men heal more when in drag?: conflicting identity cues between user and avatar , 2011, CHI.

[87]  Vili Lehdonvirta,et al.  Virtual item sales as a revenue model: identifying attributes that drive purchase decisions , 2009, Electron. Commer. Res..

[88]  Magy Seif El-Nasr,et al.  Game Analytics , 2013, Springer London.

[89]  Celia Pearce,et al.  Communities of Play: Emergent Cultures in Multiplayer Games and Virtual Worlds , 2009 .

[90]  Jeroen Jansz,et al.  Appeal of Playing Online First Person Shooter Games , 2007, Cyberpsychology Behav. Soc. Netw..

[91]  Edward Castronova,et al.  Surveying the Virtual World - A Large Scale Survey in Second Life Using the Virtual Data Collection Interface (VDCI) , 2009 .

[92]  Robert J. Moore,et al.  "Alone together?": exploring the social dynamics of massively multiplayer online games , 2006, CHI.

[93]  Scott E. Caplan,et al.  Looking for Gender: Gender Roles and Behaviors Among Online Gamers , 2009 .

[94]  Andrew Hargadon,et al.  The pleasure principle: immersion, engagement, flow , 2000, HYPERTEXT '00.

[95]  Yong Ming Kow,et al.  Digital imaginaries: How we know what we (think we) know about Chinese gold farming , 2010, First Monday.

[96]  Frans Mäyrä,et al.  Fundamental Components of the Gameplay Experience: Analysing Immersion , 2005, DiGRA Conference.

[97]  Nachiappan Nagappan,et al.  The first hour experience: how the initial play can engage (or lose) new players , 2014, CHI PLAY.

[98]  Roberto Dillon The Golden Age of Video Games: The Birth of a Multibillion Dollar Industry , 2016 .

[99]  Magy Seif El-Nasr,et al.  Sampling for Game User Research , 2013, Game Analytics, Maximizing the Value of Player Data.

[100]  Paul A. Cairns,et al.  A grounded investigation of game immersion , 2004, CHI EA '04.

[101]  Robert E. Kraut,et al.  Project massive: a study of online gaming communities , 2004, CHI EA '04.