Science Gamers, Citizen Scientists, and Dabblers: Characterizing Player Engagement in Two Citizen Science Games

Abstract Our understanding of volunteers’ engagement in citizen science games is limited, and the impact of gamefulness on volunteer engagement requires further investigation. In this study, we adopted a data-driven approach, exploring volunteers’ psychological and behavioral engagement in two citizen science games: Forgotten Island and Happy Match. We performed a cluster analysis based on the quantity and accuracy of volunteers’ contributed data and conducted a qualitative content analysis of player survey responses to open-ended survey questions. We combined the results of the clustering analysis and the content analysis to identify and characterize three player groups based on their engagement patterns: “science gamers,” “citizen scientists,” and “dabblers.” Our identification of this three-group typology of citizen science players enhances our understanding of volunteers’ contribution and engagement patterns, and we provide design recommendations that may help scientists and designers to refine their own citizen science game initiatives.

[1]  M. Lepper,et al.  Making Learning Fun : A Taxonomy of Intrinsic Motivations for Learning , 2021 .

[2]  S. West,et al.  The Diversity of Participants in Environmental Citizen Science , 2021 .

[3]  K. Irvine,et al.  What motivates the masses: Understanding why people contribute to conservation citizen science projects , 2020, Biological conservation.

[4]  J. Sherson,et al.  More than data gatherers: exploring player experience in a citizen science game , 2019, Quality and User Experience.

[5]  Jesse Schell,et al.  The Art of Game Design: A book of lenses , 2019 .

[6]  Veljko Pejovic,et al.  Understanding Interaction Design Challenges in Mobile Extreme Citizen Science , 2019, Int. J. Hum. Comput. Interact..

[7]  Richard N. Landers,et al.  Defining gameful experience as a psychological state caused by gameplay: Replacing the term 'Gamefulness' with three distinct constructs , 2019, Int. J. Hum. Comput. Stud..

[8]  Lennart E. Nacke,et al.  Empirical validation of the Gamification User Types Hexad scale in English and Spanish , 2019, Int. J. Hum. Comput. Stud..

[9]  Karen Schrier,et al.  Designing Games for Moral Learning and Knowledge Building , 2019, Games Cult..

[10]  R. Bonney,et al.  Engagement in science through citizen science: Moving beyond data collection , 2019, Science Education.

[11]  Nathan R. Prestopnik,et al.  Exploring the impact of game framing and task framing on user participation in citizen science projects , 2019, Aslib J. Inf. Manag..

[12]  L. Rasmussen.  Confronting Research Misconduct in Citizen Science , 2019, Citizen Science: Theory and Practice.

[13]  Juho Hamari,et al.  Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use , 2019, User Modeling and User-Adapted Interaction.

[14]  Brooke D. Simmons,et al.  Everyone counts? Design considerations in online citizen science , 2019, Journal of Science Communication.

[15]  J. Sprinks,et al.  Citizen science and the professional-amateur divide: lessons from differing online practices , 2019, Journal of Science Communication.

[16]  Juho Hamari,et al.  The Gamification of Work: Lessons From Crowdsourcing , 2018, Journal of Management Inquiry.

[17]  Paul A. Cairns,et al.  A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form , 2018, Int. J. Hum. Comput. Stud..

[18]  Thomas Hillman,et al.  Getting it Right or Being Top Rank: Games in Citizen Science , 2018 .

[19]  Lu Ding,et al.  Studies of student engagement in gamified online discussions , 2017, Comput. Educ..

[20]  Nathan R. Prestopnik,et al.  Diegetic Connectivity: Blending Work and Play with Storytelling in Serious Games , 2017, CHI PLAY.

[21]  Elena Paslaru Bontas Simperl,et al.  An investigation of player motivations in Eyewire, a gamified citizen science project , 2017, Comput. Hum. Behav..

[22]  I. A. Johnston,et al.  Knowledge Games: How Playing Games Can Solve Problems, Create Insight, and Make Change , 2017 .

[23]  Jun Wang,et al.  Gamers, citizen scientists, and data: Exploring participant contributions in two games with a purpose , 2017, Comput. Hum. Behav..

[24]  Juho Hamari,et al.  A definition for gamification: anchoring gamification in the service marketing literature , 2016, Electronic Markets.

[25]  Margaret Kosmala,et al.  Volunteer recruitment and retention in online citizen science projects using marketing strategies: lessons from Season Spotter , 2017 .

[26]  Marc Busch,et al.  The Gamification User Types Hexad Scale , 2016, CHI PLAY.

[27]  D. Roy,et al.  Patterns of contribution to citizen science biodiversity projects increase understanding of volunteers’ recording behaviour , 2016, Scientific Reports.

[28]  Allison L. Williams,et al.  Recruitment and Retention of Volunteers in a Citizen Science Network to Detect Invasive Species on Private Lands , 2016, Environmental Management.

[29]  Jennifer Preece,et al.  Citizen Science: New Research Challenges for Human–Computer Interaction , 2016, Int. J. Hum. Comput. Interact..

[30]  Gillian Smith,et al.  Standing on the Shoulders of Citizens: Exploring Gameful Collaboration for Creating Social Experiments , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[31]  Jian Tang,et al.  Points, stories, worlds, and diegesis: Comparing player experiences in two citizen science games , 2015, Comput. Hum. Behav..

[32]  Vickie Curtis,et al.  Motivation to Participate in an Online Citizen Science Game , 2015 .

[33]  Sebastian Deterding,et al.  The Lens of Intrinsic Skill Atoms: A Method for Gameful Design , 2015, Hum. Comput. Interact..

[34]  H. Sauermann,et al.  Crowd science user contribution patterns and their implications , 2015, Proceedings of the National Academy of Sciences.

[35]  Yulius Denny Prabowo,et al.  Defining gamification: From lexical meaning and process viewpoint towards a gameful reality , 2014, 2014 International Conference on Information Technology Systems and Innovation (ICITSI).

[36]  Katja Hutter,et al.  User Roles and Contributions in Innovation-Contest Communities , 2014, J. Manag. Inf. Syst..

[37]  Sebastian Deterding,et al.  Eudaimonic Design, or: Six Invitations to Rethink Gamification , 2014 .

[38]  Ann Blandford,et al.  Designing for dabblers and deterring drop-outs in citizen science , 2014, CHI.

[39]  R. Bonney,et al.  Next Steps for Citizen Science , 2014, Science.

[40]  Kevin Crowston,et al.  Exploring Data Quality in Games With a Purpose , 2014 .

[41]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[42]  H. Sauermann,et al.  Crowd Science: The Organization of Scientific Research in Open Collaborative Projects , 2013 .

[43]  Rick Bonney,et al.  The current state of citizen science as a tool for ecological research and public engagement , 2012 .

[44]  Arthur A. Raney,et al.  Entertainment as Pleasurable and Meaningful: Identifying Hedonic and Eudaimonic Motivations for Entertainment Consumption , 2011 .

[45]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[46]  Kenton O'Hara,et al.  Gamification. using game-design elements in non-gaming contexts , 2011, CHI Extended Abstracts.

[47]  George Mangalaraj,et al.  Are We Wielding this Hammer Correctly? A Reflective Review of the Application of Cluster Analysis in Information Systems Research , 2011, J. Assoc. Inf. Syst..

[48]  Guojun Gan,et al.  Data Clustering Algorithms , 2011 .

[49]  Kevin Crowston,et al.  From Conservation to Crowdsourcing: A Typology of Citizen Science , 2011, 2011 44th Hawaii International Conference on System Sciences.

[50]  Scott Rogers,et al.  Level Up!: The Guide to Great Video Game Design , 2010 .

[51]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[52]  James J. Appleton,et al.  Student engagement with school: Critical conceptual and methodological issues of the construct. , 2008 .

[53]  Manfred Tscheligi,et al.  Evaluating user experiences in games , 2008, CHI Extended Abstracts.

[54]  J. Cohn.  Citizen Science: Can Volunteers Do Real Research? , 2008 .

[55]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[56]  Donald A. Norman,et al.  Introduction to This Special Section on Beauty, Goodness, and Usability , 2004, Hum. Comput. Interact..

[57]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[58]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[59]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[60]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[61]  G. W. Milligan,et al.  Methodology Review: Clustering Methods , 1987 .

[62]  G. W. Milligan,et al.  An examination of procedures for determining the number of clusters in a data set , 1985 .

[63]  Thomas W. Malone,et al.  Heuristics for designing enjoyable user interfaces: Lessons from computer games , 1982, CHI '82.

[64]  Karin Ackermann,et al.  Designing Virtual Worlds , 2016 .

[65]  Heather L. O'Brien,et al.  Theoretical Perspectives on User Engagement , 2016, Why Engagement Matters.

[66]  Steffen P. Walz,et al.  Position Statement: I'm Not Playful, I'm Gameful , 2014 .

[67]  Paul V Stenis,et al.  Uncertainty in Games , 2013 .

[68]  Joydeep Ghosh,et al.  Data Clustering Algorithms And Applications , 2013 .

[69]  M. Oliver,et al.  Appreciation as Audience Response: Exploring Entertainment Gratifications beyond Hedonism. , 2010 .

[70]  Sheng-Chin Yu,et al.  journal homepage: www.elsevier.com/locate/compedu , 2022 .

[71]  Karolien Poels,et al.  Characterising and measuring user experiences in digital games , 2007 .

[72]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .

[73]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[74]  André Hardy,et al.  An examination of procedures for determining the number of clusters in a data set , 1994 .