Gamification in Science: A Study of Requirements in the Context of Reproducible Research

The need for data preservation and reproducible research is widely recognized in the scientific community. Yet, researchers often struggle to find the motivation to contribute to data repositories and to use tools that foster reproducibility. In this paper, we explore possible uses of gamification to support reproducible practices in High Energy Physics. To understand how gamification can be effective in research tools, we participated in a workshop and performed interviews with data analysts. We then designed two interactive prototypes of a research preservation service that use contrasting gamification strategies. The evaluation of the prototypes showed that gamification needs to address core scientific challenges, in particular the fair reflection of quality and individual contribution. Through thematic analysis, we identified four themes which describe perceptions and requirements of gamification in research: Contribution, Metrics, Applications and Scientific practice. Based on these, we discuss design implications for gamification in science.

[1]  Pawel Wozniak,et al.  Just Not The Usual Workplace: Meaningful Gamification in Science , 2018, Mensch & Computer Workshopband.

[2]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[3]  Robin Dasler,et al.  CERN Analysis Preservation: A Novel Digital Library Service to Enable Reusable and Reproducible Research , 2016, TPDL.

[4]  Brian A. Nosek,et al.  An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[5]  Janaki Kumar,et al.  Gamification at Work: Designing Engaging Business Software , 2013, HCI.

[6]  Victoria Stodden,et al.  Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research , 2014 .

[7]  Erik Schultes,et al.  The FAIR Guiding Principles for scientific data management and stewardship , 2016, Scientific Data.

[8]  Susann Fiedler,et al.  Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency , 2016, PLoS biology.

[9]  Lennart E. Nacke,et al.  Gamification : Toward a Definition , 2022 .

[10]  Pawel W. Wozniak,et al.  Supporting Meaningful Personal Fitness: the Tracker Goal Evolution Model , 2018, CHI.

[11]  Heinz Mandl,et al.  How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction , 2017, Comput. Hum. Behav..

[12]  Anisa Rowhani-Farid,et al.  What incentives increase data sharing in health and medical research? A systematic review , 2017, Research Integrity and Peer Review.

[13]  Lennart E. Nacke,et al.  The maturing of gamification research , 2017, Comput. Hum. Behav..

[14]  Ann Blandford,et al.  Qualitative HCI Research: Going Behind the Scenes , 2016, Synthesis Lectures on Human-Centered Informatics.

[15]  Anna L. Cox,et al.  “I want to be a captain! I want to be a captain!”: gamification in the old weather citizen science project , 2013, Gamification.

[16]  Carlos Delgado Kloos,et al.  Gamification for Engaging Computer Science Students in Learning Activities: A Case Study , 2014, IEEE Transactions on Learning Technologies.

[17]  Jonathan F. Russell,et al.  If a job is worth doing, it is worth doing twice , 2013, Nature.

[18]  S. Ross.  :Scholarship in the Digital Age: Information, Infrastructure, and the Internet , 2009 .

[19]  Scott Nicholson,et al.  A RECIPE for Meaningful Gamification , 2015 .

[20]  Gustavo Fortes Tondello,et al.  Elements of Gameful Design Emerging from User Preferences , 2017, CHI PLAY.

[21]  Carole A. Goble,et al.  Why Linked Data is Not Enough for Scientists , 2010, 2010 IEEE Sixth International Conference on e-Science.

[22]  Jakub Swacha,et al.  Design patterns for gamification of work , 2016, TEEM.

[23]  Vaninha Vieira,et al.  Towards a Framework for Gamification Design on Crowdsourcing Systems: The G.A.M.E. Approach , 2015, 2015 12th International Conference on Information Technology - New Generations.

[24]  Zeeya Merali.  Physics: The Large Human Collider , 2010, Nature.

[25]  Jennifer Preece,et al.  Gamifying citizen science: a study of two user groups , 2014, CSCW Companion.

[26]  Laura Rueda,et al.  Open Data and Data Analysis Preservation Services for LHC Experiments , 2015, Journal of Physics: Conference Series.

[27]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[28]  Rita Orji,et al.  Personalizing Persuasive Strategies in Gameful Systems to Gamification User Types , 2018, CHI.

[29]  Alessandro Canossa,et al.  Gamifying Research: Strategies, Opportunities, Challenges, Ethics , 2015, CHI Extended Abstracts.

[30]  M. Baker.  1,500 scientists lift the lid on reproducibility , 2016, Nature.

[31]  Ronald F. Boisvert,et al.  Incentivizing reproducibility , 2016, Commun. ACM.

[32]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[33]  Steve Dale.  Gamification Making work fun, or making fun of work? , 2014 .

[34]  Huseyin Cavusoglu,et al.  Can Gamification Motivate Voluntary Contributions?: The Case of StackOverflow Q&A Community , 2015, CSCW Companion.

[35]  K. Knorr-Cetina,et al.  Epistemic cultures : how the sciences make knowledge , 1999 .

[36]  K. Werbach,et al.  For the Win: How Game Thinking Can Revolutionize Your Business , 2012 .

[37]  Tim Berners-Lee,et al.  World-Wide Web: The Information Universe , 1992, Electron. Netw. Res. Appl. Policy.

[38]  Carole A. Goble,et al.  The Research Object Suite of Ontologies: Sharing and Exchanging Research Data and Methods on the Open Web , 2014, ArXiv.