Effects of gamification on participation and data quality in a real-world market research domain

Gamification has become an increasingly popular way to improve user engagement and motivation, but there is currently a lack of empirical research to demonstrate that increased gamification provides these benefits. To help address this problem we designed three versions of a gamified market research survey and tested them alongside the established industry standard in a study of over 600 participants. We also highlight examples where game elements compromise respondent data, and provide design solutions that correct the problem without losing the motivational benefits of gamification.

[1]  Noah Wardrip-Fruin,et al.  Motivational game design patterns of 'ville games , 2012, FDG.

[2]  Alexandre N. Tuch,et al.  Disassembling gamification: the effects of points and meaning on user motivation and performance , 2013, CHI Extended Abstracts.

[3]  Ben Shneiderman,et al.  Designing for fun: how can we design user interfaces to be more fun? , 2004, INTR.

[4]  Oliver Korn,et al.  Industrial playgrounds: how gamification helps to enrich work for elderly or impaired persons in production , 2012, EICS '12.

[5]  Kevin Lane Keller Conceptualizing, Measuring, and Managing Customer-Based Brand Equity , 1993 .

[6]  Aisling Kelliher,et al.  Taskville: visualizing tasks and raising awareness in the workplace , 2013, CHI Extended Abstracts.

[7]  Dennis L. Chao,et al.  Doom as an interface for process management , 2001, CHI.

[8]  Joseph S. Valacich,et al.  Enhancing the Motivational Affordance of Information Systems: The Effects of Real-Time Performance Feedback and Goal Setting in Group Collaboration Environments , 2010, Manag. Sci..

[9]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[10]  Luca Console,et al.  Playing while Testing: How to Gamify a User Field Evaluation , 2013, CHI 2013.

[11]  Deborah Wilson,et al.  The development of the KubeMatrix™ as a mobile app for market research online communities , 2011 .

[12]  R. Adams Proceedings , 1947 .

[13]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[14]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[15]  Otto Chrons,et al.  Digitalkoot: Making Old Archives Accessible Using Crowdsourcing , 2011, Human Computation.

[16]  M. Couper,et al.  METHODS FOR TESTING AND EVALUATING SURVEY QUESTIONS , 2004 .

[17]  Kenton O'Hara,et al.  Gamification. using game-design elements in non-gaming contexts , 2011, CHI Extended Abstracts.

[18]  Andrew K. Przybylski,et al.  The Motivational Pull of Video Games: A Self-Determination Theory Approach , 2006 .

[19]  Paul J. Krause,et al.  Tiger Nation: Empowering citizen scientists , 2012, 2012 6th IEEE International Conference on Digital Ecosystems and Technologies (DEST).

[20]  T. Guin,et al.  Myths and Realities of Respondent Engagement in Online Surveys , 2012 .

[21]  David R. Flatla,et al.  Calibration games: making calibration tasks enjoyable by adding motivating game elements , 2011, UIST.

[22]  G. Geetha,et al.  CAPTCHINO - A Gamification of Image-Based CAPTCHAs to Evaluate Usability Issues , 2012, 2012 International Conference on Computing Sciences.

[23]  Susanne Robra-Bissantz,et al.  Gamification of online idea competitions: insights from an explorative case , 2011, GI-Jahrestagung.

[24]  Elizabeth Martin,et al.  METHODS FOR TESTING AND EVALUATING SURVEY QUESTIONS , 2004 .

[25]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .