Measuring the effect of "bottom-up" gamification in a microtask setting

We investigate "bottom-up" gamification: allowing users to define their own gamification setup at runtime, i.e., they can select game elements fitting their needs. The goal is thereby to make gamification more engaging and relevant, by providing users with more autonomy. While it was shown previously that users appreciate "bottom-up" gamification, it was left open which effects "bottom-up" has in comparison to "top-down" gamification. We contribute to this by analyzing the effects within a microtask setup in the context of the text recognition domain. Participants (N=106) had to solve tasks, and were either in one of four gamified conditions (which varied in the amount of offered choices) or had to solve the tasks without gamification. Participants making use of the "bottom-up" choices solved more tasks, providing further support that systems should enable users to define their own gamification at runtime as this can lead to positive effects.

[1]  Pascal Lessel,et al.  Expense Control: A Gamified, Semi-Automated, Crowd-Based Approach For Receipt Capturing , 2016, IUI.

[2]  Regan L. Mandryk,et al.  Manipulating Leaderboards to Induce Player Experience , 2015, CHI PLAY.

[3]  Julita Vassileva,et al.  Modeling the efficacy of persuasive strategies for different gamer types in serious games for health , 2014, User Modeling and User-Adapted Interaction.

[4]  R. Ryan,et al.  Self-determination theory , 2015 .

[5]  S. Rafaeli,et al.  Studying Gamification: The Effect of Rewards and Incentives on Motivation , 2015 .

[6]  T. C. Nicholas Graham,et al.  Beyond designing for motivation: the importance of context in gamification , 2014, CHI PLAY.

[7]  Antonio Krüger,et al.  "Don't Whip Me With Your Games": Investigating "Bottom-Up" Gamification , 2016, CHI.

[8]  Yu-Hao Lee,et al.  Impacts of Forced Serious Game Play on Vulnerable Subgroups , 2011, Int. J. Gaming Comput. Mediat. Simulations.

[9]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[10]  Jaime Teevan,et al.  Selfsourcing personal tasks , 2014, CHI Extended Abstracts.

[11]  Deborah I. Fels,et al.  Gamification in theory and action: A survey , 2015, Int. J. Hum. Comput. Stud..

[12]  Derek Ruths,et al.  How One Microtask Affects Another , 2016, CHI.

[13]  Marc Busch,et al.  The Gamification User Types Hexad Scale , 2016, CHI PLAY.

[14]  Hironobu Takagi,et al.  Motivating Multi-Generational Crowd Workers in Social-Purpose Work , 2015, CSCW.

[15]  Marc Jay,et al.  Using crowdsourcing to support pro-environmental community activism , 2013, CHI.

[16]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[17]  Jaime Teevan,et al.  Chain Reactions: The Impact of Order on Microtask Chains , 2016, CHI.

[18]  Daniel J. Wigdor,et al.  Slide to X: unlocking the potential of smartphone unlocking , 2014, CHI.

[19]  Juho Hamari,et al.  Gamification in Crowdsourcing: A Review , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[20]  Ido Guy,et al.  Games for Crowds: A Crowdsourcing Game Platform for the Enterprise , 2015, CSCW.

[21]  Ethan Mollick,et al.  Mandatory Fun: Consent, Gamification and the Impact of Games at Work , 2014 .

[22]  Alexandre N. Tuch,et al.  Disassembling gamification: the effects of points and meaning on user motivation and performance , 2013, CHI Extended Abstracts.

[23]  Harri Sarsa.  Does Gamification Work? A Literature Review , 2013 .

[24]  Scott Nicholson.  A User-Centered Theoretical Framework for Meaningful Gamification , 2012 .

[25]  Stefan Greuter,et al.  Towards personalised, gamified systems: an investigation into game design, personality and player typologies , 2013, IE.

[26]  Elena Paslaru Bontas Simperl,et al.  Improving Paid Microtasks through Gamification and Adaptive Furtherance Incentives , 2015, WWW.

[27]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[28]  Wai-Tat Fu,et al.  Leveraging the crowd to improve feature-sentiment analysis of user reviews , 2013, IUI '13.

[29]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[30]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.