Incentive Mechanisms for Crowdsourcing Platforms

Crowdsourcing emerged with the development of Web 2.0 technologies as a distributed online practice that harnesses the collective aptitudes and skills of the crowd in order to reach specific goals. The success of crowdsourcing systems is influenced by the users’ levels of participation and interactions on the platform. Therefore, there is a need for the incorporation of appropriate incentive mechanisms that would lead to sustained user engagement and quality contributions. Accordingly, the aim of the particular paper is threefold: first, to provide an overview of user motives and incentives, second, to present the corresponding incentive mechanisms used to trigger these motives, alongside with some indicative examples of successful crowdsourcing platforms that incorporate these incentive mechanisms, and third, to provide recommendations on their careful design in order to cater to the context and goal of the platform.

[1]  Dana Chandler,et al.  Breaking Monotony with Meaning: Motivation in Crowdsourcing Markets , 2012, ArXiv.

[2]  Luis von Ahn.  Games with a Purpose , 2006, Computer.

[3]  Henriette Cramer,et al.  Performing a check-in: emerging practices, norms and 'conflicts' in location-sharing using foursquare , 2011, Mobile HCI.

[4]  Elisa Bertino,et al.  Reputation management in crowdsourcing systems , 2012, 8th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom).

[5]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[6]  Anita Greenhill,et al.  Playing with science:gamised aspects of gamification found on the Online Citizen Science Project - Zooniverse , 2014 .

[7]  Chrysanthos Dellarocas.  Designing Reputation Systems for the Social Web , 2010 .

[8]  Jan Marco Leimeister,et al.  Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition , 2009, J. Manag. Inf. Syst..

[9]  Qinghua Zhu,et al.  Evaluation on crowdsourcing research: Current status and future direction , 2012, Information Systems Frontiers.

[10]  Wang Zhongmin,et al.  Anonymity, Social Image, and the Competition for Volunteers: A Case Study of the Online Market for Reviews , 2010 .

[11]  Marc Jay,et al.  Using crowdsourcing to support pro-environmental community activism , 2013, CHI.

[12]  Liam Murray,et al.  Motivation: a proposed taxonomy using gamification , 2014 .

[13]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[14]  Cameron Marlow,et al.  Feed me: motivating newcomer contribution in social network sites , 2009, CHI.

[15]  M. Hossain,et al.  Users' motivation to participate in online crowdsourcing platforms , 2012, 2012 International Conference on Innovation Management and Technology Research.

[16]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[17]  Nicola Zannone,et al.  A reference model for reputation systems , 2014, Decis. Support Syst..

[18]  Lina Yordanova,et al.  Gamification in education , 2014 .

[19]  Josh Lerner,et al.  The Simple Economics of Open Source , 2000 .

[20]  Yiannis Kompatsiaris,et al.  Sensing Trending Topics in Twitter , 2013, IEEE Transactions on Multimedia.

[21]  Robert E. Kraut,et al.  Predicting Continued Participation in Newsgroups , 2006, J. Comput. Mediat. Commun..

[22]  Rekha Rani,et al.  MOTIVATION AND WORK MOTIVATION: CONCEPTS, THEORIES & RESEARCHES , 2012 .

[23]  Lili Liu,et al.  The Effects of Game Dynamics on User Engagement in Gamified Systems , 2015, 2015 48th Hawaii International Conference on System Sciences.

[24]  F. Maxwell Harper,et al.  Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens , 2010, Computational Social Systems and the Internet.

[25]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[26]  M. Blanchette,et al.  Phylo: A Citizen Science Approach for Improving Multiple Sequence Alignment , 2012, PloS one.

[27]  Izabel de Moraes Sarmento Rego.  Mobile Language Learning: How Gamification Improves the Experience , 2015 .

[28]  Kris Bubendorfer,et al.  Reputation systems: A survey and taxonomy , 2015, J. Parallel Distributed Comput..

[29]  A. Bruckman,et al.  Why Do People Write for Wikipedia? Incentives to Contribute to Open-Content Publishing , 2005 .

[30]  Sharon Drew,et al.  Can't Play Won't Play: Simply Sizzling Ideas to get the Ball Rolling for Children with Dyspraxia , 2008 .

[31]  Fernando González-Ladrón-de-Guevara,et al.  Towards an integrated crowdsourcing definition , 2012, J. Inf. Sci..

[32]  Leandros Tassiulas,et al.  Reputation-Based Resource Allocation in P2P Systems of Rational Users , 2010, IEEE Transactions on Parallel and Distributed Systems.

[33]  Pamela Paulsen,et al.  May , 1890, The Hospital.

[34]  Nikolay Archak,et al.  Money, glory and cheap talk: analyzing strategic behavior of contestants in simultaneous crowdsourcing contests on TopCoder.com , 2010, WWW '10.

[35]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[36]  Huiji Gao,et al.  Harnessing the Crowdsourcing Power of Social Media for Disaster Relief , 2011, IEEE Intelligent Systems.

[37]  Anne C. Rouse,et al.  A Preliminary Taxonomy of Crowdsourcing , 2010 .

[38]  Eric Schenk,et al.  Towards a characterization of crowdsourcing practices , 2011 .

[39]  A. Maslow.  A Theory of Human Motivation , 1943 .

[40]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[41]  Yair Movshovitz-Attias,et al.  Analysis of the reputation system and user contributions on a question answering website: StackOverflow , 2013, 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013).

[42]  Juho Hamari,et al.  Gamification in Crowdsourcing: A Review , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[43]  Artur Lugmayr,et al.  Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments , 2010 .

[44]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[45]  Daren C. Brabham.  MOVING THE CROWD AT THREADLESS , 2010 .

[46]  Aniket Kittur,et al.  An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets , 2011, ICWSM.

[47]  John Zimmerman,et al.  I'm the mayor of my house: examining why people use foursquare - a social-driven location sharing application , 2011, CHI.

[48]  Teresa Doran,et al.  IEEE 1220: for practical systems engineering , 2006, Computer.

[49]  Daren C. Brabham.  Moving the crowd at iStockphoto: The composition of the crowd and motivations for participation in a crowdsourcing application , 2008, First Monday.

[50]  S. P. Singh.  Gamification: A Strategic Tool for Organizational Effectiveness , 2012 .