Reputation-based incentive protocols in crowdsourcing applications

Crowdsourcing websites (e.g. Yahoo! Answers, Amazon Mechanical Turk, and etc.) emerged in recent years that allow requesters from all around the world to post tasks and seek help from an equally global pool of workers. However, intrinsic incentive problems reside in crowdsourcing applications as workers and requester are selfish and aim to strategically maximize their own benefit. In this paper, we propose to provide incentives for workers to exert effort using a novel game-theoretic model based on repeated games. As there is always a gap in the social welfare between the non-cooperative equilibria emerging when workers pursue their self-interests and the desirable Pareto efficient outcome, we propose a novel class of incentive protocols based on social norms which integrates reputation mechanisms into the existing pricing schemes currently implemented on crowdsourcing websites, in order to improve the performance of the non-cooperative equilibria emerging in such applications. We first formulate the exchanges on a crowdsourcing website as a two-sided market where requesters and workers are matched and play gift-giving games repeatedly. Subsequently, we study the protocol designer's problem of finding an optimal and sustainable (equilibrium) protocol which achieves the highest social welfare for that website. We prove that the proposed incentives protocol can make the website operate close to Pareto efficiency. Moreover, we also examine an alternative scenario, where the protocol designer aims at maximizing the revenue of the website and evaluate the performance of the optimal protocol.

[1]  Mark S. Ackerman,et al.  Crowdsourcing and knowledge sharing: strategic user behavior on taskcn , 2008, EC '08.

[2]  Christos H. Papadimitriou,et al.  Free-riding and whitewashing in peer-to-peer systems , 2004, IEEE Journal on Selected Areas in Communications.

[3]  Yaron Singer,et al.  Pricing Tasks in Online Labor Markets , 2011, Human Computation.

[4]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[5]  John Joseph Horton,et al.  Online Labor Markets , 2010, WINE.

[6]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[7]  Mihaela van der Schaar,et al.  Designing Social Norm Based Incentive Schemes to Sustain Cooperation in a Large Community , 2011, GAMENETS.

[8]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[9]  Bo Jiang,et al.  Opportunistic Flooding in Low-Duty-Cycle Wireless Sensor Networks with Unreliable Links , 2009, IEEE Transactions on Computers.

[10]  David C. Parkes,et al.  Designing incentives for online question and answer forums , 2009, EC '09.

[11]  Milan Vojnovic,et al.  Crowdsourcing and all-pay auctions , 2009, EC '09.

[12]  Michihiro Kandori Social Norms and Community Enforcement , 1992 .

[13]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[14]  Teck-Hua Ho,et al.  Knowledge Market Design: A Field Experiment at Google Answers , 2010 .

[15]  David K. Levine,et al.  Evolution and Information in a Gift-Giving Game , 2001, J. Econ. Theory.

[16]  Jans Aasman Social Network Analysis and Geotemporal Reasoning in a Web 3.0 World , 2009, 2009 International Conference on Computational Science and Engineering.