Improving the efficiency of crowdsourcing contests

While winner-take-all crowdsourcing contests are wide spread in practice, several researchers have observed that their social welfare can be poor due to effort exerted by contestants who are never rewarded. In this paper we study the problem of efficiency in winner-take-all crowdsourcing contests. Using a discrete choice model to capture contestants' production qualities, we introduce a mechanism which filters out low-expertise contestants, before they are asked to produce a solution. We show that under a set of natural assumptions, such a mechanism has desirable incentive properties, attracts high-quality contestants and can improve social welfare. We also provide insights into the problem of prize setting for such contests.

[1]  Milan Vojnovic,et al.  Crowdsourcing and all-pay auctions , 2009, EC '09.

[2]  Daren C. Brabham Crowdsourcing as a Model for Problem Solving , 2008 .

[3]  Balasubramanian Sivan,et al.  Optimal Crowdsourcing Contests , 2011, Encyclopedia of Algorithms.

[4]  Ruggiero Cavallo,et al.  Winner-Take-All Crowdsourcing Contests with Stochastic Production , 2013, HCOMP.

[5]  Rajiv Kishore,et al.  Rules of Crowdsourcing: Models, Issues, and Systems of Control , 2013, Inf. Syst. Manag..

[6]  Schahram Dustdar,et al.  Auction-based crowdsourcing supporting skill management , 2013, Inf. Syst..

[7]  Gireeja Ranade,et al.  To Crowdsource or Not To Crowdsource? , 2012, HCOMP@AAAI.

[8]  Devavrat Shah,et al.  Iterative Learning for Reliable Crowdsourcing Systems , 2011, NIPS.

[9]  D. McFadden Conditional logit analysis of qualitative choice behavior , 1972 .

[10]  Björn Hartmann,et al.  What's the Right Price? Pricing Tasks for Finishing on Time , 2011, Human Computation.

[11]  Ruggiero Cavallo,et al.  Efficient crowdsourcing contests , 2012, AAMAS.

[12]  Quang Duong,et al.  Discrete Choice Models of Bidder Behavior in Sponsored Search , 2011, WINE.

[13]  Kush R. Varshney,et al.  Categorical decision making by people, committees, and crowds , 2011, 2011 Information Theory and Applications Workshop.

[14]  Arun Sundararajan,et al.  Optimal Design of Crowdsourcing Contests , 2009, ICIS.

[15]  Florian Heiss,et al.  Discrete Choice Methods with Simulation , 2016 .