Crowdsourcing with All-Pay Auctions: A Field Experiment on Taskcn

To explore the effects of different incentives on crowdsourcing participation and submission quality, we conduct a randomized field experiment on Taskcn, a large Chinese crowdsourcing site using mechanisms with features of an all-pay auction. In our study, we systematically vary the size of the reward as well as the presence of a soft reserve, or early high-quality submission. We find that a higher reward induces significantly more submissions and submissions of higher quality. In comparison, we find that high-quality users are significantly less likely to enter tasks where a high-quality solution has already been submitted, resulting in lower overall quality in subsequent submissions in such soft reserve treatments. Data, as supplemental material, are available at http://dx.doi.org/10.1287/mnsc.2013.1845 . This paper was accepted by Uri Gneezy, behavioral economics.

[1]  Marie Claire Villeval,et al.  Performance-pay, sorting and social motivation , 2008 .

[2]  B. Moldovanu,et al.  The Optimal Allocation of Prizes in Contests , 2001 .

[3]  Rann Smorodinsky,et al.  All-Pay Auctions - An Experimental Study , 2006 .

[4]  J. Heckman Sample selection bias as a specification error , 1979 .

[5]  Nikolay Archak,et al.  Money, glory and cheap talk: analyzing strategic behavior of contestants in simultaneous crowdsourcing contests on TopCoder.com , 2010, WWW '10.

[6]  Yan Chen,et al.  Re-examining price as a predictor of answer quality in an online q&a site , 2010, CHI.

[7]  Mark S. Ackerman,et al.  Questions in, knowledge in?: a study of naver's question answering community , 2009, CHI.

[8]  Jeff Howe,et al.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2008, Human Resource Management International Digest.

[9]  Gadi Fibich,et al.  All-pay auctions with risk-averse players , 2006, Int. J. Game Theory.

[10]  Armin Falk,et al.  Performance Pay and Multi-Dimensional Sorting: Productivity, Preferences and Gender , 2006, SSRN Electronic Journal.

[11]  E. Maasland,et al.  Auction Theory , 2021, Springer Texts in Business and Economics.

[12]  A. Schotter,et al.  Workaholics and Dropouts in Organizations , 2010 .

[13]  E. Lazear,et al.  Rank-Order Tournaments as Optimum Labor Contracts , 1979, Journal of Political Economy.

[14]  Charles Noussair,et al.  Behavior in all-pay auctions with incomplete information , 2006, Games Econ. Behav..

[15]  Sheizaf Rafaeli,et al.  Predictors of answer quality in online Q&A sites , 2008, CHI.

[16]  Tor Eriksson,et al.  Self-Selection and the Efficiency of Tournaments , 2006, SSRN Electronic Journal.

[17]  Ella Segev,et al.  Multi-Stage Sequential All-Pay Auctions , 2012 .

[18]  Kai A. Konrad,et al.  The generalized Stackelberg equilibrium of the all-pay auction with complete information , 2005, SSRN Electronic Journal.

[19]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[20]  Tracy Xiao Liu,et al.  Competing Openly or Blindly in Crowdsourcing Contests ? , 2014 .

[21]  Yi Xu,et al.  Innovation Contests, Open Innovation, and Multiagent Problem Solving , 2008, Manag. Sci..

[22]  Milan Vojnovic,et al.  Crowdsourcing and all-pay auctions , 2009, EC '09.

[23]  Jacob K. Goeree,et al.  Rent Seeking with Bounded Rationality: An Analysis of the All‐Pay Auction , 1998, Journal of Political Economy.

[24]  Casper G. de Vries,et al.  An experimental examination of rational rent-seeking , 1998 .

[25]  Kai A. Konrad,et al.  Strategy and Dynamics in Contests , 2009 .

[26]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[27]  Ella Segev,et al.  Sequential all-pay auctions with head starts , 2014, Soc. Choice Welf..

[28]  Mark S. Ackerman,et al.  Crowdsourcing and knowledge sharing: strategic user behavior on taskcn , 2008, EC '08.

[29]  Roman M. Sheremeta,et al.  A survey of experimental research on contests, all-pay auctions and tournaments , 2012, Experimental Economics.

[30]  Leibniz-Informationszentrum Wirtschaft,et al.  A survey of experimental research on contests, all- pay auctions and tournaments , 2012 .

[31]  Jiang Yang,et al.  Seeking and Offering Expertise Across Categories: A Sustainable Mechanism Works for Baidu Knows , 2009, ICWSM.

[32]  Karim R. Lakhani,et al.  Marginality and Problem-Solving Effectiveness in Broadcast Search , 2010, Organ. Sci..

[33]  Lada A. Adamic,et al.  Crowdsourcing with all-pay auctions: A field experiment on Taskcn , 2011, ASIST.

[34]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[35]  J. Carpenter,et al.  Tournaments and Office Politics: Evidence from a Real Effort Experiment , 2007, SSRN Electronic Journal.

[36]  Charles N. Noussair,et al.  Behavior in all-pay auctions under incomplete information , 2006 .

[37]  Oded Nov,et al.  What drives content tagging: the case of photos on Flickr , 2008, CHI.

[38]  Colin Camerer,et al.  A Cognitive Hierarchy Model of Games , 2004 .

[39]  John Morgan,et al.  Endogenous entry in contests , 2012 .

[40]  Wolfgang Leininger,et al.  Asymmetric All-Pay Auctions with Incomplete Information: The Two-Player Case , 1996 .

[41]  Partha Dasgupta,et al.  The Theory of Technological Competition , 1986 .

[42]  J. Riley,et al.  Politically Contestable Rents And Transfers , 1989 .

[43]  Tor Eriksson,et al.  Does Self-Selection Improve the Efficiency , 2005 .

[44]  Daniela Puzzello,et al.  An experimental investigation of overdissipation in the all pay auction , 2010 .

[45]  Barry Nalebuff,et al.  Prices and Incentives: Towards a General Theory of Compensation and Competition , 1983 .

[46]  J. Morgan,et al.  An Analysis of the War of Attrition and the All-Pay Auction , 1997 .

[47]  Teck-Hua Ho,et al.  Knowledge Market Design: A Field Experiment at Google Answers , 2010 .

[48]  Michael R. Baye,et al.  The all-pay auction with complete information , 1990 .

[49]  Fei Song,et al.  Sorting and Incentive Effects of Pay for Performance: An Experimental Investigation , 2007 .

[50]  Mark S. Ackerman,et al.  Competing to Share Expertise: The Taskcn Knowledge Sharing Community , 2021, ICWSM.

[51]  L. Samuelson Economic Theory and Experimental Economics , 2005 .

[52]  Michael L. Bognanno,et al.  Do Tournaments Have Incentive Effects? , 1988, Journal of Political Economy.

[53]  Frank Kleemann,et al.  Un(der)paid innovators: the commercial utilization of consumer work through crowdsourcing , 2008 .

[54]  Karim R. Lakhani,et al.  Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis , 2011, Manag. Sci..

[55]  Esteve Almirall,et al.  The Underlying Mechanisms of Online Open Innovation Intermediaries , 2012 .

[56]  Paolo Bertoletti,et al.  On the reserve price in all-pay auctions with complete information and lobbying games , 2006 .

[57]  Edward P. Lazear,et al.  The Power of Incentives , 2000 .

[58]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[59]  G. Harrison,et al.  Field experiments , 1924, The Journal of Agricultural Science.

[60]  Robert J. Reilly,et al.  Do too many cooks always spoil the stew? An experimental analysis of rent-seeking and the role of a strategic buyer , 1998 .

[61]  G. Tullock Efficient Rent Seeking , 2001 .