Iterated crowdsourcing dilemma game

The Internet has enabled the emergence of collective problem solving, also known as crowdsourcing, as a viable option for solving complex tasks. However, the openness of crowdsourcing presents a challenge because solutions obtained by it can be sabotaged, stolen, and manipulated at a low cost for the attacker. We extend a previously proposed crowdsourcing dilemma game to an iterated game to address this question. We enumerate pure evolutionarily stable strategies within the class of so-called reactive strategies, i.e., those depending on the last action of the opponent. Among the 4096 possible reactive strategies, we find 16 strategies each of which is stable in some parameter regions. Repeated encounters of the players can improve social welfare when the damage inflicted by an attack and the cost of attack are both small. Under the current framework, repeated interactions do not really ameliorate the crowdsourcing dilemma in a majority of the parameter space.

[1]  Acknowledgments , 2006, Molecular and Cellular Endocrinology.

[2]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[3]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[4]  David P. Kraines,et al.  Learning to cooperate with Pavlov an adaptive strategy for the iterated Prisoner's Dilemma with noise , 1993 .

[5]  E. Hand,et al.  Citizen science: People power , 2010, Nature.

[6]  Damon Horowitz,et al.  The anatomy of a large-scale social search engine , 2010, WWW '10.

[7]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[8]  Pascal Van Hentenryck,et al.  Crowdsourcing Dilemma , 2013, ArXiv.

[9]  Luis von Ahn Games with a Purpose , 2006, Computer.

[10]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[11]  John C. Tang,et al.  Reflecting on the DARPA Red Balloon Challenge , 2011, Commun. ACM.

[12]  Fang Wu,et al.  Crowdsourcing, attention and productivity , 2008, J. Inf. Sci..

[13]  Eric Horvitz,et al.  Task routing for prediction tasks , 2012, AAMAS.

[14]  Nicholas R. Jennings,et al.  Global Manhunt Pushes the Limits of Social Mobilization , 2013, Computer.

[15]  Joseph M. Hellerstein,et al.  Searching for Jim Gray: a technical overview , 2011, CACM.

[16]  N. Oliver,et al.  People power , 2014, Nature.

[17]  Pascal Van Hentenryck,et al.  Crowdsourcing contest dilemma , 2014, Journal of The Royal Society Interface.

[18]  Yoh Iwasa,et al.  How should we define goodness?--reputation dynamics in indirect reciprocity. , 2004, Journal of theoretical biology.

[19]  Alex Pentland,et al.  Time-Critical Social Mobilization , 2010, Science.

[20]  M. Nowak,et al.  Tit for tat in heterogeneous populations , 1992, Nature.

[21]  David A. Glanzer,et al.  Technical Overview , 2008 .

[22]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[23]  Panagiotis G. Ipeirotis,et al.  Repeated labeling using multiple noisy labelers , 2012, Data Mining and Knowledge Discovery.

[24]  Gert R. G. Lanckriet,et al.  Game-powered machine learning , 2012, Proceedings of the National Academy of Sciences.

[25]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[26]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[27]  M. Nowak,et al.  The evolution of stochastic strategies in the Prisoner's Dilemma , 1990 .

[28]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[29]  Stuart Madnick,et al.  Measuring and Predicting Speed of Social Mobilization , 2013, 1303.3805.