Crowdsourcing markets, such as Amazon Mechanical Turk, provide a platform for matching prospective workers around the world with tasks. However, they are often plagued by workers who attempt to exert as little effort as possible, and requesters who deny workers payment for their labor. For crowdsourcing markets to succeed, it is essential to discourage such behavior. With this in mind, we propose a framework for the design and analysis of incentive mechanisms based on social norms, which consist of a set of rules that participants are expected to follow, and a mechanism for updating participants’ public reputations based on whether or not they do. We start by considering the most basic version of our model, which contains only homogeneous participants and randomly matches workers with tasks. The optimal social norm in this setting turns out to be a simple, easily comprehensible incentive mechanism in which market participants are encouraged to play a tit-for-tat-like strategy. This simple mechanism is optimal even when the set of market participants changes dynamically over time, or when some fraction of the participants may be irrational. In addition to the basic model, we demonstrate how this framework can be applied to situations in which there are heterogeneous users by giving several illustrating examples. This work is a first step towards a complete theory of incentive design for crowdsourcing systems. We hope to build upon this framework and explore more interesting and practical aspects of real online labor markets in our future work.
[1]
Michihiro Kandori.
Social Norms and Community Enforcement
,
1992
.
[2]
Glenn Ellison.
Cooperation in the Prisoner's Dilemma with Anonymous Random Matching
,
1994
.
[3]
Paul Resnick,et al.
Reputation systems
,
2000,
CACM.
[4]
E. Friedman,et al.
The Social Cost of Cheap Pseudonyms
,
2001
.
[5]
Chrysanthos Dellarocas,et al.
Reputation Mechanism Design in Online Trading Environments with Pure Moral Hazard
,
2005,
Inf. Syst. Res..
[6]
E. Friedman,et al.
Algorithmic Game Theory: Manipulation-Resistant Reputation Systems
,
2007
.
[7]
Joseph Y. Halpern,et al.
Manipulating Scrip Systems: Sybils and Collusion
,
2009,
AMMA.
[8]
David C. Parkes,et al.
Designing incentives for online question and answer forums
,
2009,
EC '09.
[9]
Panagiotis G. Ipeirotis,et al.
Quality management on Amazon Mechanical Turk
,
2010,
HCOMP '10.
[10]
Mihaela van der Schaar,et al.
Social Norms for Networked Communities
,
2011,
ArXiv.
[11]
Devavrat Shah,et al.
Iterative Learning for Reliable Crowdsourcing Systems
,
2011,
NIPS.
[12]
Mihaela van der Schaar,et al.
Peer-to-Peer Multimedia Sharing based on Social Norms
,
2011,
Signal Process. Image Commun..