Quality Control in Crowdsourcing Systems

As a new distributed computing model, crowdsourcing lets people leverage the crowd's intelligence and wisdom toward solving problems. This article proposes a framework for characterizing various di...

[1]  Aniket Kittur,et al.  CrowdForge: crowdsourcing complex work , 2011, UIST.

[2]  Schahram Dustdar,et al.  Predicting QoS in Scheduled Crowdsourcing , 2012, CAiSE.

[3]  Lydia B. Chilton,et al.  Exploring iterative and parallel human computation processes , 2010, HCOMP '10.

[4]  Schahram Dustdar,et al.  Expert Discovery and Interactions in Mixed Service-Oriented Systems , 2012, IEEE Transactions on Services Computing.

[5]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[6]  Alton Yeow-Kuan Chua,et al.  What Makes a High-Quality User-Generated Answer? , 2011, IEEE Internet Computing.

[7]  Björn Hartmann,et al.  Collaboratively crowdsourcing workflows with turkomatic , 2012, CSCW.

[8]  Luca de Alfaro,et al.  Reputation systems for open collaboration , 2011, Commun. ACM.

[9]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[10]  Lydia B. Chilton,et al.  TurKit: Tools for iterative tasks on mechanical turk , 2009, 2009 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[11]  Jim Laredo,et al.  PeopleCloud for the Globally Integrated Enterprise , 2009, ICSOC/ServiceWave Workshops.

[12]  Scott R. Klemmer,et al.  Shepherding the crowd yields better work , 2012, CSCW.

[13]  Lydia B. Chilton,et al.  TurKit: human computation algorithms on mechanical turk , 2010, UIST.

[14]  Gang Wang,et al.  Serf and turf: crowdturfing for fun and profit , 2011, WWW.

[15]  Aleksandar Ignjatovic,et al.  An Analytic Approach to Reputation Ranking of Participants in Online Transactions , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[16]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[17]  Schahram Dustdar,et al.  Modeling Rewards and Incentive Mechanisms for Social BPM , 2012, BPM.

[18]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[19]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[20]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[21]  Schahram Dustdar,et al.  Programming Hybrid Services in the Cloud , 2012, ICSOC.

[22]  Cristina Nita-Rotaru,et al.  A survey of attack and defense techniques for reputation systems , 2009, CSUR.

[23]  Alon Y. Halevy,et al.  Crowdsourcing systems on the World-Wide Web , 2011, Commun. ACM.

[24]  Aniket Kittur,et al.  CrowdWeaver: visually managing complex crowd work , 2012, CSCW.

[25]  Jenny Chen,et al.  Opportunities for Crowdsourcing Research on Amazon Mechanical Turk , 2011 .