Striving to Earn More: A Survey of Work Strategies and Tool Use Among Crowd Workers

Earning money is a primary motivation for workers on Amazon Mechanical Turk, but earning a good wage is difficult because work that pays well is not easily identified and can be time-consuming to find. We explored the strategies that both lowand high-earning workers use to find and complete tasks via a survey of 360 workers. Nearly all workers surveyed had earning money as their primary goal, and workers used many of the same tools (browser extensions and scripts) and strategies in an attempt to earn more money, regardless of earning level. However, high-earning workers used more tools, were more involved in worker communities, and more heavily used batch completion strategies. A natural next step is to use automated systems to assist workers with finding and completing tasks. Workers found this idea interesting, but expressed concerns about impact on the quality of their work and whether using automated tools to support them would violate platform rules. We conclude with ideas for future work in supporting workers to earn more and design considerations

[1]  Lydia B. Chilton,et al.  Task search in a human computation market , 2010, HCOMP '10.

[2]  Chris Callison-Burch,et al.  A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk , 2017, CHI.

[3]  M. Six Silberman,et al.  Turkopticon: interrupting worker invisibility in amazon mechanical turk , 2013, CHI.

[4]  M. Six Silberman,et al.  Ethics and tactics of professional crowdwork , 2010, XRDS.

[5]  Lydia B. Chilton,et al.  The labor economics of paid crowdsourcing , 2010, EC '10.

[6]  M. Six Silberman,et al.  Stories We Tell About Labor: Turkopticon and the Trouble with "Design" , 2016, CHI.

[7]  Michael S. Bernstein,et al.  We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers , 2015, CHI.

[8]  Panagiotis G. Ipeirotis Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.

[9]  Gordon B. Schmidt,et al.  Fifty Days an MTurk Worker: The Social and Motivational Context for Amazon Mechanical Turk Workers , 2015, Industrial and Organizational Psychology.

[10]  Michael S. Bernstein,et al.  Daemo: A Self-Governed Crowdsourcing Marketplace , 2015, UIST.

[11]  Sihem Amer-Yahia,et al.  Personalized and Diverse Task Composition in Crowdsourcing , 2018, IEEE Transactions on Knowledge and Data Engineering.

[12]  Jeffrey P. Bigham,et al.  A 10-Month-Long Deployment Study of On-Demand Recruiting for Low-Latency Crowdsourcing , 2017, HCOMP.

[13]  Chris Callison-Burch,et al.  Crowd-Workers: Aggregating Information Across Turkers to Help Them Find Higher Paying Work , 2014, HCOMP.

[14]  David B. Martin,et al.  TurkBench: Rendering the Market for Turkers , 2015, CHI.

[15]  Jacki O'Neill,et al.  Being a turker , 2014, CSCW.

[16]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[17]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.