Examining Crowd Work and Gig Work Through the Historical Lens of Piecework

The internet is empowering the rise of crowd work, gig work, and other forms of on--demand labor. A large and growing body of scholarship has attempted to predict the socio--technical outcomes of this shift, especially addressing three questions: begin{inlinelist} item What are the complexity limits of on-demand work?, item How far can work be decomposed into smaller microtasks?, and item What will work and the place of work look like for workers' end {inlinelist} In this paper, we look to the historical scholarship on piecework --- a similar trend of work decomposition, distribution, and payment that was popular at the turn of the nth{20} century --- to understand how these questions might play out with modern on--demand work. We identify the mechanisms that enabled and limited piecework historically, and identify whether on--demand work faces the same pitfalls or might differentiate itself. This approach introduces theoretical grounding that can help address some of the most persistent questions in crowd work, and suggests design interventions that learn from history rather than repeat it.

[1]  E. Chadwick Opening Address of the President of the Department of Economy and Trade, at the Meeting of the National Association for the Promotion of Social Science, held at York, in September, 1864 , 1865 .

[2]  C. Booth Life and Labour of the People in London , 1892 .

[3]  Steve Webb,et al.  The History of Trade Unionism , 1920 .

[4]  James Rowan A Premium System of Remunerating Labour , 1901 .

[5]  C. Booth,et al.  Life and labour of the people in London : first series : poverty , 1903 .

[6]  J. Riis How the Other Half Lives: Studies Among the Tenements of New York , 1903 .

[7]  W. Cunningham Scientific Management in the Operation of Railroads , 1911 .

[8]  D. Robertson A Narrative of the Coal Strike , 1912 .

[9]  A. C. Haddon Argonauts of the Western Pacific: An Account of Native Enterprise and Adventure in the Archipelagoes of Melanesian New Guinea , 1922, Nature.

[10]  M. Mead,et al.  Coming of Age in Samoa , 1929 .

[11]  M. Mead,et al.  Coming of Age in Samoa. , 1930 .

[12]  Daniela Fischer,et al.  Race, Language and Culture , 1940, Nature.

[13]  Donald F. Roy Efficiency and "The Fix": Informal Intergroup Relations in a Piecework Machine Shop , 1954, American Journal of Sociology.

[14]  M. J. Nadworny Scientific Management and the Unions, 1900-1932: A Historical Analysis , 1955 .

[15]  T. C. Hu Parallel Sequencing and Assembly Line Problems , 1961 .

[16]  D. C. Englebart,et al.  Augmenting human intellect: a conceptual framework , 1962 .

[17]  Douglas C. Engelbart,et al.  Augmenting human intellect: a conceptual framework , 1962 .

[18]  Sidney C. Sufrin,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups. , 1966 .

[19]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[20]  J. Hagan,et al.  Piece Work and Some of Its Consequences in the Printing and Coal Mining Industries in Australia, 1850-1930 , 1973 .

[21]  M. Weitzman The new Soviet incentive model , 1976 .

[22]  M. Weitzman The 'Ratchet Principle' and Performance Incentives , 1980 .

[23]  S. M. Jacoby Union-Management Cooperation in the United States: Lessons from the 1920S , 1983 .

[24]  Maureen Honey Creating Rosie the Riveter: Class, Gender, and Propaganda during World War II , 1984 .

[25]  David C. Schmittlein,et al.  Integration of the sales force: an empirical examination , 1984 .

[26]  Nathan Rosenberg,et al.  Inside the Black Box: Technology and Economics , 1984 .

[27]  Charles C. Brown Firms' Choice of Method of Pay , 1989 .

[28]  W. Bodmer Principles of Scientific Management , 1993, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[29]  Peter Baker Production restructuring in the textiles and clothing industries , 1993 .

[30]  G. Brady Governing the Commons: The Evolution of Institutions for Collective Action , 1993 .

[31]  Nathan Rosenberg,et al.  Exploring the Black Box: Technology, Economics, and History , 1994 .

[32]  J. Heywood,et al.  Payment by Results Systems: British Evidence , 1997 .

[33]  Walter Skok Knowledge management: London taxi cabs case study , 1999, SIGCPR '99.

[34]  T. Bewley Why Wages Don't Fall during a Recession , 1999 .

[35]  Batya Friedman,et al.  Trust online , 2000, CACM.

[36]  Richard S. J. Frackowiak,et al.  Navigation-related structural change in the hippocampi of taxi drivers. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Walter Skok,et al.  Managing knowledge within the London taxi cab service , 2000 .

[38]  Carl Graves Applying Scientific Management Principles to Railroad Repair Shops -- the Santa Fe Experience, 1904-18 , 2003 .

[39]  J. Agell,et al.  Why are Small Firms Different? Managers' Views , 2003, SSRN Electronic Journal.

[40]  David Alan Grier,et al.  When computers were human , 2005 .

[41]  R. Hart Piecework Versus Timework in British Wartime Engineering , 2005, SSRN Electronic Journal.

[42]  Yan Xiao,et al.  Coordination in Fast-Response Organizations , 2006, Manag. Sci..

[43]  David N. Figlio,et al.  Individual Teacher Incentives and Student Performance , 2006 .

[44]  Phoebe Sengers,et al.  Historical Analysis: Using the Past to Design the Future , 2006, UbiComp.

[45]  E. Maguire,et al.  Navigation around London by a taxi driver with bilateral hippocampal lesions. , 2006, Brain : a journal of neurology.

[46]  John Riedl,et al.  SuggestBot: using intelligent task routing to help people find work in wikipedia , 2007, IUI '07.

[47]  Brian P. Bailey,et al.  Effects of intelligent notification management on users and their tasks , 2008, CHI.

[48]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[49]  Jeff Howe,et al.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2008, Human Resource Management International Digest.

[50]  Panagiotis G. Ipeirotis,et al.  Get another label? improving data quality and data mining using multiple, noisy labelers , 2008, KDD.

[51]  M. Levi,et al.  Union Democracy Reexamined , 2009 .

[52]  Hugo J Spiers,et al.  Talent in the taxi: a model system for exploring expertise , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[53]  Peng Dai,et al.  Decision-Theoretic Control of Crowd-Sourced Workflows , 2010, AAAI.

[54]  Michael S. Bernstein,et al.  Soylent: a word processor with a crowd inside , 2010, UIST.

[55]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[56]  John Le,et al.  Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution , 2010 .

[57]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[58]  Lydia B. Chilton,et al.  TurKit: human computation algorithms on mechanical turk , 2010, UIST.

[59]  Rob Miller,et al.  VizWiz: nearly real-time answers to visual questions , 2010, UIST.

[60]  Panagiotis G. Ipeirotis Demographics of Mechanical Turk , 2010 .

[61]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[62]  Lydia B. Chilton,et al.  Task search in a human computation market , 2010, HCOMP '10.

[63]  Aniket Kittur,et al.  Instrumenting the crowd: using implicit behavioral measures to predict task performance , 2011, UIST.

[64]  Aniket Kittur,et al.  CrowdForge: crowdsourcing complex work , 2011, UIST.

[65]  Krzysztof Z. Gajos,et al.  Platemate: crowdsourcing nutritional analysis from food photographs , 2011, UIST.

[66]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[67]  E. Maguire,et al.  Acquiring “the Knowledge” of London's Layout Drives Structural Brain Changes , 2011, Current Biology.

[68]  Martin Schader,et al.  Managing the Crowd: Towards a Taxonomy of Crowdsourcing Processes , 2011, AMCIS.

[69]  John C. Tang,et al.  Reflecting on the DARPA Red Balloon Challenge , 2011, Commun. ACM.

[70]  Rob Miller,et al.  Real-time crowd control of existing interfaces , 2011, UIST.

[71]  Kwong-Sak Leung,et al.  A Survey of Crowdsourcing Systems , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[72]  Lukas Biewald,et al.  Programmatic Gold: Targeted and Scalable Quality Assurance in Crowdsourcing , 2011, Human Computation.

[73]  Ruck Thawonmas,et al.  Video summarization via crowdsourcing , 2011, CHI EA '11.

[74]  Daniel J. Veit,et al.  More than fun and money. Worker Motivation in Crowdsourcing - A Study on Mechanical Turk , 2011, AMCIS.

[75]  Aaron D. Shaw,et al.  Social desirability bias and self-reports of motivation: a study of amazon mechanical turk in the US and India , 2012, CHI.

[76]  A. Edmondson,et al.  Teaming: How Organizations Learn, Innovate, and Compete in the Knowledge Economy , 2012 .

[77]  E. Waltz,et al.  How i quantified myself , 2012, IEEE Spectrum.

[78]  Trebor Scholz,et al.  Digital Labor: The Internet as Playground and Factory , 2012 .

[79]  Walter S. Lasecki,et al.  Real-time captioning by groups of non-experts , 2012, UIST.

[80]  Laura A. Dabbish,et al.  Workflow transparency in a microtask marketplace , 2012, GROUP.

[81]  Aniket Kittur,et al.  CrowdScape: interactively visualizing user behavior and output , 2012, UIST.

[82]  Björn Hartmann,et al.  MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture , 2012, IEEE Internet Computing.

[83]  R. Hart,et al.  The rise and fall of piecework-timework wage differentials: market volatility, labor heterogeneity, and output pricing , 2013 .

[84]  Ignacio Aguaded The MOOC Revolution: A New Form of Education from the Technological Paradigm? , 2013 .

[85]  Jussara M. Almeida,et al.  Traffic Condition Is More Than Colored Lines on a Map: Characterization of Waze Alerts , 2013, SocInfo.

[86]  Jeffrey Nichols,et al.  Chorus: a crowd-powered conversational assistant , 2013, UIST.

[87]  Jamie K. Mccallum Global Unions, Local Power: The New Spirit of Transnational Labor Organizing , 2013 .

[88]  Ignacio Aguaded The MOOC revolution: A new form of education from the technological paradigm? , 2013 .

[89]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[90]  John S. Ahlquist,et al.  In the Interest of Others: Organizations and Social Activism , 2013 .

[91]  M. Six Silberman,et al.  Turkopticon: interrupting worker invisibility in amazon mechanical turk , 2013, CHI.

[92]  Lydia B. Chilton,et al.  Cascade: crowdsourcing taxonomy creation , 2013, CHI.

[93]  A. Davies,et al.  The Origins of the Ideal Worker: The Separation of Work and Home in the United States From the Market Revolution to 1950 , 2014 .

[94]  Jeffrey P. Bigham,et al.  Low Effort Crowdsourcing: Leveraging Peripheral Attention for Crowd Work , 2014, HCOMP.

[95]  G. Friedman Workers without employers: shadow corporations and the rise of the gig economy , 2014 .

[96]  Jaime Teevan,et al.  Selfsourcing personal tasks , 2014, CHI Extended Abstracts.

[97]  Michael S. Bernstein,et al.  Context Trees: Crowdsourcing Global Understanding from Local Views , 2014, HCOMP.

[98]  Aniket Kittur,et al.  Distributed analogical idea generation: inventing with crowds , 2014, CHI.

[99]  Aniket Kittur,et al.  Crowd synthesis: extracting categories and clusters from complex data , 2014, CSCW.

[100]  Walter S. Lasecki,et al.  Legion scribe: real-time captioning by non-experts , 2014, ASSETS.

[101]  Jacki O'Neill,et al.  Turk-Life in India , 2014, GROUP.

[102]  Alex Gekker,et al.  'Outsmarting Traffic, Together': Driving as Social Navigation , 2014 .

[103]  Jacki O'Neill,et al.  Being a turker , 2014, CSCW.

[104]  Michael S. Bernstein,et al.  Human-Computer Interaction and Collective Intelligence , 2014 .

[105]  Andreas Wittel Digital labor: the internet as playground and factory , 2014 .

[106]  André van der Hoek,et al.  Microtask programming: building software with a crowd , 2014, UIST.

[107]  Mark Fuge,et al.  Network Analysis of Collaborative Design Networks: A Case Study of OpenIDEO , 2014 .

[108]  Michael S. Bernstein,et al.  Twitch crowdsourcing: crowd contributions in short bursts of time , 2014, CHI.

[109]  Chris Callison-Burch,et al.  Crowd-Workers: Aggregating Information Across Turkers to Help Them Find Higher Paying Work , 2014, HCOMP.

[110]  Judith S. Olson,et al.  Ways of Knowing in HCI , 2014, Springer New York.

[111]  Michael S. Bernstein,et al.  Expert crowdsourcing with flash teams , 2014, UIST.

[112]  Krzysztof Z. Gajos,et al.  Toward Collaborative Ideation at Scale: Leveraging Ideas from Others to Generate More Creative and Diverse Ideas , 2015, CSCW.

[113]  Michael S. Bernstein,et al.  We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers , 2015, CHI.

[114]  Adam Marcus,et al.  The Effects of Sequence and Delay on Crowd Work , 2015, CHI.

[115]  Peng Dai,et al.  And Now for Something Completely Different: Improving Crowdsourcing Workflows with Micro-Diversions , 2015, CSCW.

[116]  Joseph M. Golden,et al.  Reputation Inflation: Evidence from an Online Labor Market , 2015 .

[117]  Michael S. Bernstein,et al.  Measuring Crowdsourcing Effort with Error-Time Curves , 2015, CHI.

[118]  Adam Marcus,et al.  Argonaut: Macrotask Crowdsourcing for Complex Data Processing , 2015, Proc. VLDB Endow..

[119]  Stefan Dietze,et al.  Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys , 2015, CHI.

[120]  James R. Glass,et al.  Wait-Learning: Leveraging Wait Time for Second Language Education , 2015, CHI.

[121]  Laura A. Dabbish,et al.  Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers , 2015, CHI.

[122]  Aniket Kittur,et al.  Crowdlines: Supporting Synthesis of Diverse Information Sources through Crowdsourced Outlines , 2015, HCOMP.

[123]  Jaime Teevan,et al.  Crowdsourcing in the Field: A Case Study Using Local Crowds for Event Reporting , 2015, HCOMP.

[124]  Michael S. Bernstein,et al.  Break It Down: A Comparison of Macro- and Microtasks , 2015, CHI.

[125]  L. Elisa Celis,et al.  Assignment Techniques for Crowdsourcing Sensitive Tasks , 2016, CSCW.

[126]  M. Six Silberman,et al.  Stories We Tell About Labor: Turkopticon and the Trouble with "Design" , 2016, CHI.

[127]  Jaime Teevan,et al.  Chain Reactions: The Impact of Order on Microtask Chains , 2016, CHI.

[128]  Aniket Kittur,et al.  The Knowledge Accelerator: Big Picture Thinking in Small Pieces , 2016, CHI.

[129]  Anne Marie Piper,et al.  "Why would anybody do this?": Understanding Older Adults' Motivations and Challenges in Crowd Work , 2016, CHI.

[130]  Aniket Kittur,et al.  Distributed Analogical Idea Generation with Multiple Constraints , 2016, CSCW.

[131]  Paolo Parigi,et al.  The gig economy , 2016 .

[132]  Derek Ruths,et al.  How One Microtask Affects Another , 2016, CHI.

[133]  Aniket Kittur,et al.  Alloy: Clustering with Crowds and Computation , 2016, CHI.

[134]  Krzysztof Z. Gajos,et al.  Curiosity Killed the Cat, but Makes Crowdwork Better , 2016, CHI.

[135]  C. Fukunaga,et al.  Supporting Collaborative Writing with Microtasks , 2016 .

[136]  Yannick Naudet,et al.  Personality Matters: Balancing for Personality Types Leads to Better Outcomes for Crowd Teams , 2016, CSCW.

[137]  Aniket Kittur,et al.  Encouraging “Outside- the- box” Thinking in Crowd Innovation Through Identifying Domains of Expertise , 2016, CSCW.

[138]  Jeffrey Heer,et al.  Parting Crowds: Characterizing Divergent Interpretations in Crowdsourced Annotation Tasks , 2016, CSCW.

[139]  Dan Cosley,et al.  One and Done: Factors affecting one-time contributors to ad-hoc online communities , 2016, CSCW.

[140]  Michael S. Bernstein,et al.  Embracing Error to Enable Rapid Crowdsourcing , 2016, CHI.

[141]  J. Drahokoupil,et al.  The Platform Economy and the Disruption of the Employment Relationship , 2016 .

[142]  Björn Hartmann,et al.  Almost an Expert: The Effects of Rubrics and Expertise on Perceived Value of Crowdsourced Design Critiques , 2016, CSCW.

[143]  Michael S. Bernstein,et al.  Meta: Enabling Programming Languages to Learn from the Crowd , 2016, UIST.

[144]  Mary L. Gray,et al.  The Crowd is a Collaborative Network , 2016, CSCW.

[145]  R. Hart The rise and fall of piecework , 2016 .

[146]  Michael S. Bernstein,et al.  Atelier: Repurposing Expert Crowdsourcing Tasks as Micro-internships , 2016, CHI.

[147]  Michael S. Bernstein,et al.  Productivity Decomposed: Getting Big Things Done with Little Microtasks , 2016, CHI Extended Abstracts.

[148]  Andrés Monroy-Hernández,et al.  Storia: Summarizing Social Media Content based on Narrative Theory using Crowdsourcing , 2015, CSCW.

[149]  Dan Cosley,et al.  Taking a HIT: Designing around Rejection, Mistrust, Risk, and Workers' Experiences in Amazon Mechanical Turk , 2016, CHI.

[150]  Jaime Teevan,et al.  WearWrite: Crowd-Assisted Writing from Smartwatches , 2016, CHI.

[151]  Yan Chen,et al.  Towards Providing On-Demand Expert Support for Software Developers , 2016, CHI.

[152]  Ming Yin,et al.  The Communication Network Within the Crowd , 2016, WWW.

[153]  Vanessa S. Williamson On the Ethics of Crowdsourced Research , 2016, PS: Political Science & Politics.

[154]  Michael S. Bernstein,et al.  Mechanical Novel: Crowdsourcing Complex Work through Reflection and Revision , 2016, CSCW.

[155]  Michael Luca,et al.  Racial Discrimination in the Sharing Economy: Evidence from a Field Experiment , 2016 .

[156]  Henry R. Towne,et al.  The Adjustment of Wages to Efficiency: Three Papers on Gain-Sharing the Premium Plan a Piece Rate System , 2017 .

[157]  Michael S. Bernstein,et al.  Crowd Guilds: Worker-led Reputation and Feedback on Crowdsourcing Platforms , 2016, CSCW.

[158]  F. Blum Evidence from a field experiment , 2018 .

[159]  Babak Naderi,et al.  Who are the Crowdworkers , 2018 .