Can Reputation Discipline the Gig Economy?: Experimental Evidence From an Online Labor Market

Just as employers face uncertainty when hiring workers, workers also face uncertainty when accepting employment, and bad employers may opportunistically depart from expectations, norms, and laws. However, prior research in economics and information sciences has focused sharply on the employer's problem of identifying good workers rather than vice versa. This issue is especially pronounced in markets for gig work, including online labor markets, where platforms are developing strategies to help workers identify good employers. We build a theoretical model for the value of such reputation systems and test its predictions in on Amazon Mechanical Turk, where employers may decline to pay workers while keeping their work product and workers protect themselves using third-party reputation systems, such as Turkopticon. We find that: (1) in an experiment on worker arrival, a good reputation allows employers to operate more quickly and on a larger scale without loss to quality; (2) in an experimental audit of employers, working for good-reputation employers pays 40 percent higher effective wages due to faster completion times and lower likelihoods of rejection; and (3) exploiting reputation system crashes, the reputation system is particularly important to small, good-reputation employers, which rely on the reputation system to compete for workers against more established employers. This is the first clean field evidence of the effects of employer reputation in any labor market and is suggestive of the special role that reputation-diffusing technologies can play in promoting gig work, where conventional labor and contract laws are weak.

[1]  Klaus M. Schmidt,et al.  Use and Abuse of Authority - A Behavioral Foundation of the Employment Relation , 2012, SSRN Electronic Journal.

[2]  F. A. Hayek The American Economic Review , 2007 .

[3]  Siddharth Suri,et al.  Monopsony in Online Labor Markets , 2018, American Economic Review: Insights.

[4]  Joseph A. Ritter,et al.  Workers as Creditors: Performance Bonds and Efficiency Wages , 1994 .

[5]  Kevin J. Murphy,et al.  Relational Contracts and the Theory of the Firm , 1997 .

[6]  OF LABOR Wage and Hour Division , 2015 .

[7]  Ritu Agarwal,et al.  Vocal Minority and Silent Majority: How Do Online Ratings Reflect Population Perceptions of Quality? , 2015, MIS Q..

[8]  Apostolos Filippas,et al.  Reputation Inflation , 2018, EC.

[9]  A. Greif Contract Enforceability and Economic Institutions in Early Trade: the Maghribi Traders' Coalition , 1993 .

[10]  Paul A. Pavlou,et al.  Evidence of the Effect of Trust Building Technology in Electronic Markets: Price Premiums and Buyer Behavior , 2002, MIS Q..

[11]  Microworking the Crowd , 2012 .

[12]  Erik Brynjolfsson,et al.  Consumer Protection in an Online World: An Analysis of Occupational Licensing , 2020 .

[13]  M. Six Silberman,et al.  Operating an Employer Reputation System: Lessons from Turkopticon, 2008-2015 , 2016 .

[14]  Randall Wright,et al.  The Economics of Internal Labor Markets , 1990 .

[15]  A. Krueger Independent Workers: What Role for Public Policy? , 2018 .

[16]  Bengt Holmstrom,et al.  Contractural Models of the Labor Market , 1980 .

[17]  A. Stinchcombe Social Structure and Organizations , 2000, Political Organizations.

[18]  Sheilagh Ogilvie,et al.  Contract Enforcement, Institutions and Social Capital: The Maghribi Traders Reappraised , 2008 .

[19]  H. Simon,et al.  A Formal Theory of the Employment Relationship , 1951 .

[20]  L. Telser A Theory of Self-enforcing Agreements , 1980 .

[21]  When Corporate Social Responsibility Backfires: Theory and Evidence from a Natural Field Experiment , 2017 .

[22]  J. List The Behavioralist Meets the Market: Measuring Social Preferences and Reputation Effects in Actual Transactions , 2005 .

[23]  D. Cable,et al.  Firm reputation and applicant pool characteristics , 2003 .

[24]  Chrysanthos Dellarocas,et al.  The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias , 2006, Manag. Sci..

[25]  Bill Tomlinson,et al.  Who are the Turkers? Worker Demographics in Amazon Mechanical Turk , 2009 .

[26]  Luís M. B. Cabral,et al.  The Dynamics of Seller Reputation: Evidence from Ebay , 2006 .

[27]  S. Board,et al.  Reputation for Quality , 2013 .

[28]  Alan Benson,et al.  Can Reputation Discipline the Gig Economy? Experimental Evidence from an Online Labor Market , 2020, Manag. Sci..

[29]  B. Klein,et al.  The Role of Market Forces in Assuring Contractual Performance , 1981, Journal of Political Economy.

[30]  John J. Horton,et al.  Buyer Uncertainty About Seller Capacity: Causes, Consequences, and a Partial Solution , 2018, Manag. Sci..

[31]  Antonio Moreno,et al.  Doing Business with Strangers: Reputation in Online Service Marketplaces , 2014, Inf. Syst. Res..

[32]  George T. Milkovich,et al.  The effect of human resource reputation signals on share prices: An event study , 1996 .

[33]  Elizabeth Lyons,et al.  Does Information Help or Hinder Job Applicants from Less Developed Countries in Online Markets? , 2013 .

[34]  A. Banerjee,et al.  Reputation Effects and the Limits of Contracting: A Study of the Indian Software Industry , 1999 .

[35]  Manning Alan,et al.  Imperfect Competition in the Labor Market , 2011 .

[36]  E. Fehr,et al.  Relational Contracts and the Nature of Market Interactions , 2003, SSRN Electronic Journal.

[37]  Alan B. Krueger,et al.  Modernizing labor laws for twenty-first-century work: the "independent worker" , 2015 .

[38]  Lydia B. Chilton,et al.  The labor economics of paid crowdsourcing , 2010, EC '10.

[39]  C. Bull The Existence of Self-Enforcing Implicit Contracts , 1987 .

[40]  Matthew Pearson,et al.  Bias and Reciprocity in Online Reviews: Evidence From Field Experiments on Airbnb , 2015, EC.

[41]  Joseph M. Golden,et al.  Reputation Inflation: Evidence from an Online Labor Market , 2015 .

[42]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[43]  Abhishek Nagaraj,et al.  Does copyright affect reuse? : evidence from the Google Books Digitization Project , 2014 .

[44]  Panagiotis G. Ipeirotis Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.

[45]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[46]  Elizabeth Lyons,et al.  Digitization and the Contract Labor Market: A Research Agenda , 2013 .

[47]  Bill Tomlinson,et al.  Sellers' problems in human computation markets , 2010, HCOMP '10.

[48]  Christopher T. Stanton,et al.  Landing the First Job: The Value of Intermediaries in Online Hiring , 2014 .

[49]  Michael W. Spiller,et al.  Employers Gone Rogue: Explaining Industry Variation in Violations of Workplace Laws , 2012 .

[50]  I. Marinescu,et al.  Incentives Can Reduce Bias in Online Reviews , 2018, SSRN Electronic Journal.

[51]  R. McDevitt Names and Reputations: An Empirical Analysis , 2011 .

[52]  Michael Luca Reviews, Reputation, and Revenue: The Case of Yelp.Com , 2016 .

[53]  Uday M. Apte,et al.  Global Disaggregation of Information-Intensive Services , 1995 .

[54]  Neel Sundaresan,et al.  Reputation and Regulations: Evidence from eBay , 2016, Manag. Sci..

[55]  Paul Resnick,et al.  Trust among strangers in internet transactions: Empirical analysis of eBay' s reputation system , 2002, The Economics of the Internet and E-commerce.

[56]  H. Carmichael Reputations in the Labor Market , 1984 .

[57]  Solon Barocas,et al.  Discriminating Tastes: Uber's Customer Ratings as Vehicles for Workplace Discrimination , 2017 .

[58]  Francine D. Blau,et al.  Handbook of Labor Economics , 1999 .

[59]  Jennifer Brown,et al.  Boarding a Sinking Ship? An Investigation of Job Applications to Distressed Firms , 2012 .

[60]  Abhishek Nagaraj Does Copyright Affect Reuse? Evidence from the Google Books Digitization Project , 2016 .

[61]  Labor market reputation and the value of the firm , 1994 .

[62]  Michael J. Prietula,et al.  Open Collaboration for Innovation: Principles and Performance , 2013, Organ. Sci..

[63]  P. Osterman In Search of the High Road: Meaning and Evidence , 2018 .

[64]  Panagiotis G. Ipeirotis,et al.  The Dynamics of Micro-Task Crowdsourcing: The Case of Amazon MTurk , 2015, WWW.

[65]  Georgios Zervas,et al.  Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud , 2015, Manag. Sci..

[66]  Ali Hortaçsu,et al.  Winner's Curse, Reserve Prices and Endogenous Entry: Empirical Insights from Ebay Auctions , 2003 .

[67]  Matthew C. Johnson Regulation by Shaming: Deterrence Effects of Publicizing Violations of Workplace Safety and Health Laws , 2020, American Economic Review.

[68]  Amanda Pallais Ineffiient Hiring in Entry-Level Labor Markets , 2012 .

[69]  R. Gibbons,et al.  Can Contract Theory Explain Social Preferences , 2007 .

[70]  M. Saeedi,et al.  Reputation & Regulations : Evidence from eBay ∗ , 2014 .

[71]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[72]  Joseph M. Golden,et al.  Reputation Inflation in an Online Marketplace , 2015 .

[73]  Scott Schaefer,et al.  Personnel Economics: Hiring and Incentives , 2010 .

[74]  G IpeirotisPanagiotis Analyzing the Amazon Mechanical Turk marketplace , 2010 .

[75]  Steven Tadelis,et al.  The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment , 2015 .

[76]  Todd Sandler,et al.  The comparative static properties of the impure public good model , 1994 .

[77]  Douglas D. Heckathorn,et al.  Broken Laws, Unprotected Workers: Violations of Employment and Labor Laws in America's Cities , 2009 .