The Value of Reputation in an Online Freelance Marketplace

Online freelance marketplaces are websites that match buyers of electronically deliverable services with freelancers. Although freelancing has grown in recent years, it faces the classic “information asymmetry” problem---buyers face uncertainty over seller quality. Typically, these markets use reputation systems to alleviate this issue, but the effectiveness of these systems is open to debate. We present a dynamic structural framework to estimate the returns to seller reputations in freelance sites. In our model, a buyer decides in each period whether to choose a bid from her current set of bids, cancel the auction, or wait for more bids. In the process, she trades off sellers' price, reputation, and other attributes, as well as the costs of waiting and canceling. Our framework addresses dynamic selection, which can lead to underestimation of reputation, through two types of persistent unobserved heterogeneities: bid arrival rates and buyers' unobserved preference for bids. We apply our framework to data from a leading freelance firm. We find that buyers are forward looking, that they place significant weight on seller reputation, and that not controlling for dynamics and selection can bias reputation estimates. Using counterfactual simulations, we infer the dollar value of seller reputations and provide guidelines to managers of freelance firms.

[1]  Peter S. Arcidiacono,et al.  Habit Persistence and Teen Sex: Could Increased Access to Contraception Have Unintended Consequences for Teen Pregnancies? , 2012 .

[2]  Stephen R. Finger RESEARCH AND DEVELOPMENT COMPETITION IN THE CHEMICALS INDUSTRY , 2008 .

[3]  Shanefrederick,et al.  Time Discounting and Time Preference : A Critical Review , 2022 .

[4]  Peter Arcidiacono,et al.  Practical Methods for Estimation of Dynamic Discrete Choice Models , 2011 .

[5]  Jiří Zelinka,et al.  Kernel Density Estimation Toolbox for Matlab , 2011 .

[6]  Robert Zeithammer Forward-Looking Bidding in Online Auctions , 2005 .

[7]  R. Winkelmann Econometric Analysis of Count Data , 1997 .

[8]  Daniel McFadden,et al.  Modelling the Choice of Residential Location , 1977 .

[9]  Sanjog Misra,et al.  Repositioning Dynamics and Pricing Strategy , 2012 .

[10]  Sanjog Misra,et al.  A structural model of sales-force compensation dynamics: Estimation and field implementation , 2009, Quantitative Marketing and Economics.

[11]  Song Yao,et al.  Online Auction Demand , 2008, Mark. Sci..

[12]  Sridhar Narayanan,et al.  Heterogeneous Learning and the Targeting of Marketing Communication for New Products , 2009, Mark. Sci..

[13]  John Rust,et al.  On the Optimal Lifetime of Nuclear Power Plants , 1996 .

[14]  Han Hong,et al.  Using price distributions to estimate search costs , 2006 .

[15]  Steven T. Berry Empirical Models of Entry and Market Structure 1 , 2006 .

[16]  John Rust,et al.  Structural estimation of markov decision processes , 1986 .

[17]  Denis Nekipelov,et al.  Game Theory and Econometrics: A Survey of Some Recent Research , 2013 .

[18]  Leonardo Rezende,et al.  Econometrics of auctions by least squares , 2008 .

[19]  Christopher Adams,et al.  The Sealed-Bid Abstraction in Online Auctions , 2009, Mark. Sci..

[20]  Wesley R. Hartmann Intertemporal effects of consumption and their implications for demand elasticity estimates , 2006 .

[21]  John Rust,et al.  How Social Security and Medicare affect retirement behavior in a world of incomplete markets , 1994 .

[22]  George A. Akerlof The Market for “Lemons”: Quality Uncertainty and the Market Mechanism , 1970 .

[23]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[24]  T. Magnac,et al.  Identifying Dynamic Discrete Decision Processes , 2002 .

[25]  Thierry Magnac,et al.  Identifying dynamic discrete choice models , 2002 .

[26]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[27]  Eric T. Bradlow,et al.  An Integrated Model for Bidding Behavior in Internet Auctions: Whether, Who, When, and how Much , 2005 .

[28]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[29]  Peter E. Rossi,et al.  Marketing models of consumer heterogeneity , 1998 .

[30]  Jean-Michel Glachant,et al.  The economics of contracts: Theories and applications , 2002 .

[31]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[32]  Sumru Altug,et al.  The Effect of Work Experience on Female Wages and Labour Supply , 1998 .

[33]  Marc Rysman,et al.  Dynamics of Consumer Demand for New Durable Goods , 2007 .

[34]  Chrysanthos Dellarocas,et al.  The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback Mechanisms , 2003, Manag. Sci..

[35]  Carl F. Mela,et al.  Determining Consumers’ Discount Rates with Field Studies , 2012 .

[36]  Robert P. W. Duin,et al.  On the Choice of Smoothing Parameters for Parzen Estimators of Probability Density Functions , 1976, IEEE Transactions on Computers.

[37]  Research Note---Optimal Selling in Dynamic Auctions: Adaptation Versus Commitment , 2007 .

[38]  Sanjog Misra,et al.  Structural Workshop Paper - Estimating Discrete Games , 2011, Mark. Sci..

[39]  Young-Hoon Park,et al.  Bayesian Estimation of Bid Sequences in Internet Auctions Using a Generalized Record Breaking Model , 2007 .

[40]  Bart J. Bronnenberg,et al.  Online Demand Under Limited Consumer Search , 2009, Mark. Sci..

[41]  Yang Wang,et al.  Estimating Dynamic Discrete Choice Models with Hyperbolic Discounting, with an Application to Mammography Decisions , 2010, SSRN Electronic Journal.

[42]  Peter S. Arcidiacono Affirmative Action in Higher Education: How do Admission and Financial Aid Rules Affect Future Earnings? , 2005 .

[43]  Pradeep K. Chintagunta,et al.  Investigating Heterogeneity in Brand Preferences in Logit Models for Panel Data , 1991 .

[44]  Andrew W. Moore,et al.  Rapid Evaluation of Multiple Density Models , 2003, AISTATS.

[45]  S. McIntyre,et al.  Return on Reputation in Online Auction Markets , 2001 .

[46]  Robert Zeithammer Optimal Selling in Dynamic Auctions: Information Versus Commitment , 2006 .

[47]  Paul Resnick,et al.  Trust among strangers in internet transactions: Empirical analysis of eBay' s reputation system , 2002, The Economics of the Internet and E-commerce.

[48]  M. Weitzman Optimal search for the best alternative , 1978 .

[49]  Peter S. Arcidiacono,et al.  Conditional Choice Probability Estimation of Dynamic Discrete Choice Models With Unobserved Heterogeneity , 2011 .

[50]  John Rust Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher , 1987 .

[51]  Ali Hortaçsu,et al.  Economic Insights from Internet Auctions , 2004 .

[52]  Joseph W. Rottman,et al.  Offshore outsourcing of IT work , 2008 .

[53]  K. Sudhir,et al.  Do Bonuses Enhance Sales Productivity? A Dynamic Structural Analysis of Bonus-Based Compensation Plans , 2013, Mark. Sci..

[54]  Sanjog Misra,et al.  Estimating Discrete Games , 2010 .

[55]  Russel Mr,et al.  International patent protection. , 1985 .

[56]  Larry Samuelson,et al.  Imperfect Monitoring and Impermanent Reputations , 2004 .

[57]  David H. Reiley,et al.  Pennies from Ebay: The Determinants of Price in Online Auctions , 2000 .

[58]  E. Friedman,et al.  The Social Cost of Cheap Pseudonyms , 2001 .

[59]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[60]  Paul B. Ellickson,et al.  The Dynamics of Retail Oligopoly , 2024, SSRN Electronic Journal.

[61]  V. J. Hotz,et al.  Conditional Choice Probabilities and the Estimation of Dynamic Models , 1993 .

[62]  Eric T. Bradlow,et al.  An Integrated Model for Whether, Who, When, and How Much in Internet Auctions , 2005 .

[63]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[64]  Stephan Seiler The impact of search costs on consumer behavior: A dynamic approach , 2013 .

[65]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[66]  Jesus M. Carro,et al.  A dynamic model of contraceptive choice of Spanish couples , 2006 .

[67]  M. Melnik,et al.  Does a Seller's Ecommerce Reputation Matter? Evidence from Ebay Auctions , 2003 .

[68]  David H. Eaton Valuing Information : Evidence from Guitar Auctions on , 2002 .

[69]  Ginger Zhe Jin,et al.  Blind Trust Online: Experimental Evidence from Baseball Cards , 2002 .

[70]  Gary J. Russell,et al.  A Probabilistic Choice Model for Market Segmentation and Elasticity Structure , 1989 .

[71]  N. Mankiw,et al.  The Politics and Economics of Offshore Outsourcing , 2006 .

[72]  H. Kasahara,et al.  Nonparametric Identification of Finite Mixture Models of Dynamic Discrete Choices , 2009 .

[73]  Sergei Koulayev,et al.  Estimating Demand in Search Markets: The Case of Online Hotel Bookings , 2009 .

[74]  Walter G. Park,et al.  International patent protection: 1960-2005 , 2008 .

[75]  Gregory S. Crawford,et al.  Uncertainty and Learning in Pharmaceutical Demand , 2005 .

[76]  Victor Aguirregabiria,et al.  Dynamic Discrete Choice Structural Models: A Survey , 2010, SSRN Electronic Journal.

[77]  Victor Aguirregabiria,et al.  Sequential Estimation of Dynamic Discrete Games , 2007 .

[78]  John R. Douceur,et al.  The Sybil Attack , 2002, IPTPS.

[79]  Steven T. Berry,et al.  Empirical Models of Entry and Market Structure , 2007 .

[80]  Joseph W. Rottman,et al.  Offshore Outsourcing of IT Work: Client and Supplier Perspectives , 2008 .