Feedback Mechanisms, Judgment Bias, and Trust Formation in Online Auctions

Online markets, like eBay, Amazon, and others rely on electronic reputation or feedback systems to curtail adverse selection and moral hazard risks and promote trust among participants in the marketplace. These systems are based on the idea that providing information about a trader's past behavior (performance on previous market transactions) allows market participants to form judgments regarding the trustworthiness of potential interlocutors in the marketplace. It is often assumed, however, that traders correctly process the data presented by these systems when updating their initial beliefs. In this article, we demonstrate that this assumption does not hold. Using a controlled laboratory experiment simulating an online auction site with 127 participants acting as buyers, we find that participants interpret seller feedback information in a biased (non-Bayesian) fashion, overemphasizing the compositional strength (i.e., the proportion of positive ratings) of the reputational information and underemphasizing the weight (predictive validity) of the evidence as represented by the total number of transactions rated. Significantly, we also find that the degree to which buyers misweigh seller feedback information is moderated by the presentation format of the feedback system as well as attitudinal and psychological attributes of the buyer. Specifically, we find that buyers process feedback data presented in an Amazon-like format—a format that more prominently emphasizes the strength dimension of feedback information—in a more biased (less-Bayesian) manner than identical ratings data presented using an eBay-like format. We further find that participants with greater institution-based trust (i.e., structural assurance) and prior online shopping experience interpreted feedback data in a more biased (less-Bayesian) manner. The implications of these findings for both research and practice are discussed.

[1]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[2]  George A. Akerlof The Market for “Lemons”: Quality Uncertainty and the Market Mechanism , 1970 .

[3]  J. Shanteau Competence in experts: The role of task characteristics , 1992 .

[4]  P. Resnick,et al.  Eliciting Honest Feedback in Electronic Markets , 2002 .

[5]  Paul A. Pavlou,et al.  Building Effective Online Marketplaces with Institution-Based Trust , 2004, Inf. Syst. Res..

[6]  Iris Vessey,et al.  Cognitive Fit: A Theory‐Based Analysis of the Graphs Versus Tables Literature* , 1991 .

[7]  Dennis F. Galletta,et al.  Cognitive Fit: An Empirical Study of Information Acquisition , 1991, Inf. Syst. Res..

[8]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .

[9]  Paul A. Pavlou,et al.  Psychological Contract Violation in Online Marketplaces: Antecedents, Consequences, and Moderating Role , 2005, Inf. Syst. Res..

[10]  Izak Benbasat,et al.  Investigating the Influence of the Functional Mechanisms of Online Product Presentations , 2007 .

[11]  J. Henslin,et al.  Craps and Magic , 1967, American Journal of Sociology.

[12]  J. Wooders,et al.  Reputation in Auctions: Theory, and Evidence from Ebay , 2006 .

[13]  Cade Massey,et al.  Detecting Regime Shifts: The Causes of Under- and Over-Reaction , 2004, Manag. Sci..

[14]  Rajeev R. Bhattacharya,et al.  A Formal Model of Trust Based on Outcomes , 1998 .

[15]  Anol Bhattacherjee,et al.  Individual Trust in Online Firms: Scale Development and Initial Test , 2002, J. Manag. Inf. Syst..

[16]  Daniel Kahneman,et al.  Judgment and Decision Making: A Personal View , 1991 .

[17]  J. Yates,et al.  General knowledge overconfidence : Cross-national variations, response style, and reality , 1997 .

[18]  Axel Ockenfel,et al.  How Effective are Online Reputation Mechanisms? An Experimental Investigation , 2002 .

[19]  Izak Benbasat,et al.  The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids , 2008, Decis. Sci..

[20]  Gary E. Bolton,et al.  How Effective are Online Reputation Mechanisms? An Experimental Study , 2004, Manag. Sci..

[21]  J. Riley,et al.  The Analytics of Uncertainty and Information- An Expository Survey , 1979 .

[22]  M. W. Nelson,et al.  Do Investors Overrely on Old Elements of the Earnings Time Series , 2003 .

[23]  Shenghua Luan,et al.  Weighting Information from Outside Sources: A Biased Process , 2004 .

[24]  W. Galston Trust: The Social Virtues and the Creation of Prosperity , 1996 .

[25]  Peter A. Todd,et al.  Paradoxes of Online Investing: Testing the Influence of Technology on User Expectancies , 2006, Decis. Sci..

[26]  Paul Resnick,et al.  Trust among strangers in internet transactions: Empirical analysis of eBay' s reputation system , 2002, The Economics of the Internet and E-commerce.

[27]  Ali Hortaçsu,et al.  Winner's Curse, Reserve Prices and Endogenous Entry: Empirical Insights from Ebay Auctions , 2003 .

[28]  Paul Resnick,et al.  The value of reputation on eBay: A controlled experiment , 2002 .

[29]  Ben Shneiderman,et al.  Designing trust into online experiences , 2000, CACM.

[30]  Eric J. Johnson,et al.  When Web Pages Influence Choice: Effects of Visual Primes on Experts and Novices , 2002 .

[31]  BaSulin,et al.  Evidence of the effect of trust building technology in electronic markets , 2002 .

[32]  Sucheta Nadkarni,et al.  A Task-Based Model of Perceived Website Complexity , 2007, MIS Q..

[33]  A. Roth,et al.  Last-Minute Bidding and the Rules for Ending Second-Price Auctions: Evidence from eBay and Amazon Auctions on the Internet , 2002 .

[34]  Chrysanthos Dellarocas,et al.  Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior , 2000, EC '00.

[35]  E. Langer The illusion of control. , 1975 .

[36]  John R. Nofsinger,et al.  Trading Performance, Disposition Effect, Overconfidence, Representativeness Bias, and Experience of Emerging Market Investors , 2007 .

[37]  A. Baier Trust and Antitrust , 1986, Ethics.

[38]  Steven J. Sherman,et al.  Effects of cooperation and competition on responsibility attribution after success and failure , 1973 .

[39]  James J. Jiang,et al.  The Impact of Model Performance History Information on Users' Confidence in Decision Models: An Experimental Examination , 1996 .

[40]  Brad M. Barber,et al.  Trading is Hazardous to Your Wealth: The Common Stock Investment Performance of Individual Investors , 2000 .

[41]  Brad M. Barber,et al.  Boys Will Be Boys: Gender, Overconfidence, and Common Stock Investment , 1998 .

[42]  Paul A. Pavlou,et al.  Evidence of the Effect of Trust Building Technology in Electronic Markets: Price Premiums and Buyer Behavior , 2002, MIS Q..

[43]  David H. Reiley,et al.  Pennies from Ebay: The Determinants of Price in Online Auctions , 2000 .

[44]  Gerardine DeSanctis,et al.  COMPUTER GRAPHICS AS DECISION AIDS: DIRECTIONS FOR RESEARCH* , 1984 .

[45]  P. Kollock The Production of Trust in Online Markets , 1999 .

[46]  Robert J. Bloomfield,et al.  The Effect of Information Strength and Weight on Behavior in Financial Markets , 2001 .

[47]  Sirkka L. Jarvenpaa,et al.  The effect of task demands and graphical format on information processing strategies , 1989 .

[48]  Glenn J. Browne,et al.  An Empirical Investigation of Web Site Use Using a Commitment-Based Model , 2006, Decis. Sci..

[49]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[50]  Ewald A. Kaluscha,et al.  Empirical research in on-line trust: a review and critical assessment , 2003, Int. J. Hum. Comput. Stud..

[51]  Charles J. Kacmar,et al.  Developing and Validating Trust Measures for e-Commerce: An Integrative Typology , 2002, Inf. Syst. Res..

[52]  Jaswinder Pal Singh,et al.  Computing and using reputations for internet ratings , 2001, EC '01.

[53]  Paul Resnick,et al.  Eliciting Informative Feedback: The Peer-Prediction Method , 2005, Manag. Sci..

[54]  J. Yates,et al.  Beliefs about Overconfidence, Including Its Cross-National Variation , 1996 .

[55]  Waleed A. Muhanna,et al.  Adverse Selection and Reputation Systems in Online Auctions: Evidence fom eBay Motors , 2005, ICIS.

[56]  Wei Jiang,et al.  Analysts' Weighting of Private and Public Information , 2003 .

[57]  R. Nisbett,et al.  The dilution effect: Nondiagnostic information weakens the implications of diagnostic information , 1981, Cognitive Psychology.

[58]  J Block,et al.  Social roles and social perception: individual differences in attribution and error. , 1986, Journal of personality and social psychology.

[59]  Mark A. Fuller,et al.  Seeing Is Believing: The Transitory Influence of Reputation Information on E-Commerce Trust and Decision Making , 2007, Decis. Sci..