Evaluating Content Quality and Usefulness of Online Product Reviews

Online product reviews are an important resource for consumers in online marketplaces because they provide a useful source of support information during the purchase of goods. Furthermore, in some online marketplaces consumers have the opportunity to evaluate the usefulness of a review by using a binary evaluation interface provided by the online marketplace. These evaluations produce a usefulness score, which is calculated as a fraction of helpful votes out of the total votes that a review has received. The results of these evaluations indicate that the usefulness score of a particular review is significantly affected by the qualitative characteristics of the review as measured by readability tests applied to a large dataset of reviews collected from the United Kingdom section of the popular online marketplace Amazon.

[1]  S. Jay Samuels,et al.  Readability: Its Past, Present, and Future , 1988 .

[2]  R. Flesch.  How to test readability , 1951 .

[3]  Michael K Paasche-Orlow,et al.  Readability standards for informed-consent forms as compared with actual readability. , 2003, The New England journal of medicine.

[4]  Garth Saloner,et al.  Economics and Electronic Commerce , 2001 .

[5]  Marsha L. Richins.  Negative Word-of-Mouth by Dissatisfied Consumers: A Pilot Study , 1983 .

[6]  Peter H. Reingen,et al.  Social Ties and Word-of-Mouth Referral Behavior , 1987 .

[7]  J. Bettman,et al.  Effects of Prior Knowledge and Experience and Phase of the Choice Process on Consumer Decision Processes: A Protocol Analysis , 1980 .

[8]  Paul A. Pavlou,et al.  Can online reviews reveal a product's true quality?: empirical findings and analytical modeling of Online word-of-mouth communication , 2006, EC '06.

[9]  Chrysanthos Dellarocas,et al.  The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback Mechanisms , 2003, Manag. Sci..

[10]  E. Clemons,et al.  When Online Reviews Meet Hyperdifferentiation: A Study of the Craft Beer Industry , 2006 .

[11]  M. Coleman,et al.  A computer readability formula designed for machine scoring. , 1975 .

[12]  G. Stigler.  The Economics of Information , 1961, Journal of Political Economy.

[13]  R. Gunning.  The Fog Index After Twenty Years , 1969 .

[14]  Gerald L. Lohse,et al.  Electronic shopping , 1998, CACM.

[15]  Angelika Dimoka,et al.  The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation , 2006, Inf. Syst. Res..

[16]  P. Nelson.  Information and Consumer Behavior , 1970, Journal of Political Economy.

[17]  JoAnne Yates,et al.  Electronic markets and electronic hierarchies , 1987, CACM.

[18]  Ling Liu,et al.  Do online reviews affect product sales? The role of reviewer characteristics and temporal effects , 2008, Inf. Technol. Manag..

[19]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[20]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .