Estimating True Ratings from Online Consumer Reviews

Online consumer reviews have emerged in the last decade as a promising starting point for monitoring and analyzing individual opinions about products and services. Especially the corresponding “star” ratings are frequently used by marketing researchers to address various aspects of electronic word-of-mouth (eWOM). But there also exist several studies which raise doubts about the general reliability of posted ratings. Against this background, we introduce a new framework based on the Beta Binomial True Intentions Model suggested by Morrison (J Mark Res 43(2):65–74, 1979) to accommodate the possible uncertainty inherent in the ratings contained in online consumer reviews. We show that, under certain conditions, the suggested framework is suitable to estimate “true” ratings from posted ones which proves advantageous in the case of rating-based predictions, e.g. with respect to the willingness to recommend a product or service. The theoretical considerations are illustrated by means of synthetic and real data.

[1]  F. Thomas Juster,et al.  Consumer Buying Intentions and Purchase Probability: An Experiment in Survey Design , 1966 .

[2]  David A. Schweidel,et al.  Online Product Opinions: Incidence, Evaluation, and Evolution , 2012, Mark. Sci..

[3]  Paul A. Pavlou,et al.  Can online reviews reveal a product's true quality?: empirical findings and analytical modeling of Online word-of-mouth communication , 2006, EC '06.

[4]  Sven Jöckel,et al.  The Impact of Experience: The Influences of User and Online Review Ratings on the Performance of Video Games in the US Market , 2007, DiGRA Conference.

[5]  Bing Liu,et al.  Opinion observer: analyzing and comparing opinions on the Web , 2005, WWW '05.

[6]  Wendy W. Moe,et al.  Measuring the Value of Social Dynamics in Online Product Ratings Forums , 2010 .

[7]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[8]  Nitin Indurkhya,et al.  Handbook of Natural Language Processing , 2010 .

[9]  M. Healy,et al.  Regression to the mean. , 1978, Annals of human biology.

[10]  Mohammad Najmud Doja,et al.  Feature and Opinion Mining for Customer Review Summarization , 2009, PReMI.

[11]  Chrysanthos Dellarocas,et al.  Are Consumers More Likely to Contribute Online Reviews for Hit or Niche Products? , 2010, J. Manag. Inf. Syst..

[12]  Bing Liu,et al.  Sentiment Analysis and Subjectivity , 2010, Handbook of Natural Language Processing.

[13]  Yong Tan,et al.  The Economic Value of Ratings in App Market , 2011 .

[14]  D. G. Morrison Purchase Intentions and Purchase Behavior , 1979 .

[15]  Pei-Yu Sharon Chen,et al.  The Impact of Online Recommendations and Consumer Feedback on Sales , 2004, ICIS.

[16]  Paul A. Pavlou,et al.  Overcoming the J-shaped distribution of product reviews , 2009, CACM.

[17]  David Godes,et al.  Using Online Conversations to Study Word-of-Mouth Communication , 2004 .

[18]  Alex S. L. Tsang,et al.  Is a “star” worth a thousand words?: The interplay between product‐review texts and rating valences , 2009 .

[19]  Xiaoquan Zhang,et al.  AIS Electronic Library (AISeL) , 2017 .

[20]  Ingoo Han,et al.  The Different Effects of Online Consumer Reviews on Consumers' Purchase Intentions Depending on Trust in Online Shopping Mall: An Advertising Perspective , 2011, Internet Res..

[21]  Frank M. Bass,et al.  Adjusting Stated Intention Measures to Predict Trial Purchase of New Products: A Comparison of Models and Methods , 1989 .

[22]  Lorin M. Hitt,et al.  Price Effects in Online Product Reviews: An Analytical Model and Empirical Analysis , 2010, MIS Q..

[23]  Alvin J. Silk,et al.  On the reliability and predictive validity of purchase intention measures , 2011 .

[24]  Baojun Jiang,et al.  An Economic Analysis of Online Product Reviews and Ratings , 2007 .

[25]  Innis G. Sande,et al.  Imputation in Surveys: Coping with Reality , 1982 .

[26]  Lorin M. Hitt,et al.  Self Selection and Information Role of Online Product Reviews , 2007, Inf. Syst. Res..

[27]  John P. Fraedrich,et al.  Increased Word-of-Mouth via Strategic Cause-Related Marketing , 2011 .