Mitigating Online Product Rating Biases Through the Discovery of Optimistic, Pessimistic, and Realistic Reviewers

The authors of this work present a model that reduces product ratings biases that are a result of varying degrees of customers’ optimism/pessimism. Recently, large-scale customer reviews and numerical product ratings have served as substantial criteria for new customers who make their purchasing decisions through electronic word-of-mouth. However, due to differences among reviewers’ rating criteria, customer ratings are often biased. For example, a 3-star rating can be considered low for an optimistic reviewer. On the other hand, the same 3-star rating can be considered high for a pessimistic reviewer. Many existing studies of online customer reviews overlook the significance of reviewers’ rating histories and tendencies. Considering reviewers’ rating histories and tendencies is significant for identifying unbiased customer ratings and true product quality, because each reviewer has different criteria for buying and rating products. The proposed customer rating analysis model adjusts product ratings in order to provide customers with more objective and accurate feedback. The authors propose an unsupervised model aimed at mitigating customer ratings based on rating histories and tendencies, instead of human-labeled training data. A case study involving real-world customer rating data from an electronic commerce company is used to validate the method.

[1]  Kai H. Lim,et al.  Effects of conflicting aggregated rating on eWOM review credibility and diagnosticity: The moderating role of review valence , 2012, Decis. Support Syst..

[2]  Wai Lam,et al.  An unsupervised method for joint information extraction and feature mining across different Web sites , 2009, Data Knowl. Eng..

[3]  Rolph E. Anderson,et al.  Customer loyalty in e-commerce: an exploration of its antecedents and consequences , 2002 .

[4]  Aarnout Brombacher,et al.  The needs and benefits of applying textual data mining within the product development process , 2004 .

[5]  Conrad S. Tucker,et al.  Automated Discovery of Lead Users and Latent Product Features by Mining Large Scale Social Media Networks , 2015 .

[6]  Arjun Mukherjee,et al.  Exploiting Burstiness in Reviews for Review Spammer Detection , 2021, ICWSM.

[7]  Ling Liu,et al.  Manipulation of online reviews: An analysis of ratings, readability, and sentiments , 2012, Decis. Support Syst..

[8]  Susan Rose,et al.  Online Customer Experience: A Review of the Business-to-Consumer Online Purchase Context , 2011 .

[9]  Anton van den Hengel,et al.  Image-Based Recommendations on Styles and Substitutes , 2015, SIGIR.

[10]  Han Tong Loh,et al.  Gather customer concerns from online product reviews - A text summarization approach , 2009, Expert Syst. Appl..

[11]  Bernardo A. Huberman,et al.  Predicting the Future with Social Media , 2010, Web Intelligence.

[12]  Abhinav Singh,et al.  A machine learning approach to product review disambiguation based on function, form and behavior classification , 2017, Decis. Support Syst..

[13]  Ee-Peng Lim,et al.  Detecting product review spammers using rating behaviors , 2010, CIKM.

[14]  Richard Y. K. Fung,et al.  Identifying helpful online reviews: A product designer's perspective , 2013, Comput. Aided Des..

[15]  Yuan-Chun Jiang,et al.  Maximizing customer satisfaction through an online recommendation system: A novel associative classification model , 2010, Decis. Support Syst..

[16]  Abraham Kandel,et al.  Introduction to Pattern Recognition: Statistical, Structural, Neural and Fuzzy Logic Approaches , 1999 .

[17]  Paul A. Pavlou,et al.  Why Do Online Product Reviews Have a J-Shaped Distribution? Overcoming Biases in Online Word-of-Mouth Communication , 2007 .

[18]  R. Fisher 014: On the "Probable Error" of a Coefficient of Correlation Deduced from a Small Sample. , 1921 .

[19]  Michael D. Smith,et al.  All Reviews are Not Created Equal: The Disaggregate Impact of Reviews and Reviewers at Amazon.Com , 2008 .

[20]  Arjun Mukherjee,et al.  What Yelp Fake Review Filter Might Be Doing? , 2013, ICWSM.

[21]  Conrad S. Tucker,et al.  A Bayesian Sampling Method for Product Feature Extraction From Large-Scale Textual Data , 2016 .

[22]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[23]  Sung Hoon Lim,et al.  An unsupervised machine learning model for discovering latent infectious diseases using social media data , 2017, J. Biomed. Informatics.

[24]  Abhinav Singh,et al.  Investigating the Heterogeneity of Product Feature Preferences Mined Using Online Product Data Streams , 2015, DAC 2015.

[25]  Wai Lam,et al.  Learning to extract and summarize hot item features from multiple auction web sites , 2007, Knowledge and Information Systems.

[26]  Jason Q. Zhang,et al.  When does electronic word-of-mouth matter? A study of consumer product reviews☆ , 2010 .

[27]  Paul A. Pavlou,et al.  Can online reviews reveal a product's true quality?: empirical findings and analytical modeling of Online word-of-mouth communication , 2006, EC '06.

[28]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[29]  Paul A. Pavlou,et al.  Overcoming the J-shaped distribution of product reviews , 2009, CACM.

[30]  Conrad S. Tucker,et al.  Predicting emerging product design trend by mining publicly available customer review data , 2011 .

[31]  Peter C. Neijens,et al.  "Highly Recommended!" The Content Characteristics and Perceived Usefulness of Online Consumer Reviews , 2011, J. Comput. Mediat. Commun..

[32]  Conrad S. Tucker,et al.  Automated Mapping of Product Features Mined From Online Customer Reviews to Engineering Product Characteristics , 2016 .

[33]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[34]  Fang Wu,et al.  Opinion formation under costly expression , 2010, TIST.

[35]  Mike Thelwall,et al.  Can Amazon.com reviews help to assess the wider impacts of books? , 2016, J. Assoc. Inf. Sci. Technol..

[36]  Rahul Rai,et al.  Identifying Key Product Attributes and Their Importance Levels From Online Customer Reviews , 2012, DAC 2012.

[37]  Qiang Yang Introduction to ACM TIST , 2010, TIST.

[38]  Panagiotis G. Ipeirotis,et al.  Show me the money!: deriving the pricing power of product features by mining consumer reviews , 2007, KDD '07.

[39]  David M. Pennock,et al.  Mining the peanut gallery: opinion extraction and semantic classification of product reviews , 2003, WWW '03.

[40]  Kemper Lewis,et al.  Combining Anthropometric Data and Consumer Review Content to Inform Design for Human Variability , 2015, DAC 2015.

[41]  Jure Leskovec,et al.  Inferring Networks of Substitutable and Complementary Products , 2015, KDD.

[42]  Natalie S. Glance,et al.  Star Quality: Aggregating Reviews to Rank Products and Merchants , 2010, ICWSM.

[43]  Arjun Mukherjee,et al.  Spotting fake reviewer groups in consumer reviews , 2012, WWW.