Understanding Persuasion Cascades in Online Product Rating Systems: Modeling, Analysis, and Inference

Online product rating systems have become an indispensable component for numerous web services such as Amazon, eBay, Google Play Store, and TripAdvisor. One functionality of such systems is to uncover the product quality via product ratings (or reviews) contributed by consumers. However, a well-known psychological phenomenon called “message-based persuasion” lead to “biased” product ratings in a cascading manner (we call this the persuasion cascade). This article investigates: (1) How does the persuasion cascade influence the product quality estimation accuracy? (2) Given a real-world product rating dataset, how to infer the persuasion cascade and analyze it to draw practical insights? We first develop a mathematical model to capture key factors of a persuasion cascade. We formulate a high-order Markov chain to characterize the opinion dynamics of a persuasion cascade and prove the convergence of opinions. We further bound the product quality estimation error for a class of rating aggregation rules including the averaging scoring rule, via the matrix perturbation theory and the Chernoff bound. We also design a maximum likelihood algorithm to infer parameters of the persuasion cascade. We conduct experiments on both synthetic data and real-world data from Amazon and TripAdvisor. Experiment results show that our inference algorithm has a high accuracy. Furthermore, persuasion cascades notably exist, but the average scoring rule has a small product quality estimation error under practical scenarios.

[1]  W. Wood Attitude change: persuasion and social influence. , 2000, Annual review of psychology.

[2]  Sean J. Taylor,et al.  Social Influence Bias: A Randomized Experiment , 2013, Science.

[3]  V. N. Bogaevski,et al.  Matrix Perturbation Theory , 1991 .

[4]  John Riedl,et al.  Is seeing believing?: how recommender system interfaces affect users' opinions , 2003, CHI '03.

[5]  H. Kelley,et al.  Communication and Persuasion: Psychological Studies of Opinion Change , 1982 .

[6]  Bing Liu,et al.  Review spam detection , 2007, WWW '07.

[7]  Fei Wang,et al.  Quantifying herding effects in crowd wisdom , 2014, KDD.

[8]  Georg Lackermair,et al.  Importance of Online Product Reviews from a Consumer's Perspective , 2013 .

[9]  D. Paulin Concentration inequalities for Markov chains by Marton couplings and spectral methods , 2012, 1212.2015.

[10]  Olfa Nasraoui,et al.  Human-Recommender Systems: From Benchmark Data to Benchmark Cognitive Models , 2016, RecSys.

[11]  John C. S. Lui,et al.  Mathematical modeling of group product recommendation with partial information: How many ratings do we need? , 2014, Perform. Evaluation.

[12]  John C. S. Lui,et al.  Mathematical Modeling and Analysis of Product Rating with Partial Information , 2015, TKDD.

[13]  SchuffDavid,et al.  What makes a helpful online review? a study of customer reviews on amazon.com , 2010 .

[14]  Sanjay Krishnan,et al.  A methodology for learning, analyzing, and mitigating social influence bias in recommender systems , 2014, RecSys '14.

[15]  Yi Zhao,et al.  Modeling Consumer Learning from Online Product Reviews , 2012, Mark. Sci..

[16]  Ahmed A. El-Masry,et al.  Why Do Consumers Trust Online Travel Websites? Drivers and Outcomes of Consumer Trust toward Online Travel Websites , 2017 .

[17]  John C. S. Lui,et al.  Modeling the Assimilation-Contrast Effects in Online Product Rating Systems: Debiasing and Recommendations , 2017, ACM Conference on Recommender Systems.

[18]  John C. S. Lui,et al.  A Data Driven Approach to Uncover Deficiencies in Online Reputation Systems , 2015, 2015 IEEE International Conference on Data Mining.

[19]  John C. S. Lui,et al.  Understanding Persuasion Cascades in Online Product Rating Systems: Modeling, Analysis, and Inference , 2019, AAAI.

[20]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[21]  Chuan-Hoo Tan,et al.  Helpfulness of Online Product Reviews as Seen by Consumers: Source and Content Features , 2013, Int. J. Electron. Commer..

[22]  Shawn P. Curley,et al.  Understanding Effects of Personalized vs. Aggregate Ratings on User Preferences , 2016, IntRS@RecSys.

[23]  John C.S. Lui,et al.  Understanding Assimilation-contrast Effects in Online Rating Systems , 2019, ACM Trans. Inf. Syst..

[24]  David B. Dunson,et al.  Uncovering Systematic Bias in Ratings across Categories: a Bayesian Approach , 2015, RecSys.

[25]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[26]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[27]  Michael Luca Reviews, Reputation, and Revenue: The Case of Yelp.Com , 2016 .

[28]  Jure Leskovec,et al.  From amateurs to connoisseurs: modeling the evolution of user expertise through online reviews , 2013, WWW.

[29]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.