A Tangled Web: Should Online Review Portals Display Fraudulent Reviews?

The growing interest in online product reviews for legitimate promotion has been accompanied by an increase in fraudulent reviews. However, beyond algorithms for initial fraud detection, little is known about what review portals should do with fraudulent reviews after detecting them. In this paper, we address this question by studying how consumers respond to potentially fraudulent reviews and how review portals can leverage this knowledge to design better fraud management policies. To do this, we combine theoretical development from the trust literature with randomized experiments and statistical analysis using large-scale data from Yelp. We find that consumers tend to increase their trust in the information provided by review portals when the portal displays fraudulent reviews along with non-fraudulent reviews, as opposed to the common practice of censoring suspected fraudulent reviews. The impact of fraudulent reviews on consumers’ decision-making process increases with the uncertainty in the initial evaluation of product quality. We also find that consumers do not effectively process the content of fraudulent reviews (negative or positive). This result furthers the case for a decision heuristic that will incorporate the motivational differences between positive fraudulent reviews and negative fraudulent reviews to effectively aid consumers' decision making.

[1]  Paul Slovic,et al.  From Shakespeare to Simon: speculations--and some evidence-- about man's ability to process information , 1972 .

[2]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[3]  A. Tversky,et al.  The simulation heuristic , 1982 .

[4]  John W. Payne,et al.  Effort and Accuracy in Choice , 1985 .

[5]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[6]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[7]  Blair H. Sheppard,et al.  Business on a handshake , 1992 .

[8]  David Gefen,et al.  Building users' trust in freeware providers and the effects of this trust on users' perceptions of usefulness, ease of use and intended use of freeware , 1997 .

[9]  Erik Brynjolfsson,et al.  Frictionless Commerce? A Comparison of Internet and Conventional Retailers , 2000 .

[10]  Sirkka L. Jarvenpaa,et al.  Consumer Trust in an Internet Store: A Cross-Cultural Validation , 2006, J. Comput. Mediat. Commun..

[11]  Edward,et al.  Measuring Trust , 2000 .

[12]  V. Smith,et al.  Monetary rewards and decision cost in experimental economics , 2000 .

[13]  D. Gefen,et al.  E-commerce: the role of familiarity and trust , 2000 .

[14]  Charles J. Kacmar,et al.  Trust in e-commerce vendors: a two-stage model , 2000, ICIS.

[15]  Izak Benbasat,et al.  Inducing compensatory information processing through decision aids that facilitate effort reduction: an experimental assessment , 2000 .

[16]  Paul A. Pavlou,et al.  Building Effective Online Marketplaces with Institution-Based Trust , 2004, Inf. Syst. Res..

[17]  Charles J. Kacmar,et al.  Developing and Validating Trust Measures for e-Commerce: An Integrative Typology , 2002, Inf. Syst. Res..

[18]  David J. Hand,et al.  Statistical fraud detection: A review , 2002 .

[19]  David Gefen,et al.  Reflections on the dimensions of trust and trustworthiness among online consumers , 2002, Data Base.

[20]  Detmar W. Straub,et al.  Trust and TAM in Online Shopping: An Integrated Model , 2003, MIS Q..

[21]  Jens Riegelsberger,et al.  Shiny happy people building trust?: photos on e-commerce websites and consumer trust , 2003, CHI '03.

[22]  F. Reichheld,et al.  E-LOYALTY: YOUR SECRET WEAPON ON THE WEB , 2003 .

[23]  Jens Riegelsberger,et al.  The researcher's dilemma: evaluating trust in computer-mediated communication , 2003, Int. J. Hum. Comput. Stud..

[24]  Chang-Tien Lu,et al.  Survey of fraud detection techniques , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[25]  A. O'connell Logistic Regression Models for Ordinal Response Variables , 2005 .

[26]  Chrysanthos Dellarocas,et al.  Exploring the value of online product reviews in forecasting sales: The case of motion pictures , 2007 .

[27]  Panagiotis G. Ipeirotis,et al.  Show me the money!: deriving the pricing power of product features by mining consumer reviews , 2007, KDD '07.

[28]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[29]  Anindya Ghose,et al.  Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets , 2008, Inf. Syst. Res..

[30]  Bing Liu,et al.  Opinion spam and analysis , 2008, WSDM '08.

[31]  Panagiotis G. Ipeirotis Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.

[32]  Derek Greene,et al.  Distortion as a validation criterion in the identification of suspicious reviews , 2010, SOMA '10.

[33]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[34]  Wang Zhongmin,et al.  Anonymity, Social Image, and the Competition for Volunteers: A Case Study of the Online Market for Reviews , 2010 .

[35]  Ee-Peng Lim,et al.  Detecting product review spammers using rating behaviors , 2010, CIKM.

[36]  Ee-Peng Lim,et al.  Finding unusual review patterns using unexpected rules , 2010, CIKM.

[37]  Sriram Venkataraman,et al.  The Effects of Online User Reviews on Movie Box-Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets , 2010 .

[38]  Duncan J. Watts,et al.  Cooperation and Contagion in Web-Based, Networked Public Goods Experiments , 2010, SECO.

[39]  Claire Cardie,et al.  Finding Deceptive Opinion Spam by Any Stretch of the Imagination , 2011, ACL.

[40]  Dekang Lin,et al.  Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1 , 2011 .

[41]  Yejin Choi,et al.  Distributional Footprints of Deceptive Product Reviews , 2012, ICWSM.

[42]  Dina Mayzlin,et al.  Promotional Reviews: An Empirical Investigation of Online Review Manipulation , 2012 .

[43]  Beibei Li,et al.  Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowd-Sourced Content , 2011, Mark. Sci..

[44]  Arjun Mukherjee,et al.  Spotting fake reviewer groups in consumer reviews , 2012, WWW.

[45]  Krzysztof Z. Gajos,et al.  TurkServer: Enabling Synchronous and Longitudinal Online Experiments , 2012, HCOMP@AAAI.

[46]  Yi Zhao,et al.  Modeling Consumer Learning from Online Product Reviews , 2012, Mark. Sci..

[47]  Arjun Mukherjee,et al.  What Yelp Fake Review Filter Might Be Doing? , 2013, ICWSM.

[48]  Beibei Li,et al.  Examining the Impact of Ranking on Consumer Behavior and Search Engine Revenue , 2013, Manag. Sci..

[49]  Yejin Choi,et al.  Keystroke Patterns as Prosody in Digital Writings: A Case Study with Deceptive Reviews and Essays , 2014, EMNLP.

[50]  Bing Liu,et al.  Spotting Fake Reviews via Collective Positive-Unlabeled Learning , 2014, 2014 IEEE International Conference on Data Mining.

[51]  Jie Zhang,et al.  Towards Collusive Fraud Detection in Online Reviews , 2015, 2015 IEEE International Conference on Data Mining.

[52]  José Fernando Rodrigues,et al.  ORFEL: super-fast detection of defamation and illegitimate promotion in online recommendation , 2015, ArXiv.

[53]  Georgios Zervas,et al.  Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud , 2015, Manag. Sci..

[54]  George Valkanas,et al.  The Impact of Fake Reviews on Online Visibility: A Vulnerability Assessment of the Hotel Industry , 2016, Inf. Syst. Res..

[55]  Weixiang Shao,et al.  Bimodal Distribution and Co-Bursting in Review Spam Detection , 2017, WWW.

[56]  Miriam J. Metzger,et al.  The science of fake news , 2018, Science.

[57]  Sinan Aral,et al.  The spread of true and false news online , 2018, Science.

[58]  Beibei Li,et al.  Modeling Consumer Footprints on Search Engines: An Interplay with Social Media , 2019, Manag. Sci..