What makes a helpful online review? A meta-analysis of review characteristics

In this study, we aim to clarify the determinants of online review helpfulness concerning review depth, extremity and timeliness. Based on a meta-analysis, we examine the effects of important characteristics of reviews employing 53 empirical studies yielding 191 effect sizes. Findings reveal that review depth has a greater impact on helpfulness than review extremity and timeliness with the exception of its sub-metric of review volume, which exerts the negative influence on review helpfulness. Specifically, readability is the most important factor in evaluating review helpfulness. Furthermore, we discuss important moderators of the relationships and find interesting insights regarding website and culture background. In accordance with the results, we propose several implications for researchers and E-business firms. Our study provides a much needed quantitative synthesis of this burgeoning stream of research.

[1]  Yi-Hsiu Cheng,et al.  Social influence's impact on reader perceptions of online reviews , 2015 .

[2]  Di Xu,et al.  Research of online review helpfulness based on negative binary regress model the mediator role of reader participation , 2015, 2015 12th International Conference on Service Systems and Service Management (ICSSSM).

[3]  Rolph E. Anderson,et al.  Multivariate data analysis (4th ed.): with readings , 1995 .

[4]  Juan Luis Nicolau,et al.  Asymmetric effects of online consumer reviews , 2015 .

[5]  Panagiotis G. Ipeirotis,et al.  Designing novel review ranking systems: predicting the usefulness and impact of reviews , 2007, ICEC.

[6]  Yun Wan,et al.  The Matthew Effect in social commerce , 2015, Electron. Mark..

[7]  Du Zhang,et al.  Automatically predicting the helpfulness of online reviews , 2014, Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration (IEEE IRI 2014).

[8]  JoongHo Ahn,et al.  Helpfulness of Online Consumer Reviews: Readers' Objectives and Review Cues , 2012, Int. J. Electron. Commer..

[9]  Franziska Völckner,et al.  The price-perceived quality relationship: A meta-analytic review and assessment of its determinants , 2007 .

[10]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[11]  Linchi Kwok,et al.  Factors contributing to the helpfulness of online hotel reviews , 2016 .

[12]  Ling Liu,et al.  Do online reviews affect product sales? The role of reviewer characteristics and temporal effects , 2008, Inf. Technol. Manag..

[13]  Zheng Xiang,et al.  A comparative analysis of major online review platforms: Implications for social media analytics in hospitality and tourism , 2017 .

[14]  Thomas L. Ngo-Ye,et al.  The influence of reviewer engagement characteristics on online review helpfulness: A text regression model , 2014, Decis. Support Syst..

[15]  G. Tellis The Price Elasticity of Selective Demand: A Meta-Analysis of Econometric Models of Sales , 1988 .

[16]  Izak Benbasat,et al.  Investigating the Influence of the Functional Mechanisms of Online Product Presentations , 2007 .

[17]  Anindya Ghose,et al.  Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets , 2008, Inf. Syst. Res..

[18]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[19]  David A. Schweidel,et al.  Listening in on Social Media: A Joint Model of Sentiment and Venue Format Choice , 2014 .

[20]  R. Schindler,et al.  Perceived Helpfulness of Online Consumer Reviews: The Role of Message Content and Style , 2010 .

[21]  Bin Gu,et al.  Do online reviews matter? - An empirical investigation of panel data , 2008, Decis. Support Syst..

[22]  C. Schultz,et al.  The moderating role of internal and external resources on the performance effect of multitasking: Evidence from the R&D performance of surgeons , 2013 .

[23]  Tranos Zuva,et al.  CORPORATE GOVERNANCE AND ORGANISATIONAL PERFORMANCE , 2018 .

[24]  W. Chu,et al.  Exploring the Role of Preference Heterogeneity and Causal Attribution in Online Ratings Dynamics , 2014 .

[25]  Huiping Huang,et al.  A Cross-Cultural Test of the Spiral of Silence , 2005 .

[26]  Eric K. Clemons,et al.  Do Online Reviews Reflect a Product's True Perceived Quality? - An Investigation of Online Movie Reviews Across Cultures , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[27]  David W. Johnson,et al.  Effects of cooperative, competitive, and individualistic goal structures on achievement: A meta-analysis. , 1981 .

[28]  Kai Lung Hui,et al.  What Makes a Review Voted? An Empirical Investigation of Review Voting in Online Review Systems , 2015, J. Assoc. Inf. Syst..

[29]  Philip Fei Wu In Search of Negativity Bias: An Empirical Study of Perceived Helpfulness of Online Reviews , 2013 .

[30]  David C. Yen,et al.  Predicting the Helpfulness of Online Reviews—A Replication , 2013, Int. J. Hum. Comput. Interact..

[31]  Xiaojun Wang,et al.  Exploring Determinants of Attraction and Helpfulness of Online Product Review: A Consumer Behaviour Perspective , 2016 .

[32]  Ayyaz Hussain,et al.  An analysis of review content and reviewer variables that contribute to review helpfulness , 2018, Inf. Process. Manag..

[33]  David C. Yen,et al.  A study of factors that contribute to online review helpfulness , 2015, Comput. Hum. Behav..

[34]  Kuanchin Chen,et al.  Predicting hotel review helpfulness: The impact of review visibility, and interaction between hotel stars and review ratings , 2016, Int. J. Inf. Manag..

[35]  Wei He,et al.  Is This Opinion Leader's Review Useful? Peripheral Cues for Online Review Helpfulness , 2014 .

[36]  Joon Yeon Choeh,et al.  Exploring the determinants of and predicting the helpfulness of online user reviews using decision trees , 2017 .

[37]  Pradeep Racherla,et al.  Perceived 'usefulness' of online consumer reviews: An exploratory investigation across three services categories , 2012, Electron. Commer. Res. Appl..

[38]  Snehasish Banerjee,et al.  Understanding review helpfulness as a function of reviewer reputation, review rating, and review depth , 2015, J. Assoc. Inf. Sci. Technol..

[39]  Jung Lee,et al.  What Makes People Read an Online Review? The Relative Effects of Posting Time and Helpfulness on Review Readership , 2013, Cyberpsychology Behav. Soc. Netw..

[40]  Lauren I. Labrecque,et al.  The Assimilative and Contrastive Effects of Word-of-Mouth Volume: An Experimental Examination of Online Consumer Ratings , 2011 .

[41]  R. Rosenthal Parametric measures of effect size. , 1994 .

[42]  Donald R. Lehmann,et al.  Empirical Marketing Generalization Using Meta-Analysis , 1995 .

[43]  Yimeng Li,et al.  Effects of Emotional Valence and Arousal on Consumer Perceptions of Online Review Helpfulness , 2014 .

[44]  Wonjoon Kim,et al.  The impact of emotions on the helpfulness of movie reviews , 2015 .

[45]  Raffaele Filieri What makes online reviews helpful? A diagnosticity-adoption framework to explain informational and normative influences in e-WOM , 2015 .

[46]  Jason Q. Zhang,et al.  When does electronic word-of-mouth matter? A study of consumer product reviews☆ , 2010 .

[47]  C. D. Ward,et al.  Better Liked than Right , 1980 .

[48]  Fang Wang,et al.  Online review helpfulness: Impact of reviewer profile image , 2017, Decis. Support Syst..

[49]  JoongHo Ahn,et al.  Normative Social Influence and Online Review Helpfulness: Polynomial Modeling and Response Surface Analysis , 2015 .

[50]  Peter C. Neijens,et al.  "Highly Recommended!" The Content Characteristics and Perceived Usefulness of Online Consumer Reviews , 2011, J. Comput. Mediat. Commun..

[51]  Wei Xu,et al.  Exploring Heuristic cues for Consumer Perceptions of Online Reviews Helpfulness: the Case of Yelp.Com , 2014, PACIS.

[52]  Zhu Zhang Weighing Stars: Aggregating Online Product Reviews for Intelligent E-commerce Applications , 2008, IEEE Intelligent Systems.

[53]  Elena García Barriocanal,et al.  Evaluating content quality and helpfulness of online product reviews: The interplay of review helpfulness vs. review content , 2012, Electron. Commer. Res. Appl..

[54]  Erik Cambria,et al.  A concept-level approach to the analysis of online review helpfulness , 2016, Comput. Hum. Behav..

[55]  Sangwon Park,et al.  What makes a useful online review? Implication for travel product websites. , 2015 .

[56]  Yogesh Kumar Dwivedi,et al.  Predicting the “helpfulness” of online consumer reviews , 2017 .

[57]  Alton Yeow-Kuan Chua,et al.  Helpfulness of user-generated reviews as a function of review sentiment, product type and information quality , 2016, Comput. Hum. Behav..

[58]  Ingoo Han,et al.  The Effects of Consumer Knowledge on Message Processing of Electronic Word of Mouth via Online Consumer Reviews , 2008, ECIS.

[59]  Sangjae Lee,et al.  Predicting the helpfulness of online reviews using multilayer perceptron neural networks , 2014, Expert Syst. Appl..

[60]  Hulisi Ögüt,et al.  The influence of internet customer reviews on the online sales and prices in hotel industry , 2012 .

[61]  J. Farley,et al.  How Advertising Affects Sales: Meta-Analysis of Econometric Results , 1984 .

[62]  Qing Cao,et al.  Exploring determinants of voting for the "helpfulness" of online user reviews: A text mining approach , 2011, Decis. Support Syst..

[63]  Nikolaos Korfiatis,et al.  The Influences of Negativity and Review Quality on the Helpfulness of Online Reviews , 2011, ICIS.

[64]  Han Zhang,et al.  Anxious or Angry? Effects of Discrete Emotions on the Perceived Helpfulness of Online Reviews , 2014, MIS Q..

[65]  Yue Pan,et al.  Born Unequal: A Study of the Helpfulness of User-Generated Product Reviews , 2011 .

[66]  Geng Cui,et al.  Terms of Use , 2003 .

[67]  Hong-Hee Lee,et al.  Corporate blogging strategies of the Fortune 500 companies , 2006 .

[68]  Bin Guo,et al.  What makes population perception of review helpfulness: an information processing perspective , 2017, Electron. Commer. Res..

[69]  Jahna Otterbacher,et al.  'Helpfulness' in online communities: a measure of message quality , 2009, CHI.

[70]  J. Leon Zhao,et al.  Introduction to the special issue of ECR on E-business innovation with big data , 2017, Electron. Commer. Res..

[71]  Nicholas H. Lurie,et al.  Temporal Contiguity and Negativity Bias in the Impact of Online Word of Mouth , 2013 .

[72]  Bin Guo,et al.  The Interactive Effect of Review Rating and Text Sentiment on Review Helpfulness , 2015, EC-Web.

[73]  Dennis F. Galletta,et al.  Cognitive Fit: An Empirical Study of Information Acquisition , 1991, Inf. Syst. Res..

[74]  Chrysanthos Dellarocas,et al.  The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback Mechanisms , 2003, Manag. Sci..

[75]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[76]  J. Singer,et al.  Applied Longitudinal Data Analysis , 2003 .

[77]  Tammo H. A. Bijmolt,et al.  The Effect of Electronic Word of Mouth on Sales: A Meta-Analytic Review of Platform, Product, and Metric Factors , 2016 .

[78]  Hermann Haken Discrete dynamics of complex systems , 1997 .

[79]  Hengyun Li,et al.  How Review Sentiment and Readability Affect Online Peer Evaluation Votes? – An Examination Combining Reviewer’s Social Identity and Social network , 2016 .

[80]  Tammo H. A. Bijmolt,et al.  Meta-Analysis in Marketing when Studies Contain Multiple Measurements , 2001 .

[81]  Thomas W. Jackson,et al.  Theory-based model of factors affecting information overload , 2012, Int. J. Inf. Manag..

[82]  Mohammad Salehan,et al.  Predicting the performance of online consumer reviews: A sentiment mining approach to big data analytics , 2014, Decis. Support Syst..

[83]  J. Gotlieb,et al.  The Moderating Effects of Message Framing and Source Credibility on the Price-perceived Risk Relationship , 1994 .

[84]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[85]  Amit M. Joshi,et al.  A Meta-Analysis of Electronic Word-of-Mouth Elasticity , 2015 .

[86]  Linda Court Salisbury,et al.  The Formation of Market-Level Expectations and Its Covariates , 2003 .

[87]  Panagiotis G. Ipeirotis,et al.  Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics , 2010, IEEE Transactions on Knowledge and Data Engineering.

[88]  Rajiv Kohli,et al.  Understanding Determinants of Online Consumer Satisfaction: A Decision Process Perspective , 2004, J. Manag. Inf. Syst..

[89]  Patrick De Pelsmacker,et al.  A Meta-analytic Investigation of the Role of Valence in Online Reviews , 2015 .

[90]  Xiangji Huang,et al.  Mining Online Reviews for Predicting Sales Performance: A Case Study in the Movie Domain , 2012, IEEE Transactions on Knowledge and Data Engineering.

[91]  Jianan Wu,et al.  Review popularity and review helpfulness: A model for user review effectiveness , 2017, Decis. Support Syst..

[92]  Jan Muntermann,et al.  Explaining and predicting online review helpfulness: The role of content and reviewer-related signals , 2018, Decis. Support Syst..

[93]  Jin Li,et al.  Online Persuasion: How the Written Word Drives WOM , 2011, Journal of Advertising Research.

[94]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[95]  Saad A. Alhoqail,et al.  How Online Product Reviews Affect Retail Sales: A Meta-analysis , 2014 .

[96]  Soo-Min Kim,et al.  Automatically Assessing Review Helpfulness , 2006, EMNLP.

[97]  Steven P. Brown,et al.  On the use of beta coefficients in meta-analysis. , 2005, The Journal of applied psychology.

[98]  Q. Ye,et al.  Analysis of the Perceived Value of Online Tourism Reviews: Influence of Readability and Reviewer Characteristics , 2016 .

[99]  R. Schindler,et al.  Perceived helpfulness of online consumer reviews: The role of message content and style: Perceived helpfulness of online consumer reviews , 2012 .

[100]  Lars Jaakko Havro,et al.  An Empirical Investigation of Self-Selection Bias and Factors Influencing Review Helpfulness , 2015 .

[101]  Jan Muntermann,et al.  AIS Electronic Library (AISeL) , 2000 .

[102]  Chih-Chien Wang,et al.  Perceived Usefulness of Word-of-Mouth: An Analysis of Sentimentality in Product Reviews , 2015, MISNC.

[103]  Yili Hong,et al.  Effects of membership tier on user content generation behaviors: evidence from online reviews , 2017, Electronic Commerce Research.