Exploring the influence of online reviews and motivating factors on sales: A meta-analytic study and the moderating role of product category

Abstract Online reviews, which significantly influence product sales, have been a central research topic in the field of marketing. Meanwhile, some motivating factors related to online retailers have been linked to product sales. While several articles have examined the impact between online reviews and motivating factors on product sales, many of the conclusions drawn are contradictory. From 28 studies focusing on online reviews and sales, this study performs a meta-analysis to analyze the true impacts of six review-related factors (i.e., the number of reviews, star ratings, standard deviation of ratings, helpfulness, review length and sentiment), and two motivating factors (i.e., price discounts and special shipping) on product sales. Meanwhile, this paper also studies how one product-related factor (i.e., product age) and one reviewer-related factor (i.e., reviewer's reputation) influence the relationship between online reviews and product sales. In addition, to study the moderating effect of product category, we divide the selected literature into two subgroups which are search and experience products. The results indicate that only review length and special shipping have no significant impact on product sales, while product category has a valid and specific moderating effect on the relationship between these determinants and sales. The presented conclusions will have important implications for academic research and for future industry practice.

[1]  Ying Zhu,et al.  Examining impacts of negative reviews and purchase goals on consumer purchase decision , 2017 .

[2]  Yubo Chen,et al.  Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix , 2004, Manag. Sci..

[3]  Bin Gu,et al.  Research Note - The Impact of External Word-of-Mouth Sources on Retailer Sales of High-Involvement Products , 2012, Inf. Syst. Res..

[4]  J. Fleiss.  Review papers : The statistical basis of meta-analysis , 1993 .

[5]  Tong Bao,et al.  Finding Disseminators Via Electronic Word of Mouth Message for Effective Marketing Communications , 2014, Decis. Support Syst..

[6]  Qihua Liu,et al.  The interaction effects of information cascades, word of mouth and recommendation systems on online reading behavior: an empirical investigation , 2018, Electron. Commer. Res..

[7]  S. F. Bernritter,et al.  The Effect of Online Customer Reviews’ Characteristics on Sales , 2017 .

[8]  Chrysanthos Dellarocas,et al.  The Impact of Online Product Reviews on Product Returns , 2017, Inf. Syst. Res..

[9]  A. Field.  Meta-analysis of correlation coefficients: a Monte Carlo comparison of fixed- and random-effects methods. , 2001, Psychological methods.

[10]  Luis Alberto Mendieta Caballero.  The impact of online ratings on video game sales , 2015 .

[11]  Earl K. Stice,et al.  Analyst Forecasting Ability and the Stock Price Reaction to Forecast Revisions , 2000 .

[12]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[13]  Yoonseo Park,et al.  The impact of text product reviews on sales , 2014 .

[14]  Amit M. Joshi,et al.  A Meta-Analysis of Electronic Word-of-Mouth Elasticity , 2015 .

[15]  Kai H. Lim,et al.  Are all signals equal? Investigating the differential effects of online signals on the sales performance of e-marketplace sellers , 2015, Inf. Technol. People.

[16]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[17]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[18]  Thomas Ehrmann,et al.  The Hitchhiker's Guide to the Long Tail: The Influence of Online-Reviews and Product Recommendations on Book Sales - Evidence from German Online Retailing , 2008, ICIS.

[19]  Jeffrey V. Nickerson,et al.  Arousal, valence, and volume: how the influence of online review characteristics differs with respect to utilitarian and hedonic products , 2018, Eur. J. Inf. Syst..

[20]  A. Herrmann,et al.  Product and Service Bundling Decisions and their Effects on Purchase Intention , 1997 .

[21]  C. Lim,et al.  A Meta-Analytic Review of International Tourism Demand , 1999 .

[22]  Qinghua Zhu,et al.  Towards effective online review systems in the Chinese context: A cross-cultural empirical study , 2013, Electron. Commer. Res. Appl..

[23]  Yang Yang,et al.  Electronic word of mouth and hotel performance: A meta-analysis , 2018, Tourism Management.

[24]  Yang Zhao,et al.  What factors influence the mobile health service adoption? A meta-analysis and the moderating role of age , 2017, Int. J. Inf. Manag..

[25]  K. B. Monroe.  Pricing: Making Profitable Decisions , 1990 .

[26]  Huaiqing Wang,et al.  An influence framework on product word-of-mouth (WoM) measurement , 2017, Inf. Manag..

[27]  Jessica Gurevitch,et al.  Meta-analysis and the science of research synthesis , 2018, Nature.

[28]  Feng Mai,et al.  The effect of online reviews on product sales: A joint sentiment-topic analysis , 2019, Inf. Manag..

[29]  Saad A. Alhoqail,et al.  How Online Product Reviews Affect Retail Sales: A Meta-analysis , 2014 .

[30]  David L. Mothersbaugh,et al.  Information content and consumer readership of print ads: A comparison of search and experience products , 2004 .

[31]  Lorin M. Hitt,et al.  Price Effects in Online Product Reviews: An Analytical Model and Empirical Analysis , 2010, MIS Q..

[32]  Tong Bao,et al.  Why Amazon Uses Both the New York Times Best Seller List and Customer Reviews: An Empirical Study of Multiplier Effects on Product Sales from Multiple Earned Media , 2014, Decis. Support Syst..

[33]  Geng Cui,et al.  Terms of Use , 2003 .

[34]  Ling Liu,et al.  Do online reviews affect product sales? The role of reviewer characteristics and temporal effects , 2008, Inf. Technol. Manag..

[35]  P. Chatterjee,et al.  Online Reviews: Do Consumers Use Them? , 2006 .

[36]  J. Eliashberg,et al.  Modeling goes to Hollywood: predicting individual differences in movie enjoyment , 1994 .

[37]  X. Zhang,et al.  Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics , 2010 .

[38]  Raghu Kacker,et al.  Random-effects model for meta-analysis of clinical trials: an update. , 2007, Contemporary clinical trials.

[39]  Kam-Fai Wong,et al.  Learning Domain-Specific Sentiment Lexicons for Predicting Product Sales , 2011, 2011 IEEE 8th International Conference on e-Business Engineering.

[40]  Zhang Lei.  An Empirical Study of the Impact of Review Content on Online Reviews Helpfulness in E-commerce , 2012 .

[41]  Shan Huang,et al.  The influence of information cascades on online purchase behaviors of search and experience products , 2016, Electron. Commer. Res..

[42]  Wei He,et al.  Is This Opinion Leader's Review Useful? Peripheral Cues for Online Review Helpfulness , 2014 .

[43]  Daniel Baier,et al.  Technology acceptance modeling of augmented reality at the point of sale: Can surveys be replaced by an analysis of online reviews? , 2014 .

[44]  Lorin M. Hitt,et al.  Self Selection and Information Role of Online Product Reviews , 2007, Inf. Syst. Res..

[45]  Jinhong Cui,et al.  Impact of Online Review on Sales: An Empirical Investigation of Experience Products with Different Popularities , 2012, 2012 International Conference on Management of e-Commerce and e-Government.

[46]  Jianhua Chen,et al.  Predicting movie sales revenue using online reviews , 2013, 2013 IEEE International Conference on Granular Computing (GrC).

[47]  P. Dion,et al.  Validating the search, experience, and credence product classification framework , 2010 .

[48]  Pei-Yu Sharon Chen,et al.  The Impact of Online Recommendations and Consumer Feedback on Sales , 2004, ICIS.

[49]  Anindya Ghose,et al.  Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets , 2008, Inf. Syst. Res..

[50]  Cheol Park,et al.  Information direction, website reputation and eWOM effect: A moderating role of product type , 2009 .

[51]  E. Clemons,et al.  When Online Reviews Meet Hyperdifferentiation: A Study of the Craft Beer Industry , 2006 .

[52]  Bin Wang,et al.  Impact of Consumer Reviews and Ratings on Sales, Prices, and Profits: Theory and Evidence , 2008, ICIS.

[53]  Ingoo Han,et al.  The effect of negative online consumer reviews on product attitude: An information processing view , 2008, Electron. Commer. Res. Appl..

[54]  Tammo H. A. Bijmolt,et al.  The Effect of Electronic Word of Mouth on Sales: A Meta-Analytic Review of Platform, Product, and Metric Factors , 2016 .

[55]  Nan Hu,et al.  Ratings lead you to the product, reviews help you clinch it? The mediating role of online review sentiments on product sales , 2014, Decis. Support Syst..

[56]  Jiangning Wu,et al.  Research on the Impact of Consumer Review Sentiments from Different Websites on Product Sales , 2018, 2018 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C).

[57]  Zhijie Lin,et al.  An empirical investigation of user and system recommendations in e-commerce , 2014, Decis. Support Syst..

[58]  Bin Gu,et al.  The influence of online word-of-mouth on long tail formation , 2013, Decis. Support Syst..

[59]  Hongwei Wang,et al.  Impact of online word-of-mouth on sales: the moderating role of product review quality , 2018, New Rev. Hypermedia Multim..

[60]  Eric Fang,et al.  Is Neutral Really Neutral? The Effects of Neutral User-Generated Content on Product Sales , 2014 .

[61]  Jing Zhu,et al.  A meta-analysis of mobile commerce adoption and the moderating effect of culture , 2012, Comput. Hum. Behav..

[62]  Brinja Meiseberg,et al.  The Effectiveness of E-tailers’ Communication Practices in Stimulating Sales of Niche versus Popular Products , 2016 .

[63]  Eric T. Bradlow,et al.  Automated Marketing Research Using Online Customer Reviews , 2011 .

[64]  Patrick De Pelsmacker,et al.  A Meta-analytic Investigation of the Role of Valence in Online Reviews , 2015 .

[65]  Weiguo Fan,et al.  Understanding the determinants of online review helpfulness: A meta-analytic investigation , 2017, Decis. Support Syst..

[66]  Wei Chen,et al.  The influence of user-generated content on traveler behavior: An empirical investigation on the effects of e-word-of-mouth to hotel online bookings , 2011, Comput. Hum. Behav..

[67]  J. B. Kim.  Impact of Online Customer Reviews and Incentives on the Product Sales at the Online Retail Store: An Empirical Study at Amazon.com , 2014, AMCIS.

[68]  Ling Liu,et al.  Manipulation of online reviews: An analysis of ratings, readability, and sentiments , 2012, Decis. Support Syst..

[69]  P. Nelson.  Advertising as Information , 1974, Journal of Political Economy.

[70]  B. Sparks,et al.  The impact of online reviews on hotel booking intentions and perception of trust. , 2011 .

[71]  Il Im,et al.  An analysis of online customer complaints: implications for Web complaint management , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[72]  Ingoo Han,et al.  The Effect of On-Line Consumer Reviews on Consumer Purchasing Intention: The Moderating Role of Involvement , 2007, Int. J. Electron. Commer..

[73]  Arpita Khare,et al.  An integrated model for predicting consumer's intention to write online reviews , 2017, Journal of Retailing and Consumer Services.

[74]  Robert Rosenthal,et al.  Meta-Analytic Procedures for Social Science Research , 1986 .

[75]  John Torous,et al.  The efficacy of smartphone‐based mental health interventions for depressive symptoms: a meta‐analysis of randomized controlled trials , 2017, World psychiatry : official journal of the World Psychiatric Association.

[76]  Yang Zhao,et al.  A hybrid IT framework for identifying high-quality physicians using big data analytics , 2019, Int. J. Inf. Manag..

[77]  Yogesh Kumar Dwivedi,et al.  A Meta-analysis of the Unified Theory of Acceptance and Use of Technology (UTAUT) , 2011, Governance and Sustainability in Information Systems.

[78]  Fernando R. Jiménez,et al.  Too Popular to Ignore: The Influence of Online Reviews on Purchase Intentions of Search and Experience Products , 2013 .

[79]  Van Rooyen G-J,et al.  The review credibility of electronic word-of-mouth communication on e-commerce platforms , 2013 .

[80]  Bin Gu,et al.  Do online reviews matter? - An empirical investigation of panel data , 2008, Decis. Support Syst..

[81]  Petra Schubert,et al.  Virtual Communities of Transaction: The Role of Personalization in Electronic Commerce , 2000, Electron. Mark..

[82]  R. Jacobson,et al.  Market Share and Customers’ Perceptions of Quality: When Can Firms Grow Their Way to Higher versus Lower Quality? , 1999 .

[83]  Baolong Ma,et al.  The impact of online user reviews on cameras sales , 2013 .

[84]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .