An empirical investigation of user and system recommendations in e-commerce

Despite the popular use of user and system recommendations by online retailers to drive product sales in e-commerce, empirical research investigating their relative effectiveness and interactions still lags. We attempt to answer: (1) What is the relative impact of user and system recommendations on product sales in e-commerce? (2) Are user and system recommendations substitutes or complements in affecting product sales in e-commerce? Using data on the digital camera category from the largest business-to-consumer platform in China, Tmall.com, we use linear panel data models to examine the impact of user recommendation volume and valence, and system recommendation strength on product sales, controlling for relevant factors at the recommended product, product recommender, product category, and time unit levels. Importantly, we account for implicit sales correlations among products and potential simultaneity between recommendations and sales. We uncover several notable findings. Specifically, a 1% increase in the volume (valence) of user recommendations on a product increases the product's sales quantity by 0.013% (0.022%), whereas a 1% increase in the strength of system recommendations on a product increases the product's sales quantity by 0.006%. Overall, user recommendations are more effective than system recommendations in driving product sales. Furthermore, we find that there is a substitute relationship between user recommendation volume and system recommendation strength. Our findings provide important theoretical contributions and implications for recommendation-based product marketing and e-commerce platform design. 1% increase in user recommendation volume increases product sales by 0.013%.1% increase in user recommendation valence increases product sales by 0.022%.1% increase in system recommendation strength increases product sales by 0.006%.User recommendation is more effective than system recommendation in driving sales.Substitute relationship between user and system recommendations in driving sales.

[1]  Donald H. Granbois Consumers' Information Exposure and Patronage Behavior: Three Studies , 1982 .

[2]  Yong Liu Word-of-Mouth for Movies: Its Dynamics and Impact on Box Office Revenue , 2006 .

[3]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[4]  Mike Y. Chen,et al.  Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web , 2001 .

[5]  R. Darlington,et al.  Regression and Linear Models , 1990 .

[6]  Eric R. Spangenberg,et al.  Development of a Scale to Measure Consumer Skepticism Toward Advertising , 1998 .

[7]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[8]  J. Bakos Reducing buyer search costs: implications for electronic marketplaces , 1997 .

[9]  Lihua Huang,et al.  Promotional Marketing or Word-of-Mouth? Evidence from Online Restaurant Reviews , 2013 .

[10]  Panagiotis G. Ipeirotis,et al.  Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics , 2010, IEEE Transactions on Knowledge and Data Engineering.

[11]  Petra Schubert,et al.  Virtual Communities of Transaction: The Role of Personalization in Electronic Commerce , 2000, Electron. Mark..

[12]  Robert F. Whitelaw,et al.  News or Noise? Internet Postings and Stock Prices , 2001 .

[13]  Ramayya Krishnan,et al.  Research Note - The Halo Effect in Multicomponent Ratings and Its Implications for Recommender Systems: The Case of Yahoo! Movies , 2012, Inf. Syst. Res..

[14]  Gal Oestreicher-Singer,et al.  The Network Value of Products , 2013 .

[15]  Gerald Häubl,et al.  Searching in Choice Mode: Consumer Decision Processes in Product Search with Recommendations , 2012 .

[16]  E. Clemons,et al.  When Online Reviews Meet Hyperdifferentiation: A Study of the Craft Beer Industry , 2006 .

[17]  Bin Gu,et al.  Do online reviews matter? - An empirical investigation of panel data , 2008, Decis. Support Syst..

[18]  Henry C. Lucas,et al.  The Value of IT-Enabled Retailer Learning: Personalized Product Recommendations and Customer Store Loyalty in Electronic Markets , 2011, MIS Q..

[19]  Bin Gu,et al.  Competition Among Virtual Communities and User Valuation: The Case of Investing-Related Communities , 2007, Inf. Syst. Res..

[20]  Jennifer Edson Escalas Self-Referencing and Persuasion: Narrative Transportation versus Analytical Elaboration , 2007 .

[21]  P. Nelson Information and Consumer Behavior , 1970, Journal of Political Economy.

[22]  Werner Antweiler,et al.  Is All that Talk Just Noise? The Information Content of Internet Stock Message Boards , 2001 .

[23]  V. Dhar,et al.  Does Chatter Matter? The Impact of User-Generated Content on Music Sales , 2007 .

[24]  Thomas Hess,et al.  Differential Effects of Provider Recommendations and Consumer Reviews in E-Commerce Transactions: An Experimental Study , 2012, J. Manag. Inf. Syst..

[25]  Garrett P. Sonnier,et al.  A Dynamic Model of the Effect of Online Communications on Firm Sales , 2011, Mark. Sci..

[26]  Kartik Hosanagar,et al.  Blockbuster Culture's Next Rise or Fall: The Impact of Recommender Systems on Sales Diversity , 2007, Manag. Sci..

[27]  Arun Sundararajan,et al.  The Visible Hand? Demand Effects of Recommendation Networks in Electronic Markets , 2012, Manag. Sci..

[28]  Yubo Chen,et al.  Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix , 2004, Manag. Sci..

[29]  Pradeep Chintagunta,et al.  The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets , 2010, Mark. Sci..

[30]  Ran Kivetz,et al.  The Effects of Incomplete Information on Consumer Choice , 2000 .

[31]  Yu Jeffrey Hu,et al.  From Niches to Riches: Anatomy of the Long Tail , 2006 .

[32]  Andrew Whinston,et al.  The Dynamics of Online Word-of-Mouth and Product Sales: An Empirical Investigation of the Movie Industry , 2008 .

[33]  X. Zhang,et al.  Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics , 2010 .

[34]  Scott D. Johnson,et al.  Influences on consumer use of word-of-mouth recommendation sources , 1997 .

[35]  Anindya Ghose,et al.  Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets , 2008, Inf. Syst. Res..

[36]  R. Bucklin,et al.  Modeling Purchase Behavior at an E-Commerce Web Site: A Task-Completion Approach , 2004 .

[37]  Irwin P. Levin,et al.  More than Meets the Eye: The Effect of Missing Information on Purchase Evaluations , 1985 .

[38]  David Godes,et al.  Using Online Conversations to Study Word-of-Mouth Communication , 2004 .

[39]  Erik Brynjolfsson,et al.  Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product Sales , 2011, Manag. Sci..

[40]  Angelika Dimoka,et al.  The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation , 2006, Inf. Syst. Res..

[41]  Yong-Soon Kang,et al.  Beauty and the Beholder: Toward an Integrative Model of Communication Source Effects , 2006 .

[42]  Arun Sundararajan,et al.  Recommendation Networks and the Long Tail of Electronic Commerce , 2010, MIS Q..

[43]  Ram D. Gopal,et al.  Empirical Analysis of the Impact of Recommender Systems on Sales , 2010, J. Manag. Inf. Syst..

[44]  Beibei Li,et al.  Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowd-Sourced Content , 2011, Mark. Sci..

[45]  Chrysanthos Dellarocas,et al.  The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback Mechanisms , 2003, Manag. Sci..

[46]  D. Budescu Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. , 1993 .

[47]  K. Pauwels,et al.  Effects of Word-of-Mouth versus Traditional Marketing: Findings from an Internet Social Networking Site , 2009 .

[48]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[49]  Dylan Walker,et al.  Creating Social Contagion Through Viral Product Design: A Randomized Trial of Peer Influence in Networks , 2010, ICIS.

[50]  Erik Brynjolfsson,et al.  Consumer Surplus in the Digital Economy: Estimating the Value of Increased Product Variety at Online Booksellers , 2003, Manag. Sci..

[51]  Pradeep Chintagunta,et al.  Measuring Cross-Category Price Effects with Aggregate Store Data , 2006, Manag. Sci..

[52]  John Riedl,et al.  Recommender systems in e-commerce , 1999, EC '99.

[53]  Jeffrey M. Wooldridge,et al.  Introductory Econometrics: A Modern Approach , 1999 .

[54]  K. Goh,et al.  Social Media Brand Community and Consumer Behavior: Quantifying the Relative Impact of User- and Marketer-Generated Content , 2013 .

[55]  Loriene Roy,et al.  Content-based book recommending using learning for text categorization , 1999, DL '00.

[56]  J. Chevalier,et al.  Measuring Prices and Price Competition Online: Amazon.com and BarnesandNoble.com , 2003 .

[57]  Bin Gu,et al.  Research Note - The Impact of External Word-of-Mouth Sources on Retailer Sales of High-Involvement Products , 2012, Inf. Syst. Res..

[58]  Pei-Yu Sharon Chen,et al.  The Impact of Online Recommendations and Consumer Feedback on Sales , 2004, ICIS.

[59]  Dazhong Wu,et al.  Implications of Reduced Search Cost and Free Riding in E-Commerce , 2004 .

[60]  Arun Sundararajan,et al.  Is Oprah Contagious? Identifying Demand Spillovers in Online Networks , 2012 .

[61]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .