Incorporating Profit Margins into Recommender Systems: A Randomized Field Experiment of Purchasing Behavior and Consumer Trust

A number of recent studies have proposed new recommender designs that incorporate firm-centric measures (e.g., the profit margins of products) along with consumer-centric measures (e.g., relevance of recommended products). These designs seek to maximize the long-term profits from recommender deployment without compromising customer trust. However, very little is known about how consumers might respond to recommender algorithms that account for product profitability. We tested the impact of deploying a profitbased recommender on its precision and usage, as well as customer purchasing and trust, with data from an online randomized field experiment. We found that the profit-based algorithm, despite potential concerns about its negative impact on consumers, is effective in retaining consumers’ usage and purchase levels at the same rate as a content-based recommender. We also found that the profit-based algorithm generated higher profits for the firm. Further, to measure trust, we issued a post-experiment survey to participants in the experiment; we found there were no significant differences in trust across treatment. We related the survey results to the accuracy and diversity of recommendations and found that accuracy and diversity were both positively and significantly related to trust. The study has broader implications for firms using recommenders as a marketing tool, in that the approach successfully addresses the relevance-profit tradeoff in a real-world context.

[1]  Matthew K. O. Lee,et al.  A Trust Model for Consumer Internet Shopping , 2001, Int. J. Electron. Commer..

[2]  Thompson S. H. Teo,et al.  Consumer trust in e-commerce in the United States, Singapore and China , 2007 .

[3]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .

[4]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[5]  Izak Benbasat,et al.  Trust In and Adoption of Online Recommendation Agents , 2005, J. Assoc. Inf. Syst..

[6]  Kirsten Swearingen,et al.  Beyond Algorithms: An HCI Perspective on Recommender Systems , 2001 .

[7]  H. R. Rao,et al.  A multidimensional trust formation model in B-to-C e-commerce: a conceptual framework and content analyses of academia/practitioner perspectives , 2005, Decision Support Systems.

[8]  R. Gurrea,et al.  The role played by perceived usability, satisfaction and consumer trust on website loyalty , 2006, Inf. Manag..

[9]  Ayman Abuhamdieh,et al.  Factors Influencing Trust in Online Consumer-to-Consumer (C2C) Transactions , 2008 .

[10]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[11]  Carlos Flavián,et al.  The Influence of Satisfaction, Perceived Reputation and Trust on a Consumer's Commitment to a Website , 2007 .

[12]  Sirkka L. Jarvenpaa,et al.  Consumer trust in an Internet store , 2000, Inf. Technol. Manag..

[13]  Rashmi R. Sinha,et al.  Comparing Recommendations Made by Online Systems and Friends , 2001, DELOS.

[14]  Eric T. Bradlow,et al.  The Variety of an Assortment , 1999 .

[15]  Barton A. Weitz,et al.  Marketing the Unfamiliar: The Role of Context and Item-Specific Information in Electronic Agent Recommendations , 2002 .

[16]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[17]  John Short,et al.  The social psychology of telecommunications , 1976 .

[18]  Andrew D. Gershoff,et al.  Consumer Acceptance of Online Agent Advice: Extremity and Positivity Effects , 2003 .

[19]  F. Sultan,et al.  Are the Drivers and Role of Online Trust the Same for All Web Sites and Consumers? A Large-Scale Exploratory Empirical Study , 2005 .

[20]  D. Koehn The Nature of and Conditions for Online Trust , 2003 .

[21]  Joseph P. Cannon,et al.  An Examination of the Nature of Trust in Buyer–Seller Relationships: , 1997 .

[22]  Claire Mathieu,et al.  Maximizing profit using recommender systems , 2009, ArXiv.

[23]  Donna L. Hoffman,et al.  Building consumer trust online , 1999, CACM.

[24]  Barry Smyth,et al.  On the Role of Diversity in Conversational Recommender Systems , 2003, ICCBR.

[25]  D. Gefen,et al.  E-commerce: the role of familiarity and trust , 2000 .

[26]  L. Smeltzer The Meaning and Origin of Trust in Buyer-Supplier Relationships , 1997 .

[27]  M. Koufaris,et al.  CUSTOMER TRUST ONLINE: EXAMINING THE ROLE OF THE EXPERIENCE WITH THE WEB SITE , 2002 .

[28]  Gediminas Adomavicius,et al.  Improving Aggregate Recommendation Diversity Using Ranking-Based Techniques , 2012, IEEE Transactions on Knowledge and Data Engineering.

[29]  Kartik Hosanagar,et al.  Blockbuster Culture's Next Rise or Fall: The Impact of Recommender Systems on Sales Diversity , 2007, Manag. Sci..

[30]  P. Sztompka Trust: A Sociological Theory , 2000 .

[31]  Abhijit Chaudhury,et al.  An empirical investigation of decision-making satisfaction in web-based decision support systems , 2004, Decis. Support Syst..

[32]  Paul Jen-Hwa Hu,et al.  Examining customers' trust in online vendors and their dropout decisions: An empirical study , 2007, Electron. Commer. Res. Appl..

[33]  Yoav Shoham,et al.  Fab: content-based, collaborative recommendation , 1997, CACM.

[34]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[35]  Stephen J. Hoch,et al.  Shelf management and space elasticity , 1994 .

[36]  Anand V. Bodapati Recommendation Systems with Purchase Data , 2008 .

[37]  Gediminas Adomavicius,et al.  Incorporating contextual information in recommender systems using a multidimensional approach , 2005, TOIS.

[38]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[39]  Miriam J. Metzger Effects of Site, Vendor, and Consumer Characteristics on Web Site Trust and Disclosure , 2006, Commun. Res..

[40]  Loriene Roy,et al.  Content-based book recommending using learning for text categorization , 1999, DL '00.

[41]  Matthew Brand,et al.  A Random Walks Perspective on Maximizing Satisfaction and Profit , 2005, SDM.

[42]  Christos Faloutsos,et al.  ValuePick: Towards a Value-Oriented Dual-Goal Recommender System , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[43]  Arkalgud Ramaprasad,et al.  Managing the transition to bricks and clicks , 2003, CACM.

[44]  Mark A. Fuller,et al.  Involvement and Decision-Making Performance with a Decision Aid: The Influence of Social Multimedia, Gender, and Playfulness , 2005, J. Manag. Inf. Syst..

[45]  Wayne D. Hoyer,et al.  Consumers’ Perceptions of the Assortment Offered in a Grocery Category: The Impact of Item Reduction , 1998 .

[46]  David M. Boush,et al.  Trustmarks, objective-source ratings, and implied investments in advertising: Investigating online trust and the context-specific nature of internet signals , 2006 .

[47]  Erik Brynjolfsson,et al.  Consumer Surplus in the Digital Economy: Estimating the Value of Increased Product Variety at Online Booksellers , 2003, Manag. Sci..

[48]  Marios Koufaris,et al.  The development of initial trust in an online company by new customers , 2004, Inf. Manag..

[49]  Chechen Liao,et al.  The roles of habit and web site quality in e-commerce , 2006, Int. J. Inf. Manag..

[50]  Joseph P. Cannon,et al.  Understanding the Influence of National Culture on the Development of Trust , 1998 .

[51]  W. Baumol,et al.  Variety in Retailing , 1956 .

[52]  Jinwoo Kim,et al.  Designing towards emotional usability in customer interfaces trustworthiness of cyber-banking system interfaces , 1998, Interact. Comput..

[53]  Antonella De Angeli,et al.  Personalisation and Trust: A Reciprocal Relationship? , 2004, Designing Personalized User Experiences in eCommerce.

[54]  Robert Garfinkel,et al.  Empirical Analysis of the Business Value of Recommender Systems , 2006 .

[55]  Paul A. Pavlou,et al.  Consumer Acceptance of Electronic Commerce: Integrating Trust and Risk with the Technology Acceptance Model , 2003, Int. J. Electron. Commer..

[56]  Charles J. Kacmar,et al.  Developing and Validating Trust Measures for e-Commerce: An Integrative Typology , 2002, Inf. Syst. Res..

[57]  Ramayya Krishnan,et al.  Recomended for You: The Impact of Profit Incentives on the Relevance of Online Recommendations , 2008, ICIS.

[58]  Yi-Cheng Ku,et al.  Personalized Content Recommendation and User Satisfaction: Theoretical Synthesis and Empirical Findings , 2006, J. Manag. Inf. Syst..

[59]  Mark Claypool,et al.  Combining Content-Based and Collaborative Filters in an Online Newspaper , 1999, SIGIR 1999.

[60]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[61]  J. H. Davis,et al.  An Integrative Model of Organizational Trust: Past, Present, and Future , 2007 .

[62]  Izak Benbasat,et al.  The Effects of Personalizaion and Familiarity on Trust and Adoption of Recommendation Agents , 2006, MIS Q..

[63]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[64]  Chen Wang,et al.  Consumer privacy concerns about Internet marketing , 1998, CACM.

[65]  I. Simonson,et al.  Determinants of Customers' Responses to Customized Offers: Conceptual Framework and Research Propositions , 2003 .

[66]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[67]  Ardion Beldad,et al.  How shall I trust the faceless and the intangible? A literature review on the antecedents of online trust , 2010, Comput. Hum. Behav..

[68]  M. F. Luce,et al.  Constructive Consumer Choice Processes , 1998 .

[69]  Huei Huang Kuan,et al.  Trust transference in brick and click retailers: An investigation of the before-online-visit phase , 2007, Inf. Manag..

[70]  Long-Sheng Chen,et al.  Developing recommender systems with the consideration of product profitability for sellers , 2008, Inf. Sci..

[71]  Detmar W. Straub,et al.  Trust and TAM in Online Shopping: An Integrated Model , 2003, MIS Q..

[72]  L. Hosmer TRUST: THE CONNECTING LINK BETWEEN ORGANIZATIONAL THEORY AND PHILOSOPHICAL ETHICS , 1995 .

[73]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[74]  Carl F. Mela,et al.  E-Customization , 2003 .

[75]  Paulo J. G. Lisboa,et al.  The value of personalised recommender systems to e-business: a case study , 2008, RecSys '08.

[76]  I HerpenvanH.W.,et al.  The Variety of An Assortment : An Extension to the Attribute-Based Approach , 2002 .

[77]  R. Kohli,et al.  Internet Recommendation Systems , 2000 .

[78]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[79]  Alexander Tuzhilin,et al.  Using Context to Improve Predictive Modeling of Customers in Personalization Applications , 2008, IEEE Transactions on Knowledge and Data Engineering.

[80]  David Gefen,et al.  Some antecedents and effects of trust in virtual communities , 2002, J. Strateg. Inf. Syst..

[81]  Yamada Takeshi,et al.  Recommendation Method for Improving Customer Lifetime Value , 2007 .

[82]  Changfeng Chen,et al.  Identifying Significant Factors Influencing Consumer Trust in an Online Travel Site , 2006, J. Inf. Technol. Tour..

[83]  B. Kahn,et al.  Modeling choice among assortments. , 1991 .

[84]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[85]  Ian Soboroff. Charles Nicholas Combining Content and Collaboration in Text Filtering , 1999 .

[86]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[87]  Wee Sun Lee Collaborative Learning for Recommender Systems , 2001 .

[88]  Han Yi,et al.  Trust and e-commerce: a study of consumer perceptions , 2003, Electron. Commer. Res. Appl..

[89]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.