Modeling Consumer Preferences and Price Sensitivities from Large-Scale Grocery Shopping Transaction Logs

In order to match shoppers with desired products and provide personalized promotions, whether in online or offline shopping worlds, it is critical to model both consumer preferences and price sensitivities simultaneously. Personalized preferences have been thoroughly studied in the field of recommender systems, though price (and price sensitivity) has received relatively little attention. At the same time, price sensitivity has been richly explored in the area of economics, though typically not in the context of developing scalable, working systems to generate recommendations. In this study, we seek to bridge the gap between large-scale recommender systems and established consumer theories from economics, and propose a nested feature-based matrix factorization framework to model both preferences and price sensitivities. Quantitative and qualitative results indicate the proposed personalized, interpretable and scalable framework is capable of providing satisfying recommendations (on two datasets of grocery transactions) and can be applied to obtain economic insights into consumer behavior.

[1]  Deepak Agarwal,et al.  GLMix: Generalized Linear Mixed Models For Large-Scale Response Prediction , 2016, KDD.

[2]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[3]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[4]  George Karypis,et al.  Sparse linear methods with side information for top-n recommendations , 2012, RecSys.

[5]  C. McCulloch,et al.  Generalized Linear Mixed Models , 2005 .

[6]  Pasquale Lops,et al.  Content-based Recommender Systems: State of the Art and Trends , 2011, Recommender Systems Handbook.

[7]  S. J. Spurr.  Principles of microeconomics (I) , 2019, Economic Foundations of Law.

[8]  Sunho Park,et al.  Hierarchical Bayesian Matrix Factorization with Side Information , 2013, IJCAI.

[9]  Daniel A. Ackerberg.  Advertising, Learning, and Consumer Choice in Experience Good Markets: An Empirical Examination , 2003 .

[10]  Mu Zhu,et al.  Content-boosted matrix factorization for recommender systems: experiments with recipe recommendation , 2011, RecSys '11.

[11]  Vanja Josifovski,et al.  Latent factor models with additive and hierarchically-smoothed user preferences , 2013, WSDM.

[12]  Pradeep K. Chintagunta,et al.  Investigating Purchase Incidence, Brand Choice and Purchase Quantity Decisions of Households , 1993 .

[13]  Panniello Umberto,et al.  Developing a Price-Sensitive Recommender System to Improve Accuracy and Business Performance of Ecommerce Applications , 2015 .

[14]  Bernd Ludwig,et al.  Matrix factorization techniques for context aware recommendation , 2011, RecSys '11.

[15]  Jie Zhang,et al.  Customizing Promotions in Online Stores , 2004 .

[16]  Yuan-Chun Jiang,et al.  Optimization of Online Promotion: a Profit-Maximizing Model Integrating Price discount and Product Recommendation , 2012, Int. J. Inf. Technol. Decis. Mak..

[17]  Nicholas T. Longford,et al.  Random Coefficient Models , 1994, International Encyclopedia of Statistical Science.

[18]  References , 1971 .

[19]  Brian Hutton,et al.  Does analysis using “last observation carried forward” introduce bias in dementia research? , 2008, Canadian Medical Association Journal.

[20]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[21]  J. H. May,et al.  Redesigning Promotion Strategy For E-commerce Competitiveness Through Pricing and Recommendation , 2015 .

[22]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[23]  Peter J. Danaher,et al.  Where, When, and how Long: Factors that Influence the Redemption of Mobile Phone Coupons , 2015 .

[24]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[25]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[26]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[27]  Christopher Meek,et al.  A unified approach to building hybrid recommender systems , 2009, RecSys '09.

[28]  Greg M. Allenby,et al.  A Hierarchical Bayes Model of Primary and Secondary Demand , 1998 .

[29]  A. M. Madni,et al.  Recommender systems in e-commerce , 2014, 2014 World Automation Congress (WAC).

[30]  Max Welling,et al.  Bayesian Matrix Factorization with Side Information and Dirichlet Process Mixtures , 2010, AAAI.

[31]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[32]  Sunil Gupta.  Impact of Sales Promotions on when, what, and how Much to Buy , 1988 .

[33]  Deepak Agarwal,et al.  Regression-based latent factor models , 2009, KDD.

[34]  Yong Yu,et al.  SVDFeature: a toolkit for feature-based collaborative filtering , 2012, J. Mach. Learn. Res..

[35]  M. Wedel,et al.  The Effectiveness of Customized Promotions in Online and Offline Stores , 2009 .

[36]  J. Muellbauer,et al.  An Almost Ideal Demand System , 1980 .

[37]  Lee G. Cooper,et al.  Market-Share Analysis: Evaluating Competitive Marketing Effectiveness , 1988 .

[38]  Geoffrey J. Gordon,et al.  A Unified View of Matrix Factorization Models , 2008, ECML/PKDD.

[39]  A. Rangaswamy,et al.  Consumer Choice Behavior in Online and Traditional Supermarkets: The Effects of Brand Name, Price, , 2000 .