Beyond Movie Recommendations: Solving the Continuous Cold Start Problem in E-commerceRecommendations

Many e-commerce websites use recommender systems or personalized rankers to personalize search results based on their previous interactions. However, a large fraction of users has no prior inter-actions, making it impossible to use collaborative filtering or rely on user history for personalization. Even the most active users mayvisit only a few times a year and may have volatile needs or different personas, making their personal history a sparse and noisy signal at best. This paper investigates how, when we cannot rely on the user history, the large scale availability of other user interactions still allows us to build meaningful profiles from the contextual data and whether such contextual profiles are useful to customize the ranking, exemplified by data from a major online travel agentBooking.com.Our main findings are threefold: First, we characterize the Continuous Cold Start Problem(CoCoS) from the viewpoint of typical e-commerce applications. Second, as explicit situational con-text is not available in typical real world applications, implicit cues from transaction logs used at scale can capture essential features of situational context. Third, contextual user profiles can be created offline, resulting in a set of smaller models compared to a single huge non-contextual model, making contextual ranking available with negligible CPU and memory footprint. Finally we conclude that, in an online A/B test on live users, our contextual ranker in-creased user engagement substantially over a non-contextual base-line, with click-through-rate (CTR) increased by 20%. This clearly demonstrates the value of contextual user profiles in a real world application.

[1]  Rodrygo L. T. Santos,et al.  Topic diversity in tag recommendation , 2013, RecSys.

[2]  Francesco Ricci,et al.  Context-based splitting of item ratings in collaborative filtering , 2009, RecSys '09.

[3]  Djoerd Hiemstra,et al.  Where to Go on Your Next Trip?: Optimizing Travel Destinations Based on User Preferences , 2015, SIGIR.

[4]  Huan Liu,et al.  Context-aware review helpfulness rating prediction , 2013, RecSys.

[5]  Ashish Agarwal,et al.  Overlapping experiment infrastructure: more, better, faster experimentation , 2010, KDD.

[6]  Rob Hall,et al.  Style in the long tail: discovering unique interests with latent variable models in large scale social E-commerce , 2014, KDD.

[7]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[8]  Gediminas Adomavicius,et al.  Incorporating contextual information in recommender systems using a multidimensional approach , 2005, TOIS.

[9]  Joseph A. Konstan,et al.  Evaluating recommender behavior for new users , 2014, RecSys '14.

[10]  Peter D. Turney The Identification of Context-Sensitive Features: A Formal Definition of Context for Concept Learning , 2002, ArXiv.

[11]  Alexis Tsoukiàs,et al.  Multicriteria User Modeling in Recommender Systems , 2011, IEEE Intelligent Systems.

[12]  Mounia Lalmas,et al.  Measuring User Engagement , 2014, Measuring User Engagement.

[13]  Francesco Ricci,et al.  Experimental evaluation of context-dependent collaborative filtering using item splitting , 2013, User Modeling and User-Adapted Interaction.

[14]  Jane Yung-jen Hsu,et al.  Who likes it more?: mining worth-recommending items from long tails by modeling relative preference , 2014, WSDM.

[15]  Maria Fasli,et al.  Utilizing contextual ontological user profiles for personalized recommendations , 2014, Expert Syst. Appl..

[16]  Enhong Chen,et al.  An effective approach for mining mobile user habits , 2010, CIKM.

[17]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[18]  Ryen W. White,et al.  Cross-Device Search , 2014, CIKM.

[19]  Ron Kohavi,et al.  Seven rules of thumb for web site experimenters , 2014, KDD.

[20]  Dietmar Jannach,et al.  Accuracy improvements for multi-criteria recommender systems , 2012, EC '12.

[21]  Gediminas Adomavicius,et al.  New Recommendation Techniques for Multicriteria Rating Systems , 2007, IEEE Intelligent Systems.

[22]  Hui Xiong,et al.  Exploiting enriched contextual information for mobile app classification , 2012, CIKM '12.

[23]  Lars Schmidt-Thieme,et al.  Fast context-aware recommendations with factorization machines , 2011, SIGIR.

[24]  Jaap Kamps,et al.  The Continuous Cold-start Problem in e-Commerce Recommender Systems , 2015, CBRecSys@RecSys.

[25]  Ryen W. White,et al.  Characterizing and predicting search engine switching behavior , 2009, CIKM.

[26]  Blanca Vargas-Govea,et al.  Effects of relevant contextual features in the performance of a restaurant recommender system , 2011 .

[27]  Deepak Agarwal,et al.  fLDA: matrix factorization through latent dirichlet allocation , 2010, WSDM '10.

[28]  Amin Mantrach,et al.  Item cold-start recommendations: learning local collective embeddings , 2014, RecSys '14.

[29]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[30]  Hui Xiong,et al.  An unsupervised approach to modeling personalized contexts of mobile users , 2010, 2010 IEEE International Conference on Data Mining.

[31]  Bamshad Mobasher,et al.  Query-driven context aware recommendation , 2013, RecSys.

[32]  Martha Larson,et al.  TFMAP: optimizing MAP for top-n context-aware recommendation , 2012, SIGIR '12.

[33]  Nuria Oliver,et al.  Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering , 2010, RecSys '10.

[34]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[35]  Francesco Ricci,et al.  Context-Dependent Items Generation in Collaborative Filtering , 2009 .

[36]  Martha Larson,et al.  CARS2: Learning Context-aware Representations for Context-aware Recommendations , 2014, CIKM.

[37]  Ee-Peng Lim,et al.  Modeling Temporal Adoptions Using Dynamic Matrix Factorization , 2013, 2013 IEEE 13th International Conference on Data Mining.

[38]  Toon Calders,et al.  Discovering temporal hidden contexts in web sessions for user trail prediction , 2013, WWW.

[39]  Scott Sanner,et al.  Social collaborative filtering for cold-start recommendations , 2014, RecSys '14.

[40]  Jaideep Srivastava,et al.  Just in Time Recommendations: Modeling the Dynamics of Boredom in Activity Streams , 2015, WSDM.

[41]  Enhong Chen,et al.  A habit mining approach for discovering similar mobile users , 2012, WWW.

[42]  Alexander Tuzhilin,et al.  Using Context to Improve Predictive Modeling of Customers in Personalization Applications , 2008, IEEE Transactions on Knowledge and Data Engineering.

[43]  Liang Tang,et al.  Ensemble contextual bandits for personalized recommendation , 2014, RecSys '14.

[44]  Nikolay Mehandjiev,et al.  Multi-criteria service recommendation based on user criteria preferences , 2011, RecSys '11.

[45]  Robin Burke,et al.  Context-aware music recommendation based on latenttopic sequential patterns , 2012, RecSys.

[46]  Kush R. Varshney,et al.  Dynamic matrix factorization: A state space approach , 2011, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Deepak Agarwal,et al.  Regression-based latent factor models , 2009, KDD.

[48]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[49]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[50]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[51]  Gilad Mishne,et al.  Towards recency ranking in web search , 2010, WSDM '10.

[52]  Gediminas Adomavicius,et al.  Multi-Criteria Recommender Systems , 2011, Recommender Systems Handbook.

[53]  R. Jancey Multidimensional group analysis , 1966 .

[54]  Sean M. McNee,et al.  Getting to know you: learning new user preferences in recommender systems , 2002, IUI '02.

[55]  Alexander Tuzhilin,et al.  Experimental comparison of pre- vs. post-filtering approaches in context-aware recommender systems , 2009, RecSys '09.

[56]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[57]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, RecSys '08.

[58]  Ulf Brefeld,et al.  Factored MDPs for detecting topics of user sessions , 2014, RecSys '14.

[59]  Toon Calders,et al.  Predicting Current User Intent with Contextual Markov Models , 2013, 2013 IEEE 13th International Conference on Data Mining Workshops.