Predicting Consumption Patterns with Repeated and Novel Events

There are numerous contexts where individuals typically consume a few items from a large selection of possible items. Examples include purchasing products, listening to music, visiting locations in physical or virtual environments, and so on. There has been significant prior work in such contexts on developing predictive modeling techniques for recommending new items to individuals, often using techniques such as matrix factorization. There are many situations, however, where making predictions for both previously-consumed and new items for an individual is important, rather than just recommending new items. We investigate this problem and find that widely-used matrix factorization methods are limited in their ability to capture important details in historical behavior, resulting in relatively low predictive accuracy for these types of problems. As an alternative we propose an interpretable and scalable mixture model framework that balances individual preferences in terms of exploration and exploitation. We evaluate our model in terms of accuracy in user consumption predictions using several real-world datasets, including location data, social media data, and music listening data. Experimental results show that the mixture model approach is systematically more accurate and more efficient for these problems compared to a variety of state-of-the-art matrix factorization methods.

[1]  Thomas L. Griffiths,et al.  Probabilistic Topic Models , 2007 .

[2]  Vikas Kumar,et al.  "I like to explore sometimes": Adapting to Dynamic User Novelty Preferences , 2015, RecSys.

[3]  Sergei Vassilvitskii,et al.  The dynamics of repeat consumption , 2014, WWW.

[4]  Anind K. Dey,et al.  Modeling and Understanding Human Routine Behavior , 2016, CHI.

[5]  Bernt Schiele,et al.  Using rhythm awareness in long-term activity recognition , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[6]  Xin Wang,et al.  Social Recommendation with Strong and Weak Ties , 2016, CIKM.

[7]  Ravi Kumar,et al.  Modeling User Consumption Sequences , 2016, WWW.

[8]  Le Song,et al.  Time-Sensitive Recommendation From Recurrent User Activities , 2015, NIPS.

[9]  Fabian Hadiji,et al.  Poisson Dependency Networks: Gradient Boosted Models for Multivariate Count Data , 2015, Machine Learning.

[10]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[11]  Xueqi Cheng,et al.  Learning Concise Representations of Users' Influences through Online Behaviors , 2017, IJCAI.

[12]  K. Bawa Modeling Inertia and Variety Seeking Tendencies in Brand Choice Behavior , 1990 .

[13]  Jure Leskovec,et al.  Friendship and mobility: user movement in location-based social networks , 2011, KDD.

[14]  George Karypis,et al.  SLIM: Sparse Linear Methods for Top-N Recommender Systems , 2011, 2011 IEEE 11th International Conference on Data Mining.

[15]  Stephen A. Vavasis,et al.  On the Complexity of Nonnegative Matrix Factorization , 2007, SIAM J. Optim..

[16]  Dik Lun Lee,et al.  How Much Novelty is Relevant?: It Depends on Your Curiosity , 2016, SIGIR.

[17]  E. Pessemier,et al.  Variety Seeking Behavior: An Interdisciplinary Review , 2018 .

[18]  David M. Blei,et al.  Exponential Family Embeddings , 2016, NIPS.

[19]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[20]  David M. Blei,et al.  Scalable Recommendation with Poisson Factorization , 2013, ArXiv.

[21]  J. Jacoby,et al.  Brand Loyalty Vs. Repeat Purchasing Behavior , 1973 .

[22]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[23]  Jaime Teevan,et al.  Information re-retrieval: repeat queries in Yahoo's logs , 2007, SIGIR.

[24]  Liangjie Hong,et al.  Returning is Believing: Optimizing Long-term User Engagement in Recommender Systems , 2017, CIKM.

[25]  Yang Guo,et al.  A survey of collaborative filtering based social recommender systems , 2014, Comput. Commun..

[26]  D. Jannach,et al.  On the Value of Reminders within E-Commerce Recommendations , 2016, UMAP.

[27]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[28]  Shuaiqiang Wang,et al.  A survey of serendipity in recommender systems , 2016, Knowl. Based Syst..

[29]  Lawrence Carin,et al.  Non-negative Matrix Factorization for Discrete Data with Hierarchical Side-Information , 2016, AISTATS.

[30]  Ulrich Paquet,et al.  Low-Rank Factorization of Determinantal Point Processes , 2017, AAAI.

[31]  Jure Leskovec,et al.  No country for old members: user lifecycle and linguistic change in online communities , 2013, WWW.

[32]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[33]  Padhraic Smyth,et al.  Personalized location models with adaptive mixtures , 2016, SIGSPATIAL/GIS.