S-Walk: Accurate and Scalable Session-based Recommendation with Random Walks

Session-based recommendation (SR) predicts the next items from a sequence of previous items consumed by an anonymous user. Most existing SR models focus only on modeling intra-session characteristics but pay less attention to inter-session relationships of items, which has the potential to improve accuracy. Another critical aspect of recommender systems is computational efficiency and scalability, considering practical feasibility in commercial applications. To account for both accuracy and scalability, we propose a novel session-based recommendation with a random walk, namely SWalk. Precisely, S-Walk effectively captures intraand inter-session correlations by handling high-order relationships among items using random walks with restart (RWR). By adopting linear models with closed-form solutions for transition and teleportation matrices that constitute RWR, S-Walk is highly efficient and scalable. Extensive experiments demonstrate that S-Walk achieves comparable or state-of-the-art performance in various metrics on four benchmark datasets. Moreover, the model learned by S-Walk can be highly compressed without sacrificing accuracy, conducting two or more orders of magnitude faster inference than existing DNN-based models, making it suitable for large-scale commercial systems.

[1]  Diksha Garg,et al.  NISER: Normalized Item and Session Representations with Graph Neural Networks , 2019, ArXiv.

[2]  Harald Steck,et al.  Markov Random Fields for Collaborative Filtering , 2019, NeurIPS.

[3]  Harald Steck Collaborative Filtering via High-Dimensional Regression , 2019, ArXiv.

[4]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[5]  George Karypis,et al.  RecWalk: Nearly Uncoupled Random Walks for Top-N Recommendation , 2019, WSDM.

[6]  Colin Cooper,et al.  Random walks in recommender systems: exact computation and simulations , 2014, WWW.

[7]  Jure Leskovec,et al.  Pixie: A System for Recommending 3+ Billion Items to 200+ Million Users in Real-Time , 2017, WWW.

[8]  Abraham Bernstein,et al.  Blockbusters and Wallflowers: Accurate, Diverse, and Scalable Recommendations with Random Walks , 2015, RecSys.

[9]  Deqing Wang,et al.  Collaborative Self-Attention Network for Session-based Recommendation , 2020, IJCAI.

[10]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[11]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[12]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[13]  Dietmar Jannach,et al.  User Modeling and User-Adapted Interaction Session-based Item Recommendation in E-Commerce On Short-Term Intents , Reminders , Trends , and Discounts , 2017 .

[14]  Jongwuk Lee,et al.  Local Collaborative Autoencoders , 2021, WSDM.

[15]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[16]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[17]  Yoram Singer,et al.  Matrix Approximation under Local Low-Rank Assumption , 2013, ICLR.

[18]  Dietmar Jannach,et al.  Automated Generation of Music Playlists: Survey and Experiments , 2014, ACM Comput. Surv..

[19]  Noemi Mauro,et al.  Empirical analysis of session-based recommendation algorithms , 2019, User Model. User Adapt. Interact..

[20]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[21]  Dietmar Jannach,et al.  Evaluation of session-based recommendation algorithms , 2018, User Modeling and User-Adapted Interaction.

[22]  Bart Goethals,et al.  Unifying nearest neighbors collaborative filtering , 2014, RecSys '14.

[23]  Samy Bengio,et al.  LLORMA: Local Low-Rank Matrix Approximation , 2016, J. Mach. Learn. Res..

[24]  Samy Bengio,et al.  Local collaborative ranking , 2014, WWW.

[25]  M. de Rijke,et al.  Rethinking Item Importance in Session-based Recommendation , 2020, SIGIR.

[26]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[27]  Diksha Garg,et al.  Sequence and Time Aware Neighborhood for Session-based Recommendations: STAN , 2019, SIGIR.

[28]  Wei Wei,et al.  Global Context Enhanced Graph Neural Networks for Session-based Recommendation , 2020, SIGIR.

[29]  Dietmar Jannach,et al.  When Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation , 2017, RecSys.

[30]  Dietmar Jannach,et al.  A Comparison of Frequent Pattern Techniques and a Deep Learning Method for Session-Based Recommendation , 2017, RecTemp@RecSys.

[31]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[32]  Joonseok Lee,et al.  N-GCN: Multi-scale Graph Convolution for Semi-supervised Node Classification , 2018, UAI.

[33]  Bart Goethals,et al.  Closed-Form Models for Collaborative Filtering with Side-Information , 2020, RecSys.

[34]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[35]  Harald Steck,et al.  Embarrassingly Shallow Autoencoders for Sparse Data , 2019, WWW.

[36]  Yanchi Liu,et al.  Graph Contextualized Self-Attention Network for Session-based Recommendation , 2019, IJCAI.

[37]  Maksims Volkovs,et al.  Effective Latent Models for Binary Feedback in Recommender Systems , 2015, SIGIR.

[38]  Amy Nicole Langville,et al.  Google's PageRank and beyond - the science of search engine rankings , 2006 .

[39]  Michael Carbin,et al.  The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks , 2018, ICLR.

[40]  George Karypis,et al.  Boosting Item-based Collaborative Filtering via Nearly Uncoupled Random Walks , 2019, ACM Trans. Knowl. Discov. Data.

[41]  Alexandros Karatzoglou,et al.  Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations , 2016, RecSys.

[42]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[43]  Martin Ester,et al.  TrustWalker: a random walk model for combining trust-based and item-based recommendation , 2009, KDD.

[44]  Yoram Singer,et al.  Local Low-Rank Matrix Approximation , 2013, ICML.

[45]  M. de Rijke,et al.  Star Graph Neural Networks for Session-based Recommendation , 2020, CIKM.

[46]  George Karypis,et al.  SLIM: Sparse Linear Methods for Top-N Recommender Systems , 2011, 2011 IEEE 11th International Conference on Data Mining.

[47]  Guibing Guo,et al.  Deep Learning-Based Sequential Recommender Systems: Concepts, Algorithms, and Evaluations , 2019, ICWE.

[48]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[49]  Mukkai S. Krishnamoorthy,et al.  A random walk method for alleviating the sparsity problem in collaborative filtering , 2008, RecSys '08.

[50]  Jongwuk Lee,et al.  Session-aware Linear Item-Item Models for Session-based Recommendation , 2021, WWW.

[51]  Noemi Mauro,et al.  Performance comparison of neural and non-neural approaches to session-based recommendation , 2019, RecSys.

[52]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[53]  M. de Rijke,et al.  A Collaborative Session-based Recommendation Approach with Parallel Memory Modules , 2019, SIGIR.