Cascading: Association Augmented Sequential Recommendation

Recently, recommendation according to sequential user behaviors has shown promising results in many application scenarios. Generally speaking, real-world sequential user behaviors usually reflect a hybrid of sequential influences and association relationships. However, most existing sequential recommendation methods mainly concentrate on sequential relationships while ignoring association relationships. In this paper, we propose a unified method that incorporates item association and sequential relationships for sequential recommendation. Specifically, we encode the item association as relations in item co-occurrence graph and mine it through graph embedding by GCNs. In the meanwhile, we model the sequential relationships through a widely used RNNs based sequential recommendation method named GRU4Rec. The two parts are connected into an end-to-end network with cascading style, which guarantees that representations for item associations and sequential relationships are learned simultaneously and make the learning process maintain low complexity. We perform extensive experiments on three widely used real-world datasets: TaoBao, Amazon Instant Video and Amazon Cell Phone and Accessories. Comprehensive results have shown that the proposed method outperforms several state-of-the-art methods. Furthermore, a qualitative analysis is also provided to encourage a better understanding about association relationships in sequential recommendation and illustrate the performance gain is exactly from item association.

[1]  Pascal Frossard,et al.  Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Data Domains , 2012, ArXiv.

[2]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[3]  Huan Liu,et al.  Exploring temporal effects for location recommendation on location-based social networks , 2013, RecSys.

[4]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[5]  Mingming Jiang,et al.  A Time-Aware Personalized Point-of-Interest Recommendation via High-Order Tensor Factorization , 2017, ACM Trans. Inf. Syst..

[6]  Yong Yu,et al.  Product-Based Neural Networks for User Response Prediction over Multi-Field Categorical Data , 2018, ACM Trans. Inf. Syst..

[7]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[8]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[9]  Korris Fu-Lai Chung,et al.  A Deep Bayesian Tensor-Based System for Video Recommendation , 2018, ACM Trans. Inf. Syst..

[10]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[11]  Shunzhi Zhu,et al.  Embedding Factorization Models for Jointly Recommending Items and User Generated Lists , 2017, SIGIR.

[12]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[13]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[14]  Alex Graves,et al.  Long Short-Term Memory , 2020, Computer Vision.

[15]  Yehuda Koren,et al.  Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy , 2011, RecSys '11.

[16]  Nuria Oliver,et al.  Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering , 2010, RecSys '10.

[17]  Feng Xu,et al.  Version-Aware Rating Prediction for Mobile App Recommendation , 2017, ACM Trans. Inf. Syst..

[18]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[19]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[20]  David M. Blei,et al.  Factorization Meets the Item Embedding: Regularizing Matrix Factorization with Item Co-occurrence , 2016, RecSys.

[21]  Omer Levy,et al.  Neural Word Embedding as Implicit Matrix Factorization , 2014, NIPS.

[22]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[23]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[24]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[25]  James She,et al.  Collaborative Variational Autoencoder for Recommender Systems , 2017, KDD.

[26]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[27]  John Riedl,et al.  An Empirical Analysis of Design Choices in Neighborhood-Based Collaborative Filtering Algorithms , 2002, Information Retrieval.

[28]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[29]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[30]  S. Mallat A wavelet tour of signal processing , 1998 .

[31]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[32]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[33]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[34]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[35]  Jürgen Ziegler,et al.  Sequential User-based Recurrent Neural Network Recommendations , 2017, RecSys.

[36]  Alexandros Karatzoglou,et al.  Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations , 2016, RecSys.

[37]  Tat-Seng Chua,et al.  SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Nikhil Ketkar,et al.  Convolutional Neural Networks , 2021, Deep Learning with Python.

[39]  Xing Shi,et al.  A Sequential Embedding Approach for Item Recommendation with Heterogeneous Attributes , 2018, ArXiv.

[40]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[41]  Alessandro Bozzon,et al.  Interacting Attention-gated Recurrent Networks for Recommendation , 2017, CIKM.

[42]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[43]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[44]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[45]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[46]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[47]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[48]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[49]  Nadia Magnenat-Thalmann,et al.  Time-aware point-of-interest recommendation , 2013, SIGIR.

[50]  Julian J. McAuley,et al.  Translation-based Recommendation , 2017, RecSys.

[51]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[52]  Alexander J. Smola,et al.  Neural Survival Recommender , 2017, WSDM.

[53]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[54]  Tao Mei,et al.  Contextual Video Recommendation by Multimodal Relevance and User Feedback , 2011, TOIS.