Multi-Level Coupling Network for Non-IID Sequential Recommendation

Sequential recommendation has been recently attracting a lot attention to suggest users with next items to interact. However, most of the traditional studies implicitly assume that users and items are independent and identically distributed (IID) and ignore the couplings within and between users and items. Although deep learning techniques allow the model to learn coupling relationships, they only capture a partial picture of the underlying non-IID problem. We argue that it is essential to distinguish the interactions between multiple aspects at different levels explicitly for users’ dynamic preference modeling. On the other hand, existing non-IID recommendation methods are not well designed for the sequential recommendation task since users’ interaction sequence causes more complicated couplings within the system. Hence, to systematically exploit the non-IID theory for coupling learning of sequential recommendation, we propose a non-IID sequential recommendation framework, which extracts users’ dynamic preferences from complex couplings between three aspects, including users, interacted items and target items at feature level, entity level and preference level. Furthermore, to capture the couplings effectively, we implement the framework on the base of capsule network. We indicate that the basic ideas of capsule seamlessly suit our purpose of modeling sophisticated couplings. Finally, we conduct extensive experiments to demonstrate the effectiveness of our approach. The results on three public datasets show that our model consistently outperforms six state-of-the-art methods over three ranking metrics.

[1]  Trevor Darrell,et al.  Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding , 2016, EMNLP.

[2]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[3]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[4]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[5]  Le Wu,et al.  Attentive Recurrent Social Recommendation , 2018, SIGIR.

[6]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[7]  Longbing Cao,et al.  Coupled Poisson Factorization Integrated With User/Item Metadata for Modeling Popular and Sparse Ratings in Scalable Recommendation , 2018, AAAI.

[8]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[9]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[10]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[11]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[12]  Philip S. Yu,et al.  Coupled Behavior Analysis with Applications , 2012, IEEE Transactions on Knowledge and Data Engineering.

[13]  Fangfang Li,et al.  Coupled Matrix Factorization Within Non-IID Context , 2014, PAKDD.

[14]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[15]  Alessandro Bozzon,et al.  Recurrent knowledge graph embedding for effective recommendation , 2018, RecSys.

[16]  Yanmin Zhu,et al.  Next Point-of-Interest Recommendation with Temporal and Multi-level Context Attention , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[17]  Xiaohua Liu,et al.  Dynamic Item Block and Prediction Enhancing Block for Sequential Recommendation , 2019, IJCAI.

[18]  Konstantinos N. Plataniotis,et al.  Brain Tumor Type Classification via Capsule Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[19]  Mohammad Taha Bahadori,et al.  Spectral Capsule Networks , 2018 .

[20]  Tu Minh Phuong,et al.  3D Convolutional Networks for Session-based Recommendation with Content Features , 2017, RecSys.

[21]  Xiaoyu Du,et al.  Outer Product-based Neural Collaborative Filtering , 2018, IJCAI.

[22]  Ulas Bagci,et al.  Capsules for Object Segmentation , 2018, ArXiv.

[23]  Min Yang,et al.  Investigating Capsule Networks with Dynamic Routing for Text Classification , 2018, EMNLP.

[24]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[25]  Alessandro Bozzon,et al.  Interacting Attention-gated Recurrent Networks for Recommendation , 2017, CIKM.

[26]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[27]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[28]  Joemon M. Jose,et al.  A Simple but Hard-to-Beat Baseline for Session-based Recommendations , 2018, ArXiv.

[29]  Liang Wang,et al.  A Hierarchical Contextual Attention-based GRU Network for Sequential Recommendation , 2017, ArXiv.

[30]  Fuzhen Zhuang,et al.  Policy Gradients for Contextual Recommendations , 2018, WWW.

[31]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[32]  Longbing Cao,et al.  HERS: Modeling Influential Contexts with Heterogeneous Relations for Sparse and Cold-Start Recommendation , 2019, AAAI.

[33]  Qiang Liu,et al.  An Optimization View on Dynamic Routing Between Capsules , 2018, ICLR.

[34]  Geoffrey E. Hinton,et al.  Matrix capsules with EM routing , 2018, ICLR.

[35]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[36]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[37]  Longbing Cao,et al.  CoupledCF: Learning Explicit and Implicit User-item Couplings in Recommendation for Deep Collaborative Filtering , 2018, IJCAI.

[38]  Xiaoyan Zhu,et al.  Sentiment Analysis by Capsules , 2018, WWW.

[39]  Longbing Cao,et al.  Coupled Attribute Analysis on Numerical Data , 2013, IJCAI.

[40]  Pengfei Wang,et al.  Learning Hierarchical Representation Model for NextBasket Recommendation , 2015, SIGIR.

[41]  Ed H. Chi,et al.  Towards Neural Mixture Recommender for Long Range Dependent User Sequences , 2019, WWW.

[42]  Longbing Cao,et al.  Non-IID Recommender Systems: A Review and Framework of Recommendation Paradigm Shifting , 2016, ArXiv.

[43]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[44]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[45]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[46]  Longbing Cao,et al.  Coupled nominal similarity in unsupervised learning , 2011, CIKM '11.

[47]  Haifeng Zhao,et al.  Bi-Group Bayesian Personalized Ranking from Implicit Feedback , 2019, CSSE.

[48]  Matthieu Cord,et al.  MUTAN: Multimodal Tucker Fusion for Visual Question Answering , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[49]  Longbing Cao,et al.  Coupling learning of complex interactions , 2015, Inf. Process. Manag..