Dual Attention Transfer in Session-based Recommendation with Multi-dimensional Integration

Session-based recommendation (SBR) is widely used in e-commerce to predict the anonymous user's next click action according to a short sequence. Many previous studies have shown the potential advantages of applying Graph Neural Networks (GNN) to SBR tasks. However, the existing SBR models using GNN to solve user preference problems are only based on one single dataset to obtain one recommendation model during training. While the single dataset has the problems including the excessive sparse data source and the long-distance relationship of items. Therefore, introducing the dual transfer, which can enrich the data source, to SBR is absolutely necessary. To this end, a new method is proposed in this paper, which is called dual attention transfer based on multi-dimensional integration (DAT-MDI): (i) DAT uses a potential mapping method based on a slot attention mechanism to extract the user's representation information in different sessions between multiple domains. (ii) MDI combines the graph neural network for the graphs (session graph and global graph) and the gate recurrent unit (GRU) for the sequence to learn the item representation in each session. Then the multi-level session representation are combined by a soft-attention mechanism. We do a variety of experiments on four benchmark datasets which have shown that the superiority of the DAT-MDI model over the state-of-the-art methods.

[1]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[2]  DTCDR , 2019, Proceedings of the 28th ACM International Conference on Information and Knowledge Management.

[3]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[4]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[5]  Ling Chen,et al.  SPORE: A sequential personalized spatial item recommender system , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[6]  Hongzhi Yin,et al.  Streaming Session-based Recommendation , 2019, KDD.

[7]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[8]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[9]  Yan Wang,et al.  DTCDR: A Framework for Dual-Target Cross-Domain Recommendation , 2019, CIKM.

[10]  Tie-Yan Liu,et al.  Dual Learning for Machine Translation , 2016, NIPS.

[11]  Feiping Nie,et al.  Cross-language web page classification via dual knowledge transfer using nonnegative matrix tri-factorization , 2011, SIGIR.

[12]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[13]  Zi Huang,et al.  Rethinking the Item Order in Session-based Recommendation with Graph Neural Networks , 2019, CIKM.

[14]  Yanchi Liu,et al.  Graph Contextualized Self-Attention Network for Session-based Recommendation , 2019, IJCAI.

[15]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[16]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Hui Xiong,et al.  Collaborative Dual-PLSA: mining distinction and commonality across multiple domains for text classification , 2010, CIKM.

[18]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[19]  Georg Heigold,et al.  Object-Centric Learning with Slot Attention , 2020, NeurIPS.

[20]  Guy Shani,et al.  An MDP-Based Recommender System , 2002, J. Mach. Learn. Res..

[21]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[22]  Deepak S. Turaga,et al.  Cross domain distribution adaptation via kernel mapping , 2009, KDD.

[23]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[24]  M. de Rijke,et al.  RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendation , 2018, AAAI.

[25]  Jianmin Wang,et al.  Dual Transfer Learning , 2012, SDM.

[26]  David Maxwell Chickering,et al.  Using Temporal Data for Making Recommendations , 2001, UAI.

[27]  Wei Wei,et al.  Global Context Enhanced Graph Neural Networks for Session-based Recommendation , 2020, SIGIR.

[28]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[29]  Chen Ma,et al.  Hierarchical Gating Networks for Sequential Recommendation , 2019, KDD.

[30]  Pan Li,et al.  DDTCDR: Deep Dual Transfer Cross Domain Recommendation , 2019, WSDM.

[31]  DDTCDR , 2020, Proceedings of the 13th International Conference on Web Search and Data Mining.

[32]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[33]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[34]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[35]  Li Zhao,et al.  Dual Transfer Learning for Neural Machine Translation with Marginal Distribution Regularization , 2018, AAAI.

[36]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.