Dual-Task Learning for Multi-Behavior Sequential Recommendation

Recently, sequential recommendation has become a research hotspot while multi-behavior sequential recommendation (MBSR) that exploits users' heterogeneous interactions in sequences has received relatively little attention. Existing works often overlook the complementary effect of different perspectives when addressing the MBSR problem. In addition, there are two specific challenges remained to be addressed. One is the heterogeneity of a user's intention and the context information, the other one is the sparsity of the interactions of target behavior. To release the potential of multi-behavior interaction sequences, we propose a novel framework named NextIP that adopts a dual-task learning strategy to convert the problem to two specific tasks, i.e., next-item prediction and purchase prediction. For next-item prediction, we design a target-behavior aware context aggregator (TBCG), which utilizes the next behavior to guide all kinds of behavior-specific item sub-sequences to jointly predict the next item. For purchase prediction, we design a behavior-aware self-attention (BSA) mechanism to extract a user's behavior-specific interests and treat them as negative samples to learn the user's purchase preferences. Extensive experimental results on two public datasets show that our NextIP performs significantly better than the state-of-the-art methods.

[1]  Ruobing Xie,et al.  Multi-view Multi-behavior Contrastive Learning in Recommendation , 2022, DASFAA.

[2]  Jiashu Zhao,et al.  Contrastive Meta Learning with Behavior Multiplicity for Recommendation , 2022, WSDM.

[3]  Weike Pan,et al.  VAE++: Variational AutoEncoder for Heterogeneous One-Class Collaborative Filtering , 2022, WSDM.

[4]  Philip S. Yu,et al.  Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation , 2021, 2021 IEEE International Conference on Data Mining (ICDM).

[5]  Chao Huang,et al.  Graph Meta Network for Multi-Behavior Recommendation , 2021, SIGIR.

[6]  Chen Gao,et al.  Sequential Recommendation with Graph Neural Networks , 2021, SIGIR.

[7]  Ruoqian Zhang,et al.  Graph neural network based model for multi-behavior session-based recommendation , 2021, GeoInformatica.

[8]  Yiqun Liu,et al.  Graph Heterogeneous Multi-Relational Recommendation , 2021, AAAI.

[9]  Jian Pei,et al.  Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendation , 2021, AAAI.

[10]  Dawei Yin,et al.  Deep Multifaceted Transformers for Multi-objective Ranking in Large-Scale E-commerce Recommender Systems , 2020, CIKM.

[11]  Zhong Ming,et al.  FISSA: Fusing Item Similarity Models with Self-Attention Networks for Sequential Recommendation , 2020, ACM Conference on Recommender Systems.

[12]  Lin Li,et al.  A Survey on Heterogeneous One-class Collaborative Filtering , 2020, ACM Trans. Inf. Syst..

[13]  David S. Rosenblum,et al.  Translation-Based Sequential Recommendation for Complex Users on Sparse Data , 2020, IEEE Transactions on Knowledge and Data Engineering.

[14]  Depeng Jin,et al.  Multi-behavior Recommendation with Graph Convolutional Networks , 2020, SIGIR.

[15]  Wei Wei,et al.  Global Context Enhanced Graph Neural Networks for Session-based Recommendation , 2020, SIGIR.

[16]  Cheng Ling,et al.  Deep Feedback Network for Recommendation , 2020, IJCAI.

[17]  Yanghua Xiao,et al.  Incorporating User Micro-behaviors and Item Knowledge into Multi-task Learning for Session-based Recommendation , 2020, SIGIR.

[18]  Liangjie Hong,et al.  Attentive Sequential Models of Latent Intent for Next Item Recommendation , 2020, WWW.

[19]  Yiqun Liu,et al.  Efficient Heterogeneous Collaborative Filtering without Negative Sampling for Recommendation , 2020, AAAI.

[20]  Hongyuan Zha,et al.  Beyond Clicks: Modeling Multi-Relational Item Graph for Session-Based Target Behavior Prediction , 2020, WWW.

[21]  Ross B. Girshick,et al.  Momentum Contrast for Unsupervised Visual Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Zi Huang,et al.  Rethinking the Item Order in Session-based Recommendation with Graph Neural Networks , 2019, CIKM.

[23]  Yanchi Liu,et al.  Graph Contextualized Self-Attention Network for Session-based Recommendation , 2019, IJCAI.

[24]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[25]  Quan Z. Sheng,et al.  A Survey on Session-based Recommender Systems , 2019, ArXiv.

[26]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[27]  Chen Gao,et al.  Neural Multi-task Recommendation from Multi-behavior Data , 2018, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[28]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[29]  Joemon M. Jose,et al.  A Simple Convolutional Generative Network for Next Item Recommendation , 2018, WSDM.

[30]  Enhong Chen,et al.  Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviors , 2018, KDD.

[31]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[32]  Jiliang Tang,et al.  Micro Behaviors: A New Perspective in E-commerce Recommender Systems , 2018, WSDM.

[33]  Jürgen Ziegler,et al.  Sequential User-based Recurrent Neural Network Recommendations , 2017, RecSys.

[34]  Julian J. McAuley,et al.  Translation-based Recommendation , 2017, RecSys.

[35]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[36]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[37]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[38]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[39]  Martha Larson,et al.  Bayesian Personalized Ranking with Multi-Channel User Feedback , 2016, RecSys.

[40]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[41]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[42]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[43]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[44]  Congfu Xu,et al.  Adaptive Bayesian personalized ranking for heterogeneous implicit feedbacks , 2015, Knowl. Based Syst..