XDM: Improving Sequential Deep Matching with Unclicked User Behaviors for Recommender System

Deep learning-based sequential recommender systems have recently attracted increasing attention from both academia and industry. Among them, how to comprehensively capture sequential user interest is a fundamental problem. However, most existing sequential recommendation models take as input clicked or purchased behavior sequences from user-item interactions. This leads to incomprehensive user representation and sub-optimal model performance, since they ignore the complete user behavior exposure data, i.e., impressed yet unclicked items. In this work, we attempt to incorporate and model those unclicked item sequences using a new learning approach in order to explore better sequential recommendation technique. An efficient triplet metric learning algorithm is proposed to appropriately learn the representation of unclicked items. Our method can be simply integrated with existing sequential recommendation models by a confidence fusion network and further gain better user representation. We name our algorithm SRU2B (short for Sequential Recommendation with Unclicked User Behaviors). The experimental results based on real-world E-commerce data demonstrate the effectiveness of SRU2B and verify the importance of unclicked items in sequential recommendation.

[1]  Nir Ailon,et al.  Deep Metric Learning Using Triplet Network , 2014, SIMBAD.

[2]  Min Yang,et al.  PLASTIC: Prioritize Long and Short-term Information in Top-n Recommendation using Adversarial Training , 2018, IJCAI.

[3]  Thorsten Joachims,et al.  Playlist prediction via metric embedding , 2012, KDD.

[4]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[5]  Chen Gao,et al.  Learning to Recommend With Multiple Cascading Behaviors , 2018, IEEE Transactions on Knowledge and Data Engineering.

[6]  Yoshua Bengio,et al.  On Using Very Large Target Vocabulary for Neural Machine Translation , 2014, ACL.

[7]  Laurens van der Maaten,et al.  Accelerating t-SNE using tree-based algorithms , 2014, J. Mach. Learn. Res..

[8]  Yifeng Zeng,et al.  Personalized Ranking Metric Embedding for Next New POI Recommendation , 2015, IJCAI.

[9]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[10]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[11]  Depeng Jin,et al.  Reinforced Negative Sampling for Recommendation with Exposure Data , 2019, IJCAI.

[12]  Guorui Zhou,et al.  Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction , 2019, KDD.

[13]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[14]  Li Li,et al.  Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction , 2019, KDD.

[15]  S. C. Hui,et al.  Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking , 2017, WWW.

[16]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[17]  Hui Xiong,et al.  Sequential Recommender System based on Hierarchical Attention Networks , 2018, IJCAI.

[18]  Xiaohua Liu,et al.  Dynamic Item Block and Prediction Enhancing Block for Sequential Recommendation , 2019, IJCAI.

[19]  Cheng Ling,et al.  Deep Feedback Network for Recommendation , 2020, IJCAI.

[20]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[21]  Kun Zhang,et al.  Modeling Dynamic Missingness of Implicit Feedback for Recommendation , 2018, NeurIPS.

[22]  Rong Jin,et al.  Fine-grained visual categorization via multi-stage metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[24]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[25]  Silvio Savarese,et al.  Deep Metric Learning via Lifted Structured Feature Embedding , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[27]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Yanchi Liu,et al.  Graph Contextualized Self-Attention Network for Session-based Recommendation , 2019, IJCAI.

[29]  Ji-Rong Wen,et al.  CTRec: A Long-Short Demands Evolution Model for Continuous-Time Recommendation , 2019, SIGIR.

[30]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[31]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[32]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[33]  Kyumin Lee,et al.  Adversarial Mahalanobis Distance-based Attentive Song Recommender for Automatic Playlist Continuation , 2019, SIGIR.

[34]  Ed H. Chi,et al.  Towards Neural Mixture Recommender for Long Range Dependent User Sequences , 2019, WWW.

[35]  Xing Xie,et al.  Collaborative Metric Learning with Memory Network for Multi-Relational Recommender Systems , 2019, IJCAI.

[36]  Deborah Estrin,et al.  Collaborative Metric Learning , 2017, WWW.

[37]  Wilfred Ng,et al.  SDM: Sequential Deep Matching Model for Online Large-scale Recommender System , 2019, CIKM.

[38]  Jure Leskovec,et al.  Hierarchical Temporal Convolutional Networks for Dynamic Recommender Systems , 2019, WWW.

[39]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[40]  Dongha Lee,et al.  Action Space Learning for Heterogeneous User Behavior Prediction , 2019, IJCAI.

[41]  Wei Li,et al.  Multi-Interest Network with Dynamic Routing for Recommendation at Tmall , 2019, CIKM.

[42]  Enhong Chen,et al.  Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviors , 2018, KDD.

[43]  Ji-Rong Wen,et al.  Taxonomy-Aware Multi-Hop Reasoning Networks for Sequential Recommendation , 2019, WSDM.

[44]  Chen Ma,et al.  Hierarchical Gating Networks for Sequential Recommendation , 2019, KDD.

[45]  Xing Xie,et al.  Adaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation , 2019, IJCAI.

[46]  Zaiqiao Meng,et al.  Hierarchical Neural Variational Model for Personalized Sequential Recommendation , 2019, WWW.

[47]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[48]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[49]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[50]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[51]  Julian J. McAuley,et al.  Translation-based Recommendation , 2017, RecSys.

[52]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[53]  Liang Zhang,et al.  Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning , 2018, KDD.