Criterion-based Heterogeneous Collaborative Filtering for Multi-behavior Implicit Recommendation

With the increasing scale and diversification of interaction behaviors in E-commerce, more and more researchers pay attention to multi-behavior recommender systems that utilize interaction data of other auxiliary behaviors such as view and cart. Among various multi-behavior recommendation methods, non-sampling methods have shown superiority over negative sampling methods. However, two observations are usually ignored in existing state-of-the-art non-sampling methods based on binary regression: (1) users have different preference strengths for different items, so they cannot be measured simply by binary implicit data; (2) the dependency across multiple behaviors varies for different users and items. To tackle the above issue, we propose a novel non-sampling learning framework named Criterion-guided Heterogeneous Collaborative Filtering (CHCF). CHCF introduces both upper and lower bounds to indicate selection criteria, which will guide user preference learning. Besides, CHCF integrates criterion learning and user preference learning into a unified framework, which can be trained jointly for the interaction prediction on target behavior. We further theoretically demonstrate that the optimization of Collaborative Metric Learning can be approximately achieved by CHCF learning framework in a non-sampling form effectively. Extensive experiments on two real-world datasets show that CHCF outperforms the state-of-the-art methods in heterogeneous scenarios.

[1]  S. C. Hui,et al.  Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking , 2017, WWW.

[2]  Liang Tang,et al.  An Empirical Study on Recommendation with Multiple Types of Feedback , 2016, KDD.

[3]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[4]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[5]  Depeng Jin,et al.  Multi-behavior Recommendation with Graph Convolutional Networks , 2020, SIGIR.

[6]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[7]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[8]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[9]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[10]  Chang Zhou,et al.  Controllable Multi-Interest Framework for Recommendation , 2020, KDD.

[11]  Kun Gai,et al.  Learning Tree-based Deep Model for Recommender Systems , 2018, KDD.

[12]  Lina Yao,et al.  Quaternion Collaborative Filtering for Recommendation , 2019, IJCAI.

[13]  Xiangnan He,et al.  Bilinear Graph Neural Network with Neighbor Interactions , 2020, IJCAI.

[14]  M. Coates,et al.  Knowledge-Enhanced Top-K Recommendation in Poincaré Ball , 2021, AAAI.

[15]  Zheng Qin,et al.  Sampler Design for Implicit Feedback Data by Noisy-label Robust Learning , 2020, SIGIR.

[16]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[17]  Chen Gao,et al.  Learning to Recommend With Multiple Cascading Behaviors , 2018, IEEE Transactions on Knowledge and Data Engineering.

[18]  Bin Shen,et al.  Collaborative Memory Network for Recommendation Systems , 2018, SIGIR.

[19]  Jiliang Tang,et al.  Micro Behaviors: A New Perspective in E-commerce Recommender Systems , 2018, WSDM.

[20]  Yiqun Liu,et al.  An Efficient Adaptive Transfer Neural Network for Social-aware Recommendation , 2019, SIGIR.

[21]  Tat-Seng Chua,et al.  fBGD: Learning Embeddings From Positive Unlabeled Data with BGD , 2018, UAI.

[22]  Jinwen Ma,et al.  ARGO: Modeling Heterogeneity in E-commerce Recommendation , 2021, 2021 International Joint Conference on Neural Networks (IJCNN).

[23]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[24]  Jaana Kekäläinen,et al.  IR evaluation methods for retrieving highly relevant documents , 2000, SIGIR '00.

[25]  Iadh Ounis,et al.  Jointly Learning Representations of Nodes and Attributes for Attributed Networks , 2020, ACM Trans. Inf. Syst..

[26]  Liu Yiqun,et al.  Learning and Transferring Social and Item Visibilities for Personalized Recommendation , 2017, CIKM.

[27]  Xing Xie,et al.  Collaborative Translational Metric Learning , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[28]  Irwin King,et al.  STAR-GCN: Stacked and Reconstructed Graph Convolutional Networks for Recommender Systems , 2019, IJCAI.

[29]  Xing Xie,et al.  Collaborative Metric Learning with Memory Network for Multi-Relational Recommender Systems , 2019, IJCAI.

[30]  Yiqun Liu,et al.  Graph Heterogeneous Multi-Relational Recommendation , 2021, AAAI.

[31]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[32]  Joemon M. Jose,et al.  Batch IS NOT Heavy: Learning Word Representations From All Samples , 2018, ACL.

[33]  Xue Liu,et al.  Probabilistic Metric Learning with Adaptive Margin for Top-K Recommendation , 2020, KDD.

[34]  Walid Krichene,et al.  On Sampled Metrics for Item Recommendation , 2020, KDD.

[35]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[36]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[37]  Hwanjo Yu,et al.  Do "Also-Viewed" Products Help User Rating Prediction? , 2017, WWW.

[38]  Philip S. Yu,et al.  DeepCF: A Unified Framework of Representation Learning and Matching Function Learning in Recommender System , 2019, AAAI.

[39]  Chao Huang,et al.  Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network , 2020, SIGIR.

[40]  Chen Gao,et al.  Neural Multi-task Recommendation from Multi-behavior Data , 2018, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[41]  Deborah Estrin,et al.  Collaborative Metric Learning , 2017, WWW.

[42]  Xiaoyu Du,et al.  Outer Product-based Neural Collaborative Filtering , 2018, IJCAI.

[43]  Kai Liu,et al.  Deep Item-based Collaborative Filtering for Top-N Recommendation , 2018, ACM Trans. Inf. Syst..

[44]  Depeng Jin,et al.  Sampler Design for Bayesian Personalized Ranking by Leveraging View Data , 2018, IEEE Transactions on Knowledge and Data Engineering.

[45]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[46]  George Karypis,et al.  Evaluation of Item-Based Top-N Recommendation Algorithms , 2001, CIKM '01.

[47]  Wanwan Tang,et al.  Dual Channel Hypergraph Collaborative Filtering , 2020, KDD.

[48]  David M. Blei,et al.  Modeling User Exposure in Recommendation , 2015, WWW.

[49]  Xiangnan He,et al.  Disentangled Graph Collaborative Filtering , 2020, SIGIR.

[50]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[51]  Cheng Ling,et al.  Deep Feedback Network for Recommendation , 2020, IJCAI.

[52]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[53]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[54]  Huiyuan Chen,et al.  Neural Tensor Model for Learning Multi-Aspect Factors in Recommender Systems , 2020, IJCAI.

[55]  Yongdong Zhang,et al.  LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation , 2020, SIGIR.

[56]  Martha Larson,et al.  Bayesian Personalized Ranking with Multi-Channel User Feedback , 2016, RecSys.

[57]  Tat-Seng Chua,et al.  Improving Implicit Recommender Systems with View Data , 2018, IJCAI.

[58]  Yiqun Liu,et al.  Efficient Heterogeneous Collaborative Filtering without Negative Sampling for Recommendation , 2020, AAAI.

[59]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[60]  Jianling Sun,et al.  Compositional Coding for Collaborative Filtering , 2019, SIGIR.

[61]  Lars Schmidt-Thieme,et al.  Multi-relational matrix factorization using bayesian personalized ranking for social network data , 2012, WSDM '12.

[62]  Douglas W. Oard,et al.  Implicit Feedback for Recommender Systems , 1998 .

[63]  Shuai Zhang,et al.  Symmetric Metric Learning with Adaptive Margin for Recommendation , 2020, AAAI.

[64]  Hongxia Yang,et al.  Hierarchical Representation Learning for Bipartite Graphs , 2019, IJCAI.

[65]  Zhe Zhao,et al.  Improving User Topic Interest Profiles by Behavior Factorization , 2015, WWW.

[66]  Chenliang Li,et al.  An Attention-based Deep Relevance Model for Few-shot Document Filtering , 2020, ACM Trans. Inf. Syst..

[67]  Yiqun Liu,et al.  Efficient Neural Matrix Factorization without Sampling for Recommendation , 2020, ACM Trans. Inf. Syst..

[68]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[69]  Stephanie Rogers,et al.  Related Pins at Pinterest: The Evolution of a Real-World Recommender System , 2017, WWW.

[70]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[71]  Xin Li,et al.  Explainable Recommendation via Interpretable Feature Mapping and Evaluation of Explainability , 2020, IJCAI.