Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation

Social relations are often used to improve recommendation quality when user-item interaction data is sparse in recommender systems. Most existing social recommendation models exploit pairwise relations to mine potential user preferences. However, real-life interactions among users are very complicated and user relations can be high-order. Hypergraph provides a natural way to model complex high-order relations, while its potentials for improving social recommendation are under-explored. In this paper, we fill this gap and propose a multi-channel hypergraph convolutional network to enhance social recommendation by leveraging high-order user relations. Technically, each channel in the network encodes a hypergraph that depicts a common high-order user relation pattern via hypergraph convolution. By aggregating the embeddings learned through multiple channels, we obtain comprehensive user representations to generate recommendation results. However, the aggregation operation might also obscure the inherent characteristics of different types of high-order connectivity information. To compensate for the aggregating loss, we innovatively integrate self-supervised learning into the training of the hypergraph convolutional network to regain the connectivity information with hierarchical mutual information maximization. The experimental results on multiple real-world datasets show that the proposed model outperforms the SOTA methods, and the ablation study verifies the effectiveness of the multi-channel setting and the selfsupervised task. The implementation of our model is available via https://github.com/Coder-Yu/RecQ.

[1]  Ji-Rong Wen,et al.  S3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization , 2020, CIKM.

[2]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[3]  Oriol Vinyals,et al.  Representation Learning with Contrastive Predictive Coding , 2018, ArXiv.

[4]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[5]  Le Wu,et al.  A Neural Influence Diffusion Model for Social Recommendation , 2019, SIGIR.

[6]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[7]  Michael R. Lyu,et al.  Learning to recommend with social trust ensemble , 2009, SIGIR.

[8]  Ji Zhang,et al.  A novel social network hybrid recommender system based on hypergraph topologic structure , 2018, World Wide Web.

[9]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[10]  Yongdong Zhang,et al.  LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation , 2020, SIGIR.

[11]  Alexander Kolesnikov,et al.  S4L: Self-Supervised Semi-Supervised Learning , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Zhangyang Wang,et al.  Graph Contrastive Learning with Augmentations , 2020, NeurIPS.

[13]  Yue Gao,et al.  Hypergraph Neural Networks , 2018, AAAI.

[14]  Minnan Luo,et al.  Graph Representation Learning via Graphical Mutual Information Maximization , 2020, WWW.

[15]  Kai Zheng,et al.  Social Influence-Based Group Representation Learning for Group Recommendation , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[16]  Shazia Wasim Sadiq,et al.  Discovering interpretable geo-social communities for user behavior prediction , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[17]  Hongzhi Yin,et al.  Streaming Session-based Recommendation , 2019, KDD.

[18]  Hao Wang,et al.  Adapting to User Interest Drift for POI Recommendation , 2016, IEEE Transactions on Knowledge and Data Engineering.

[19]  Chun Chen,et al.  Music recommendation by unified hypergraph: combining social media information and music content , 2010, ACM Multimedia.

[20]  Jiming Liu,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Social Collaborative Filtering by Trust , 2022 .

[21]  Zhanxing Zhu,et al.  Multi-Stage Self-Supervised Learning for Graph Convolutional Networks , 2020, AAAI.

[22]  Zi Huang,et al.  Enhancing Social Recommendation With Adversarial Graph Convolutional Networks , 2020, IEEE Transactions on Knowledge and Data Engineering.

[23]  David A. McAllester,et al.  Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence , 2009, UAI 2009.

[24]  Tong Zhao,et al.  Leveraging Social Connections to Improve Personalized Ranking for Collaborative Filtering , 2014, CIKM.

[25]  Noah J. Goldstein,et al.  Social influence: compliance and conformity. , 2004, Annual review of psychology.

[26]  Iadh Ounis,et al.  A Heterogeneous Graph Neural Model for Cold-start Recommendation , 2020, SIGIR.

[27]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[28]  Meng Wang,et al.  Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach , 2020, AAAI.

[29]  Min Gao,et al.  Generating Reliable Friends via Adversarial Training to Improve Social Recommendation , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[30]  James Caverlee,et al.  Next-item Recommendation with Sequential Hypergraphs , 2020, SIGIR.

[31]  Zhao Chen,et al.  Ranking Users in Social Networks With Higher-Order Structures , 2018, AAAI.

[32]  Guihai Chen,et al.  Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systems , 2019, WWW.

[33]  Xiangliang Zhang,et al.  Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendation , 2020, AAAI.

[34]  Jian Tang,et al.  Session-Based Social Recommendation via Dynamic Graph Attention Networks , 2019, WSDM.

[35]  Yuxiao Dong,et al.  GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training , 2020, KDD.

[36]  Michael R. Lyu,et al.  Learning to recommend with trust and distrust relationships , 2009, RecSys '09.

[37]  Yann Dauphin,et al.  Language Modeling with Gated Convolutional Networks , 2016, ICML.

[38]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Hongzhi Yin,et al.  Overcoming Data Sparsity in Group Recommendation , 2020, IEEE Transactions on Knowledge and Data Engineering.

[40]  Zhihua Wei,et al.  Mixed Pooling for Convolutional Neural Networks , 2014, RSKT.

[41]  Jure Leskovec,et al.  Higher-order organization of complex networks , 2016, Science.

[42]  John Riedl,et al.  Sparsity, scalability, and distribution in recommender systems , 2001 .

[43]  Suhang Wang,et al.  Self-supervised Learning on Graphs: Deep Insights and New Direction , 2020, ArXiv.

[44]  H. Sundaram,et al.  Beyond Localized Graph Neural Networks: An Attributed Motif Regularization Framework , 2020, 2020 IEEE International Conference on Data Mining (ICDM).

[45]  Yoshua Bengio,et al.  Learning deep representations by mutual information estimation and maximization , 2018, ICLR.

[46]  Neil Yorke-Smith,et al.  TrustSVD: Collaborative Filtering with Both the Explicit and Implicit Influence of User Trust and of Item Ratings , 2015, AAAI.

[47]  Zi Huang,et al.  Joint Event-Partner Recommendation in Event-Based Social Networks , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[48]  Huan Liu,et al.  Adaptive Implicit Friends Identification over Heterogeneous Network for Social Recommendation , 2018, CIKM.

[49]  Wei Zhang,et al.  GroupIM: A Mutual Information Maximization Framework for Neural Group Recommendation , 2020, SIGIR.

[50]  Richang Hong,et al.  DiffNet++: A Neural Influence and Interest Diffusion Network for Social Recommendation , 2020, ArXiv.

[51]  Song Bai,et al.  Hypergraph Convolution and Hypergraph Attention , 2019, Pattern Recognit..

[52]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[53]  Chang Zhou,et al.  Disentangled Self-Supervision in Sequential Recommenders , 2020, KDD.

[54]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[55]  Wanwan Tang,et al.  Dual Channel Hypergraph Collaborative Filtering , 2020, KDD.

[56]  Junhao Wen,et al.  Recommender Systems Based on Generative Adversarial Networks: A Problem-Driven Perspective , 2020, Inf. Sci..

[57]  Yuan He,et al.  Graph Neural Networks for Social Recommendation , 2019, WWW.

[58]  Alain Bretto,et al.  Hypergraph Theory: An Introduction , 2013 .

[59]  Philippe Cudré-Mauroux,et al.  Revisiting User Mobility and Social Relationships in LBSNs: A Hypergraph Embedding Approach , 2019, WWW.

[60]  R Devon Hjelm,et al.  Learning Representations by Maximizing Mutual Information Across Views , 2019, NeurIPS.

[61]  Michael R. Lyu,et al.  SoRec: social recommendation using probabilistic matrix factorization , 2008, CIKM '08.

[62]  Junping Du,et al.  Modeling the Evolution of Users’ Preferences and Social Links in Social Networking Services , 2017, IEEE Transactions on Knowledge and Data Engineering.

[63]  Junhao Wen,et al.  Hybrid attacks on model-based social recommender systems , 2017 .

[64]  Konstantinos G. Derpanis,et al.  RankMI: A Mutual Information Maximizing Ranking Loss , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).