Graph Neural News Recommendation with Unsupervised Preference Disentanglement

With the explosion of news information, personalized news recommendation has become very important for users to quickly find their interested contents. Most existing methods usually learn the representations of users and news from news contents for recommendation. However, they seldom consider high-order connectivity underlying the user-news interactions. Moreover, existing methods failed to disentangle a user’s latent preference factors which cause her clicks on different news. In this paper, we model the user-news interactions as a bipartite graph and propose a novel Graph Neural News Recommendation model with Unsupervised Preference Disentanglement, named GNUD. Our model can encode high-order relationships into user and news representations by information propagation along the graph. Furthermore, the learned representations are disentangled with latent preference factors by a neighborhood routing algorithm, which can enhance expressiveness and interpretability. A preference regularizer is also designed to force each disentangled subspace to independently reflect an isolated preference, improving the quality of the disentangled representations. Experimental results on real-world news datasets demonstrate that our proposed model can effectively improve the performance of news recommendation and outperform state-of-the-art news recommendation methods.

[1]  Xing Xie,et al.  Neural News Recommendation with Attentive Multi-View Learning , 2019, IJCAI.

[2]  Suyu Ge,et al.  Neural News Recommendation with Multi-Head Self-Attention , 2019, EMNLP.

[3]  Juan Carlos Niebles,et al.  Learning to Decompose and Disentangle Representations for Video Prediction , 2018, NeurIPS.

[4]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[6]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[7]  Xiaofei Zhou,et al.  DAN: Deep Attention Neural Network for News Recommendation , 2019, AAAI.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Linmei Hu,et al.  Graph Neural News Recommendation with Long-term and Short-term Interest Modeling , 2020, Inf. Process. Manag..

[10]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[11]  Nikos Komodakis,et al.  Unsupervised Representation Learning by Predicting Image Rotations , 2018, ICLR.

[12]  Christopher Burgess,et al.  beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework , 2016, ICLR 2016.

[13]  Maosong Sun,et al.  Stylistic Chinese Poetry Generation via Unsupervised Style Disentanglement , 2018, EMNLP.

[14]  Larry P. Heck,et al.  Learning deep structured semantic models for web search using clickthrough data , 2013, CIKM.

[15]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[16]  Xing Xie,et al.  Neural News Recommendation with Long- and Short-term User Representations , 2019, ACL.

[17]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[18]  Jon Atle Gulla,et al.  The Adressa dataset for news recommendation , 2017, WI.

[19]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[20]  Wenwu Zhu,et al.  Disentangled Graph Convolutional Networks , 2019, ICML.

[21]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[22]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[23]  Xing Xie,et al.  NPA: Neural News Recommendation with Personalized Attention , 2019, KDD.

[24]  Yukihiro Tagami,et al.  Embedding-based News Recommendation for Millions of Users , 2017, KDD.

[25]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[26]  Flavius Frasincar,et al.  Ontology-based news recommendation , 2010, EDBT '10.

[27]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[28]  Andriy Mnih,et al.  Disentangling by Factorising , 2018, ICML.

[29]  Jiahui Liu,et al.  Personalized news recommendation based on click behavior , 2010, IUI '10.

[30]  Hongxia Yang,et al.  Learning Disentangled Representations for Recommendation , 2019, NeurIPS.