Joint Knowledge Pruning and Recurrent Graph Convolution for News Recommendation

Recently, exploiting a knowledge graph (KG) to enrich the semantic representation of a news article have been proven to be effective for news recommendation. These solutions focus on the representation learning for news articles with additional information in the knowledge graph, where the user representations are mainly derived based on these news representations later. However, different users would hold different interests on the same news article. In other words, directly identifying the entities relevant to the user's interest and deriving the resultant user representation could enable a better news recommendation and explanation. To this end, in this paper, we propose a novel knowledge pruning based recurrent graph convolutional network (named Kopra) for news recommendation. Instead of extracting relevant entities for a news article from KG, Kopra is devised to identify the relevant entities from both a user's clicked history and a KG to derive the user representation. We firstly form an initial entity graph (namely interest graph) with seed entities extracted from news titles and abstracts. Then, a joint knowledge pruning and recurrent graph convolution (RGC) mechanism is introduced to augment each seed entity with relevant entities from KG in a recurrent manner. That is, the entities in the neighborhood of each seed entity inside KG but irrelevant to the user's interest are pruned from the augmentation. With this pruning and graph convolution process in a recurrent manner, we can derive the user's both long- and short-term representations based on her click history within a long and short time period respectively. At last, we introduce a max-pooling predictor over the long- and short-term user representations and the seed entities in the candidate news to calculate the ranking score for recommendation. The experimental results over two real-world datasets in two different languages suggest that the proposed Kopra obtains significantly better performance than a series of state-of-the-art technical alternatives. Moreover, the entity graph generated by Kopra can facilitate recommendation explanation much easier.

[1]  Jon Atle Gulla,et al.  The Adressa dataset for news recommendation , 2017, WI.

[2]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[3]  Xing Xie,et al.  NPA: Neural News Recommendation with Personalized Attention , 2019, KDD.

[4]  Miaomiao Li,et al.  A Survey on Personalized News Recommendation Technology , 2019, IEEE Access.

[5]  Yixin Cao,et al.  Explainable Reasoning over Knowledge Graphs for Recommendation , 2018, AAAI.

[6]  Xing Xie,et al.  Towards Better Representation Learning for Personalized News Recommendation: a Multi-Channel Deep Fusion Approach , 2018, IJCAI.

[7]  Alexander J. Smola,et al.  Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS) , 2014, KDD.

[8]  Dik Lun Lee,et al.  Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba , 2018, KDD.

[9]  Xiangyang Luo,et al.  A Review-Driven Neural Model for Sequential Recommendation , 2019, IJCAI.

[10]  Niloy Ganguly,et al.  MVL: Multi-View Learning for News Recommendation , 2020, SIGIR.

[11]  Yukihiro Tagami,et al.  Embedding-based News Recommendation for Millions of Users , 2017, KDD.

[12]  Xing Xie,et al.  KRED: Knowledge-Aware Document Representation for News Recommendations , 2019, RecSys.

[13]  Jure Leskovec,et al.  Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems , 2019, KDD.

[14]  Alessandro Bozzon,et al.  Recurrent knowledge graph embedding for effective recommendation , 2018, RecSys.

[15]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[16]  Xing Xie,et al.  Neural News Recommendation with Long- and Short-term User Representations , 2019, ACL.

[17]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[18]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[19]  Tao Qi,et al.  User Modeling with Click Preference and Reading Satisfaction for News Recommendation , 2020, IJCAI.

[20]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[21]  Jisoo Lee,et al.  Deep Neural Networks for News Recommendations , 2017, CIKM.

[22]  Xing Xie,et al.  MIND: A Large-scale Dataset for News Recommendation , 2020, ACL.

[23]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[24]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[25]  Xing Xie,et al.  News Graph: An Enhanced Knowledge Graph for News Recommendation , 2019, KaRS@CIKM.

[26]  Suyu Ge,et al.  Neural News Recommendation with Multi-Head Self-Attention , 2019, EMNLP.

[27]  Dik Lun Lee,et al.  Meta-Graph Based Recommendation Fusion over Heterogeneous Information Networks , 2017, KDD.

[28]  Xing Xie,et al.  Neural News Recommendation with Attentive Multi-View Learning , 2019, IJCAI.

[29]  Dietmar Jannach,et al.  News recommender systems - Survey and roads ahead , 2018, Inf. Process. Manag..