NPA: Neural News Recommendation with Personalized Attention

News recommendation is very important to help users find interested news and alleviate information overload. Different users usually have different interests and the same user may have various interests. Thus, different users may click the same news article with attention on different aspects. In this paper, we propose a neural news recommendation model with personalized attention (NPA). The core of our approach is a news representation model and a user representation model. In the news representation model we use a CNN network to learn hidden representations of news articles based on their titles. In the user representation model we learn the representations of users based on the representations of their clicked news articles. Since different words and different news articles may have different informativeness for representing news and users, we propose to apply both word- and news-level attention mechanism to help our model attend to important words and news articles. In addition, the same news article and the same word may have different informativeness for different users. Thus, we propose a personalized attention network which exploits the embedding of user ID to generate the query vector for the word- and news-level attentions. Extensive experiments are conducted on a real-world news recommendation dataset collected from MSN news, and the results validate the effectiveness of our approach on news recommendation.

[1]  Xing Xie,et al.  Towards Better Representation Learning for Personalized News Recommendation: a Multi-Channel Deep Fusion Approach , 2018, IJCAI.

[2]  Abhinandan Das,et al.  Google news personalization: scalable online collaborative filtering , 2007, WWW '07.

[3]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Yukihiro Tagami,et al.  Embedding-based News Recommendation for Millions of Users , 2017, KDD.

[6]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[7]  Seong-Bae Park,et al.  A location-based news article recommendation with explicit localized semantic analysis , 2013, SIGIR.

[8]  Xing Xie,et al.  Neural News Recommendation with Attentive Multi-View Learning , 2019, IJCAI.

[9]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[10]  Larry P. Heck,et al.  Learning deep structured semantic models for web search using clickthrough data , 2013, CIKM.

[11]  Flavius Frasincar,et al.  Semantics-based news recommendation , 2012, WIMS '12.

[12]  Xing Xie,et al.  Neural News Recommendation with Long- and Short-term User Representations , 2019, ACL.

[13]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[14]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[15]  Chuhan Wu,et al.  Neural Demographic Prediction using Search Query , 2019, WSDM.

[16]  Lantao Yu,et al.  Dynamic Attention Deep Model for Article Recommendation by Learning Human Editors' Demonstration , 2017, KDD.

[17]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[18]  Zhongfei Zhang,et al.  DeepIntent: Learning Attentions for Online Advertising with Recurrent Neural Networks , 2016, KDD.

[19]  Barry Smyth,et al.  Using twitter to recommend real-time topical news , 2009, RecSys '09.

[20]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[21]  Barry Smyth,et al.  Terms of a Feather: Content-Based News Recommendation and Discovery Using Twitter , 2011, ECIR.

[22]  Flavius Frasincar,et al.  Ontology-based news recommendation , 2010, EDBT '10.

[23]  Yiqun Liu,et al.  Neural Attentional Rating Regression with Review-level Explanations , 2018, WWW.

[24]  Aristides Gionis,et al.  From chatter to headlines: harnessing the real-time web for personalized news recommendation , 2012, WSDM '12.

[25]  Xing Xie,et al.  Content-Based Collaborative Filtering for News Topic Recommendation , 2015, AAAI.

[26]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[27]  Bradley N. Miller,et al.  GroupLens: applying collaborative filtering to Usenet news , 1997, CACM.

[28]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[29]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[30]  Xing Xie,et al.  Neural News Recommendation with Topic-Aware News Representation , 2019, ACL.

[31]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[32]  Chiranjib Bhattacharyya,et al.  Content Driven User Profiling for Comment-Worthy Recommendations of News and Blog Articles , 2015, RecSys.

[33]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[34]  Nicholas Jing Yuan,et al.  DRN: A Deep Reinforcement Learning Framework for News Recommendation , 2018, WWW.

[35]  Jiahui Liu,et al.  Personalized news recommendation based on click behavior , 2010, IUI '10.

[36]  Zhaohui Zheng,et al.  Learning to model relatedness for news recommendation , 2011, WWW.

[37]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[38]  Balaji Padmanabhan,et al.  SCENE: a scalable two-stage personalized news recommendation system , 2011, SIGIR.

[39]  Joachim Meyer,et al.  User attitudes towards news content personalization , 2010, Int. J. Hum. Comput. Stud..

[40]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.