Neighborhood Attentional Memory Networks for Recommendation Systems

Deep learning systems have been phenomenally successful in the fields of computer vision, speech recognition, and natural language processing. Recently, researchers have adopted deep learning techniques to tackle collaborative filteringwith implicit feedback.However, the existing methods generally profile both users and items directly, while neglecting the similarities between users’ and items’ neighborhoods. To this end, we propose the neighborhood attentional memory networks (NAMN), a deep learning recommendation model applying two dedicated memory networks to capture users’ neighborhood relations and items’ neighborhood relations respectively. Specifically, we first design the user neighborhood component and the item neighborhood component based on memory networks and attentionmechanisms.+en, by the associative addressing scheme with the user and itemmemories in the neighborhood components, we capture the complex user-item neighborhood relations. Stacking multiple memory modules together yields deeper architectures exploring higher-order complex user-item neighborhood relations. Finally, the output module jointly exploits the user and itemneighborhood informationwith the user and itemmemories to obtain the ranking score. Extensive experiments on three real-world datasets demonstrate significant improvements of the proposed NAMN method over the state-of-the-art methods.

[1]  Lior Rokach,et al.  Recommender Systems Handbook , 2010 .

[2]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[3]  Wojciech Zaremba,et al.  Learning to Execute , 2014, ArXiv.

[4]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[5]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[6]  Bin Shen,et al.  Collaborative Memory Network for Recommendation Systems , 2018, SIGIR.

[7]  Bin Liu,et al.  Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction , 2019, WWW.

[8]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[9]  Chang Zhou,et al.  Deep Interest Evolution Network for Click-Through Rate Prediction , 2018, AAAI.

[10]  Hui Xiong,et al.  Joint Representation Learning for Multi-Modal Transportation Recommendation , 2019, AAAI.

[11]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[12]  Xing Xie,et al.  Adaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation , 2019, IJCAI.

[13]  Yiqun Liu,et al.  Social Attentional Memory Network: Modeling Aspect- and Friend-Level Differences in Recommendation , 2019, WSDM.

[14]  Jason Weston,et al.  Memory Networks , 2014, ICLR.

[15]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[16]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[17]  Xing Xie,et al.  Collaborative Metric Learning with Memory Network for Multi-Relational Recommender Systems , 2019, IJCAI.

[18]  Qi Zhang,et al.  Hashtag Recommendation Using Attention-Based Convolutional Neural Network , 2016, IJCAI.

[19]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[20]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[21]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[22]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[23]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[24]  Huanbo Luan,et al.  Discrete Collaborative Filtering , 2016, SIGIR.

[25]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[26]  Xuanjing Huang,et al.  Mention Recommendation for Twitter with End-to-end Memory Network , 2017, IJCAI.

[27]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[28]  Alexandros Karatzoglou,et al.  Deep Learning for Recommender Systems , 2017, RecSys.

[29]  Xiangnan He,et al.  CFM: Convolutional Factorization Machines for Context-Aware Recommendation , 2019, IJCAI.

[30]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[31]  Lina Yao,et al.  AutoSVD++: An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders , 2017, SIGIR.