Exploiting review embedding and user attention for item recommendation

As a valuable source of user preferences and item properties, reviews have been widely leveraged in many approaches to enhance the performance of recommender systems. Although encouraging success has been obtained, there are two more weaknesses need to be addressed. (1) Most approaches represent users or items merely based on the modeling of review texts, but ignore the potential and latent preferences beyond textual information. (2) Existing methods tend to blindly merge all the previous reviews for user profiling. However, it may be less effective because different interacted items may play distinct roles. Hence, indiscriminately aligning interacted items may limit the model flexibility and performance. In this paper, with the desire to fill these gaps, we design a novel attentive deep review-based recommendation method. In specific, we complement the item representation by an auxiliary vector, based on which a user is then attentively profiled by her posted items to predict the likeness for the target item. Extensive experiments on five real-world datasets demonstrate that our model can not only significantly outperform the state-of-the-art methods, but also provide intuitive explanations to the recommendations.

[1]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[2]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[3]  Lei Zhang,et al.  Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[5]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Laizhong Cui,et al.  A novel context-aware recommendation algorithm with two-level SVD in social networks , 2017, Future Gener. Comput. Syst..

[8]  Aaron C. Courville,et al.  Learning Distributed Representations from Reviews for Collaborative Filtering , 2015, RecSys.

[9]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[10]  Daniel Thalmann,et al.  A simple but effective method to incorporate trusted neighbors in recommender systems , 2012, UMAP.

[11]  Jie Zhang,et al.  TopicMF: Simultaneously Exploiting Ratings and Reviews for Recommendation , 2014, AAAI.

[12]  Michael R. Lyu,et al.  Ratings meet reviews, a combined approach to recommend , 2014, RecSys '14.

[13]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[14]  Huiling Zhu,et al.  Combining Deep Learning and Topic Modeling for Review Understanding in Context-Aware Recommendation , 2018, NAACL-HLT.

[15]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[16]  Yongfeng Zhang,et al.  Personalized Key Frame Recommendation , 2017, SIGIR.

[17]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[18]  William W. Cohen,et al.  TransNets: Learning to Transform for Recommendation , 2017, RecSys.

[19]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[20]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[21]  Jiming Liu,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Social Collaborative Filtering by Trust , 2022 .

[22]  Laizhong Cui,et al.  A novel multi-objective evolutionary algorithm for recommendation systems , 2017, J. Parallel Distributed Comput..

[23]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[26]  Alexander J. Smola,et al.  Stacked Attention Networks for Image Question Answering , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[28]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[29]  Jing Huang,et al.  Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction , 2017, RecSys.

[30]  Donghyun Kim,et al.  Convolutional Matrix Factorization for Document Context-Aware Recommendation , 2016, RecSys.

[31]  Neil Yorke-Smith,et al.  TrustSVD: Collaborative Filtering with Both the Explicit and Implicit Influence of User Trust and of Item Ratings , 2015, AAAI.

[32]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[33]  Jiasen Lu,et al.  Hierarchical Question-Image Co-Attention for Visual Question Answering , 2016, NIPS.

[34]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[35]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Vahid Kazemi,et al.  Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering , 2017, ArXiv.

[37]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[38]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[39]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.