Dual Learning for Explainable Recommendation: Towards Unifying User Preference Prediction and Review Generation

In many recommender systems, users express item opinions through two kinds of behaviors: giving preferences and writing detailed reviews. As both kinds of behaviors reflect users’ assessment of items, review enhanced recommender systems leverage these two kinds of user behaviors to boost recommendation performance. On the one hand, researchers proposed to better model the user and item embeddings with additional review information for enhancing preference prediction accuracy. On the other hand, some recent works focused on automatically generating item reviews for recommendation explanations with related user and item embeddings. We argue that, while the task of preference prediction with the accuracy goal is well recognized in the community, the task of generating reviews for explainable recommendation is also important to gain user trust and increase conversion rate. Some preliminary attempts have considered jointly modeling these two tasks, with the user and item embeddings are shared. These studies empirically showed that these two tasks are correlated, and jointly modeling them would benefit the performance of both tasks. In this paper, we make a further study of unifying these two tasks for explainable recommendation. Instead of simply correlating these two tasks with shared user and item embeddings, we argue that these two tasks are presented in dual forms. In other words, the input of the primal preference prediction task is exactly the output of the dual review generation task , with and denote the preference value space and review space. Therefore, we could explicitly model the probabilistic correlation between these two dual tasks with . We design a unified dual framework of how to inject the probabilistic duality of the two tasks in the training stage. Furthermore, as the detailed preference and review information are not available for each user-item pair in the test stage, we propose a transfer learning based model for preference prediction and review generation. Finally, extensive experimental results on two real-world datasets clearly show the effectiveness of our proposed model for both user preference prediction and review generation.

[1]  Michael R. Lyu,et al.  Ratings meet reviews, a combined approach to recommend , 2014, RecSys '14.

[2]  Yan Liu,et al.  Representation Learning of Users and Items for Review Rating Prediction Using Attention-based Convolutional Neural Network , 2017 .

[3]  Le Wu,et al.  A Neural Influence Diffusion Model for Social Recommendation , 2019, SIGIR.

[4]  Le Wu,et al.  Multilevel Image-Enhanced Sentence Representation Net for Natural Language Inference , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[6]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[7]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[8]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[9]  Le Wu,et al.  A Hierarchical Attention Model for Social Contextual Image Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[10]  Julian J. McAuley,et al.  Addressing Complex and Subjective Product-Related Queries with Customer Reviews , 2015, WWW.

[11]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[12]  Barry Smyth,et al.  Coevolutionary Recommendation Model: Mutual Learning between Ratings and Reviews , 2018, WWW.

[13]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[14]  Barry Smyth,et al.  Why I like it: multi-task learning for recommendation and explanation , 2018, RecSys.

[15]  Joelle Pineau,et al.  Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models , 2015, AAAI.

[16]  Guokun Lai,et al.  Explicit factor models for explainable recommendation based on phrase-level sentiment analysis , 2014, SIGIR.

[17]  Aaron C. Courville,et al.  Learning Distributed Representations from Reviews for Collaborative Filtering , 2015, RecSys.

[18]  Xuanjing Huang,et al.  Review Response Generation in E-Commerce Platforms with External Product Information , 2019, WWW.

[19]  Jure Leskovec,et al.  Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems , 2019, KDD.

[20]  Junping Du,et al.  Modeling the Evolution of Users’ Preferences and Social Links in Social Networking Services , 2017, IEEE Transactions on Knowledge and Data Engineering.

[21]  Le Wu,et al.  Modeling Users' Preferences and Social Links in Social Networking Services: A Joint-Evolving Perspective , 2016, AAAI.

[22]  Xing Xie,et al.  Co-Attentive Multi-Task Learning for Explainable Recommendation , 2019, IJCAI.

[23]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[24]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[25]  Zhaochun Ren,et al.  Explainable Outfit Recommendation with Joint Outfit Matching and Comment Generation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[26]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[27]  Piji Li,et al.  Neural Rating Regression with Abstractive Tips Generation for Recommendation , 2017, SIGIR.

[28]  Nenghai Yu,et al.  Dual Supervised Learning , 2017, ICML.

[29]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[30]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[31]  Yiqun Liu,et al.  Social Attentional Memory Network: Modeling Aspect- and Friend-Level Differences in Recommendation , 2019, WSDM.

[32]  Tao Zhang,et al.  Automatic Generation of Pattern-controlled Product Description in E-commerce , 2019, WWW.

[33]  Tie-Yan Liu,et al.  Dual Learning for Machine Translation , 2016, NIPS.

[34]  Quoc-Tuan Truong,et al.  Multimodal Review Generation for Recommender Systems , 2019, WWW.

[35]  Yongfeng Zhang,et al.  Personalized Fashion Recommendation with Visual Explanations based on Multimodal Attention Network: Towards Visually Explainable Recommendation , 2019, SIGIR.

[36]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[37]  Yiqun Liu,et al.  Neural Attentional Rating Regression with Review-level Explanations , 2018, WWW.

[38]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[39]  William W. Cohen,et al.  TransNets: Learning to Transform for Recommendation , 2017, RecSys.

[40]  Piji Li,et al.  Persona-Aware Tips Generation? , 2019, WWW.

[41]  Xiaojun Wan,et al.  Towards Automatic Generation of Product Reviews from Aspect-Sentiment Scores , 2017, INLG.

[42]  Xing Xie,et al.  A Reinforcement Learning Framework for Explainable Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[43]  Mengting Wan,et al.  Modeling Ambiguity, Subjectivity, and Diverging Viewpoints in Opinion Question Answering Systems , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[44]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[45]  Jing Huang,et al.  Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction , 2017, RecSys.

[46]  Mirella Lapata,et al.  Learning to Generate Product Reviews from Attributes , 2017, EACL.

[47]  Hermann Ney,et al.  LSTM Neural Networks for Language Modeling , 2012, INTERSPEECH.