Aspect-Aware Latent Factor Model: Rating Prediction with Ratings and Reviews

Although latent factor models (e.g., matrix factorization) achieve good accuracy in rating prediction, they suffer from several problems including cold-start, non-transparency, and suboptimal recommendation for local users or items. In this paper, we employ textual review information with ratings to tackle these limitations. Firstly, we apply a proposed aspect-aware topic model (ATM) on the review text to model user preferences and item features from different aspects, and estimate the aspect importance of a user towards an item. The aspect importance is then integrated into a novel aspect-aware latent factor model (ALFM), which learns user's and item's latent factors based on ratings. In particular, ALFM introduces a weighted matrix to associate those latent factors with the same set of aspects discovered by ATM, such that the latent factors could be used to estimate aspect ratings. Finally, the overall rating is computed via a linear combination of the aspect ratings, which are weighted by the corresponding aspect importance. To this end, our model could alleviate the data sparsity problem and gain good interpretability for recommendation. Besides, an aspect rating is weighted by an aspect importance, which is dependent on the targeted user's preferences and targeted item's features. Therefore, it is expected that the proposed method can model a user's preferences on an item more accurately for each user-item pair locally. Comprehensive experimental studies have been conducted on 19 datasets from Amazon and Yelp 2017 Challenge dataset. Results show that our method achieves significant improvement compared with strong baseline methods, especially for users with only few ratings. Moreover, our model could interpret the recommendation results in depth.

[1]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[2]  Huanbo Luan,et al.  Discrete Collaborative Filtering , 2016, SIGIR.

[3]  Wei Zhang,et al.  Integrating Topic and Latent Factors for Scalable Personalized Review-based Rating Prediction , 2016, IEEE Transactions on Knowledge and Data Engineering.

[4]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[5]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[6]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[7]  Xu Chen,et al.  Joint Representation Learning for Top-N Recommendation with Heterogeneous Information Sources , 2017, CIKM.

[8]  Michael R. Lyu,et al.  Ratings meet reviews, a combined approach to recommend , 2014, RecSys '14.

[9]  Jialie Shen,et al.  On Effective Location-Aware Music Recommendation , 2016, ACM Trans. Inf. Syst..

[10]  Tat-Seng Chua,et al.  TEM: Tree-enhanced Embedding Model for Explainable Recommendation , 2018, WWW.

[11]  Alexander J. Smola,et al.  Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS) , 2014, KDD.

[12]  Yehuda Koren,et al.  Lessons from the Netflix prize challenge , 2007, SKDD.

[13]  Andrei Popescu-Belis,et al.  Sentiment analysis of user comments for one-class collaborative filtering over ted talks , 2013, SIGIR.

[14]  Mohan S. Kankanhalli,et al.  Exploiting Music Play Sequence for Music Recommendation , 2017, IJCAI.

[15]  Evangelia Christakopoulou,et al.  Local Item-Item Models For Top-N Recommendation , 2016, RecSys.

[16]  Tomás Horváth,et al.  Opinion-Driven Matrix Factorization for Rating Prediction , 2013, UMAP.

[17]  Jun Guo,et al.  Aspect-based latent factor model by integrating ratings and reviews for recommender system , 2016, Knowl. Based Syst..

[18]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[19]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[20]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[21]  Jie Zhang,et al.  TopicMF: Simultaneously Exploiting Ratings and Reviews for Recommendation , 2014, AAAI.

[22]  William W. Cohen,et al.  TransNets: Learning to Transform for Recommendation , 2017, RecSys.

[23]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[24]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[25]  David M. Blei,et al.  Probabilistic topic models , 2012, Commun. ACM.

[26]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[27]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[28]  Dominik Endres,et al.  A new metric for probability distributions , 2003, IEEE Transactions on Information Theory.

[29]  Sheng Wang,et al.  SUIT: A Supervised User-Item Based Topic Model for Sentiment Analysis , 2014, AAAI.

[30]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[32]  Guokun Lai,et al.  Explicit factor models for explainable recommendation based on phrase-level sentiment analysis , 2014, SIGIR.

[33]  M. Narasimha Murty,et al.  On Finding the Natural Number of Topics with Latent Dirichlet Allocation: Some Observations , 2010, PAKDD.

[34]  Yue Lu,et al.  Latent aspect rating analysis without aspect keyword supervision , 2011, KDD.

[35]  Martha Larson,et al.  Mining contextual movie similarity with matrix factorization for context-aware recommendation , 2013, TIST.

[36]  Mohan S. Kankanhalli,et al.  Exploring User-Specific Information in Music Retrieval , 2017, SIGIR.

[37]  Tat-Seng Chua,et al.  Item Silk Road: Recommending Items from Information Domains to Social Users , 2017, SIGIR.

[38]  Amélie Marian,et al.  Beyond the Stars: Improving Rating Predictions using Review Text Content , 2009, WebDB.

[39]  Wei Zhang,et al.  Collaborative Multi-Level Embedding Learning from Reviews for Rating Prediction , 2016, IJCAI.

[40]  Yue Gao,et al.  Attribute-Augmented Semantic Hierarchy: Towards a Unified Framework for Content-Based Image Retrieval , 2014, TOMM.

[41]  Martin Ester,et al.  FLAME: A Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering , 2015, WSDM.

[42]  Yiqun Liu,et al.  Rating-Boosted Latent Topics: Understanding Users and Items with Ratings and Reviews , 2016, IJCAI.

[43]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.