Recommendation system exploiting aspect-based opinion mining with deep learning method

Abstract With the developments of e-commerce websites, user textual review has become an important source of information for improving the performance of recommendation systems, as they contain fine-grained users’ opinions that generally reflect their preference towards products. However, most of the classical recommender systems (RSs) often ignore such user opinions and therefore fail to precisely capture users’ specific sentiments on products. Although a few of the approaches have attempted to utilize fine-grained users’ opinions for enhancing the accuracy of recommendation systems to some extent, most of these methods basically rely on handcrafted and rule-based approaches that are generally known to be time-consuming and labour-intensive. As such, their application is limited in practice. Thus, to overcome the above problems, this paper proposes a recommendation system that utilizes aspect-based opinion mining (ABOM) based on the deep learning technique to improve the accuracy of the recommendation process. The proposed model consists of two parts: ABOM and rating prediction. In the first part, we use a multichannel deep convolutional neural network (MCNN) to better extract aspects and generate aspect-specific ratings by computing users’ sentiment polarities on various aspects. In the second part, we integrate the aspect-specific ratings into a tensor factorization (TF) machine for the overall rating prediction. Experimental results using various datasets show that our proposed model achieves significant improvements compared with the baseline methods.

[1]  D. V. Nagarjuna Devi,et al.  A Feature Based Approach for Sentiment Analysis by Using Support Vector Machine , 2016, 2016 IEEE 6th International Conference on Advanced Computing (IACC).

[2]  Wei Zhang,et al.  Integrating Topic and Latent Factors for Scalable Personalized Review-based Rating Prediction , 2016, IEEE Transactions on Knowledge and Data Engineering.

[3]  Erik Cambria,et al.  Aspect extraction for opinion mining with a deep convolutional neural network , 2016, Knowl. Based Syst..

[4]  Xueming Qian,et al.  Rating prediction by exploring user’s preference and sentiment , 2018, Multimedia Tools and Applications.

[5]  Philip S. Yu,et al.  Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction , 2018, ACL.

[6]  Daniel M. Dunlavy,et al.  An Optimization Approach for Fitting Canonical Tensor Decompositions. , 2009 .

[7]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[8]  Yiqun Liu,et al.  Rating-Boosted Latent Topics: Understanding Users and Items with Ratings and Reviews , 2016, IJCAI.

[9]  Zhipeng Luo,et al.  Conditional Random Fields , 2014 .

[10]  Alexandros Karatzoglou,et al.  Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations , 2016, RecSys.

[11]  Naomie Salim,et al.  Aspect extraction on user textual reviews using multi-channel convolutional neural network , 2019, PeerJ Comput. Sci..

[12]  Li Chen,et al.  Review mining for estimating users' ratings and weights for product aspects , 2015, Web Intell..

[13]  Naomie Salim,et al.  Sentiment-Aware Deep Recommender System With Neural Attention Networks , 2019, IEEE Access.

[14]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations for Incomplete Data , 2010, ArXiv.

[15]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[16]  Philipp Cimiano,et al.  Aspect-Based Relational Sentiment Analysis Using a Stacked Neural Network Architecture , 2017, ECAI.

[17]  Yue Lu,et al.  Latent aspect rating analysis without aspect keyword supervision , 2011, KDD.

[18]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[19]  Claire Cardie,et al.  Opinion Mining with Deep Recurrent Neural Networks , 2014, EMNLP.

[20]  Yue Lu,et al.  Latent aspect rating analysis on review text data: a rating regression approach , 2010, KDD.

[21]  Regina Barzilay,et al.  Multiple Aspect Ranking Using the Good Grief Algorithm , 2007, NAACL.

[22]  Geoffrey Zweig,et al.  Linguistic Regularities in Continuous Space Word Representations , 2013, NAACL.

[23]  Ivan Titov,et al.  A Joint Model of Text and Aspect Ratings for Sentiment Summarization , 2008, ACL.

[24]  Shafiq R. Joty,et al.  Fine-grained Opinion Mining with Recurrent Neural Networks and Word Embeddings , 2015, EMNLP.

[25]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[26]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[27]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[28]  Michael R. Lyu,et al.  Ratings meet reviews, a combined approach to recommend , 2014, RecSys '14.

[29]  Guokun Lai,et al.  Explicit factor models for explainable recommendation based on phrase-level sentiment analysis , 2014, SIGIR.

[30]  Lei Shu,et al.  Lifelong Learning CRF for Supervised Aspect Extraction , 2017, ACL.

[31]  Yehuda Koren,et al.  Scalable Collaborative Filtering with Jointly Derived Neighborhood Interpolation Weights , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[32]  Hyeoncheol Kim,et al.  Multi-Channel Lexicon Integrated CNN-BiLSTM Models for Sentiment Analysis , 2017, ROCLING/IJCLCLP.

[33]  Zhiqiang Toh,et al.  DLIREC: Aspect Term Extraction and Term Polarity Classification System , 2014, *SEMEVAL.

[34]  Hao Wang,et al.  A Sentiment-aligned Topic Model for Product Aspect Rating Prediction , 2014, EMNLP.

[35]  Chun Chen,et al.  Opinion Word Expansion and Target Extraction through Double Propagation , 2011, CL.

[36]  Alexander J. Smola,et al.  Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS) , 2014, KDD.

[37]  William W. Cohen,et al.  TransNets: Learning to Transform for Recommendation , 2017, RecSys.

[38]  Xiaohui Yu,et al.  Collaborative filtering with weighted opinion aspects , 2016, Neurocomputing.