Rating Prediction Based on Merge-CNN and Concise Attention Review Mining

Online review websites provide an open platform for users to write reviews or give ratings on items (business services) as well as share their consumption experience. However, the volume of reviews is large, while the rating scores provide users with a quick picture of the items without reading all reviews. Recommendation systems can help users find items of interest by predicting user’s ratings on unrated items. Review contents contain more personalized preference features than simply user ratings. Therefore, it is important to consider both ratings and review contents when making rating predictions. This research proposes a novel approach that combines deep learning and review mining with attention mechanism for rating predictions. Review mining with attention mechanism is adopted to extract concise attention reviews with important words and sentences. A merge convolutional neural network (merge-CNN) model is proposed to consider both the target user’s preference features and performance features of target business for rating prediction. This method extracts quality business performance features from the quality reviews written by elite (credible) users. Moreover, the proposed method uses the concise attention reviews of target user’s neighbors to simulate target users’ reviews on unrated target business. Experiments were conducted on Yelp data sets to evaluate our proposed methods. The results show that the proposed method, i.e. considering concise attention reviews and quality reviews written by elite users, outperforms traditional methods in improving prediction accuracy. The experiment result also shows that our review simulation methods can well simulate target user’s reviews on unrated target business.

[1]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Pasquale Lops,et al.  Content-based Recommender Systems: State of the Art and Trends , 2011, Recommender Systems Handbook.

[4]  Tat-Seng Chua,et al.  Attentive Aspect Modeling for Review-Aware Recommendation , 2018, ACM Trans. Inf. Syst..

[5]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[6]  Ting Liu,et al.  Document Modeling with Gated Recurrent Neural Network for Sentiment Classification , 2015, EMNLP.

[7]  Pengpeng Zhao,et al.  Visual and Textual Jointly Enhanced Interpretable Fashion Recommendation , 2020, IEEE Access.

[8]  Jing Huang,et al.  Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction , 2017, RecSys.

[9]  Shiliang Sun,et al.  A review of natural language processing techniques for opinion mining systems , 2017, Inf. Fusion.

[10]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[11]  Nima Jafari Navimipour,et al.  Recommender systems: A systematic review of the state of the art literature and suggestions for future research , 2018, Kybernetes.

[12]  Duen-Ren Liu,et al.  Advertisement recommendation based on personal interests and ad push fairness , 2019, Kybernetes.

[13]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Zhiliang Zhu,et al.  A Dynamic Personalized News Recommendation System Based on BAP User Profiling Method , 2018, IEEE Access.

[15]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Markus Schaal,et al.  Topic Extraction from Online Reviews for Classification and Recommendation , 2013, IJCAI.

[17]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[18]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[19]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[20]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[21]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[22]  Duen-Ren Liu,et al.  Online news recommendations based on topic modeling and online interest adjustment , 2019, Ind. Manag. Data Syst..

[23]  Ye Zhang,et al.  A Sensitivity Analysis of (and Practitioners’ Guide to) Convolutional Neural Networks for Sentence Classification , 2015, IJCNLP.

[24]  Akshi Kumar,et al.  Reviewer Credibility and Sentiment Analysis Based User Profile Modelling for Online Product Recommendation , 2020, IEEE Access.

[25]  Michael R. Lyu,et al.  Ratings meet reviews, a combined approach to recommend , 2014, RecSys '14.

[26]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[27]  Ting Liu,et al.  User Modeling with Neural Network for Review Rating Prediction , 2015, IJCAI.

[28]  Mohan S. Kankanhalli,et al.  MMALFM , 2018, ACM Trans. Inf. Syst..

[29]  Amélie Marian,et al.  Beyond the Stars: Improving Rating Predictions using Review Text Content , 2009, WebDB.

[30]  Arif Ur Rahman,et al.  News Recommendation Systems - Accomplishments, Challenges & Future Directions , 2020, IEEE Access.

[31]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[32]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[33]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[34]  B. Eswara Reddy,et al.  Neighborhood Algorithm for Product Recommendation , 2019 .

[35]  Rajesh Wadhvani,et al.  A Comparative Study of Music Recommendation Systems , 2018, 2018 IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS).

[36]  Tiejian Luo,et al.  A Recommendation Model Based on Deep Neural Network , 2018, IEEE Access.