Deep Learning-Based Approach to Classify Praises or Complaints from Customer Reviews

Online reviews carry customers’ opinion about product or service and help the customers to make online purchase-related decisions. These reviews are analyzed by business organizations to understand customer sentiment w.r.t. product/service. The extreme opinions like praise and complaint sentences are a subset of positive and negative sentences and difficult to find. Praise sentences are more descriptive in nature. Praises contain more nouns, adjectives, and intensifiers as compared to plain positive sentences and complaint sentences contain more connectives, adverbs as compared to plain negative sentences. In the past machine, learning methods are used to identify extreme opinions but the accuracy of such methods is very limited. This paper proposes (1) linguistic feature-based approach for reviewing sentences filtering and (2) machine learning-based and deep learning-based approach to classifying review sentences as praises or complaints. These praise and complaint sentences can be further analyzed by business organizations to identify the reasons for customer satisfaction or dissatisfaction. It can also be used for creating automatic product description from online reviews in terms of pro and con of the product/service. The performance of the machine learning classifiers with proposed hybrid features and deep learning-based classifiers using dense neural network, CNN, and multichannel CNN was evaluated by training and testing the deep neural network with a set of important words such as nouns, adjectives, intensifiers, and verbs present in the sentence. Hotel domain reviews were evaluated using the parameters accuracy, precision, recall, and F1-score. The proposed method showed excellent results as compared to state-of–the-art classifiers.

[1]  Pablo Gamallo,et al.  Linguistic Features to Identify Extreme Opinions: An Empirical Study , 2018, IDEAL.

[2]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[3]  Yao Liu,et al.  Using contextual features and multi-view ensemble learning in product defect identification from online discussion forums , 2018, Decis. Support Syst..

[4]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[5]  Xun Xu,et al.  Predicting overall customer satisfaction: Big data evidence from hotel online textual reviews , 2019, International Journal of Hospitality Management.

[6]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[7]  Weiguo Fan,et al.  An Integrated Text Analytic Framework for Product Defect Discovery , 2015 .

[8]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[9]  S. Becken,et al.  Sentiment Analysis in Tourism: Capitalizing on Big Data , 2019 .

[10]  Guangyu Zhou,et al.  Linguistic Understanding of Complaints and Praises in User Reviews , 2016, WASSA@NAACL-HLT.

[11]  Srikumar Krishnamoorthy,et al.  Linguistic features for review helpfulness prediction , 2015, Expert Syst. Appl..

[12]  Indranil Bose,et al.  What do hotel customers complain about? Text analysis using structural topic model , 2019, Tourism Management.

[13]  Pablo Gamallo,et al.  A lexicon based method to search for extreme opinions , 2018, PloS one.

[14]  Alcione de Paiva Oliveira,et al.  A Deep Learning Approach for Sentiment Analysis Applied to Hotel's Reviews , 2018, NLDB.

[15]  Yogesh Kumar Dwivedi,et al.  Ranking online consumer reviews , 2019, Electron. Commer. Res. Appl..

[16]  Vishal. A. Kharde,et al.  Sentiment Analysis of Twitter Data : A Survey of Techniques , 2016, ArXiv.

[17]  Jesús M. Torres,et al.  Using Deep Learning to Predict Sentiments: Case Study in Tourism , 2018, Complex..

[18]  Roberto Basili,et al.  Complex Linguistic Features for Text Classification: A Comprehensive Study , 2004, ECIR.

[19]  Jun Liu,et al.  Classifying facts and opinions in Twitter messages: a deep learning-based approach , 2018 .