A New Semantic Relations-Based Hybrid Approach for Implicit Aspect Identification in Sentiment Analysis

Within the next few years, sentiment analysis or opinion mining is set to become an important component of real-world applications for product manufacturers, e-commerce companies, and potential customers. Sentiment analysis deals with the computational assessment of people’s opinions apparent or hidden within the text according to three levels: document, sentence and aspect levels. The aspect-level is increasingly becoming an active phase of sentiment analysis. At this level, the aim is to determine the hidden target of opinion represented in datasets, known as aspect term identification. This paper proposes an original hybrid model combining semantic relations and frequency-based approach with supervised classifiers for implicit aspect identification (IAI). The proposed approach is directed towards improving the F1-performances for traditional supervised classifiers commonly used in this field based on eager and lazy learning, and deep learning technique using long short-term memory whit attention mechanism applied for IAI. Particularly, this work addresses aspect term extraction and aggregation, the two sub-tasks of IAI, involving adjectives and verbs. The effects of this approach are empirically examined on multiple datasets of electronic products and restaurant reviews with multiple aspect granularity levels. Comparing this method with similar approaches clearly shows the benefits of this method: (i) the use of an appropriately selected WordNet semantic relations of adjectives and verbs that significantly helps classifiers for IAI. (ii) Using the hybrid model helps classifiers better handle these selected WordNet semantic relations and therefore deal better with IAI.

[1]  Yu-N Cheah,et al.  Hybrid rule-based approach for aspect extraction and categorization from customer reviews , 2015, 2015 9th International Conference on IT in Asia (CITA).

[2]  Ekin Ekinci,et al.  Using Adjusted Laplace Smoothing to Extract Implicit Aspects from Turkish Hotel Reviews , 2018, 2018 Innovations in Intelligent Systems and Applications (INISTA).

[3]  S. Brindha,et al.  A survey on classification techniques for text mining , 2016, 2016 3rd International Conference on Advanced Computing and Communication Systems (ICACCS).

[4]  Surangika Ranathunga,et al.  Implicit Aspect Detection in Restaurant Reviews using Cooccurence of Words , 2016, WASSA@NAACL-HLT.

[5]  Tingting Wang,et al.  Deep Learning for Aspect-Level Sentiment Classification: Survey, Vision, and Challenges , 2019, IEEE Access.

[6]  Erik Cambria,et al.  Affective Computing and Sentiment Analysis , 2016, IEEE Intelligent Systems.

[7]  Savas Yildirim,et al.  Classification of "Hot News" for Financial Forecast Using NLP Techniques , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[8]  Erik Cambria,et al.  Aspect extraction for opinion mining with a deep convolutional neural network , 2016, Knowl. Based Syst..

[9]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[10]  Geoff Holmes,et al.  Multinomial Naive Bayes for Text Categorization Revisited , 2004, Australian Conference on Artificial Intelligence.

[11]  Namita Mittal,et al.  Semantic Orientation-Based Approach for Sentiment Analysis , 2016 .

[12]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[13]  Mike Thelwall,et al.  Sentiment Analysis Is a Big Suitcase , 2017, IEEE Intelligent Systems.

[14]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[15]  Xin Li,et al.  Deep Multi-Task Learning for Aspect Term Extraction with Memory Interaction , 2017, EMNLP.

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Mohammad Tubishat,et al.  Implicit aspect extraction in sentiment analysis: Review, taxonomy, oppportunities, and open challenges , 2018, Inf. Process. Manag..

[18]  Panagiotis G. Ipeirotis,et al.  Show me the money!: deriving the pricing power of product features by mining consumer reviews , 2007, KDD '07.

[19]  Kim Schouten,et al.  Implicit Feature Extraction for Sentiment Analysis in Consumer Reviews , 2014, NLDB.

[20]  Wei Shi,et al.  Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification , 2016, ACL.

[21]  Goutam Sanyal,et al.  Performance Assessment of Multiple Classifiers Based on Ensemble Feature Selection Scheme for Sentiment Analysis , 2018, Appl. Comput. Intell. Soft Comput..

[22]  Erik Cambria,et al.  Multimodal Sentiment Analysis: Addressing Key Issues and Setting Up the Baselines , 2018, IEEE Intelligent Systems.

[23]  Kim Schouten,et al.  Detection of Multiple Implicit Features per Sentence in Consumer Review Data , 2016, DB&IS.

[24]  TubishatMohammad,et al.  Implicit aspect extraction in sentiment analysis , 2018 .

[25]  Mahmoud Al-Ayyoub,et al.  Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels' reviews , 2017, J. Comput. Sci..

[26]  Kim Schouten,et al.  Semantics-Driven Implicit Aspect Detection in Consumer Reviews , 2015, WWW.

[27]  Kim Schouten,et al.  Finding Implicit Features in Consumer Reviews for Sentiment Analysis , 2014, ICWE.

[28]  Ayu Purwarianti,et al.  Comparative Study on Language Rule Based Methods for Aspect Extraction in Sentiment Analysis , 2018, 2018 International Conference on Asian Language Processing (IALP).