Context Extraction for Aspect-Based Sentiment Analytics: Combining Syntactic, Lexical and Sentiment Knowledge

Aspect-level sentiment analysis of customer feedback data when done accurately can be leveraged to understand strong and weak performance points of businesses and services and also formulate critical action steps to improve their performance. In this work we focus on aspect-level sentiment classification studying the role of opinion context extraction for a given aspect and the extent to which traditional and neural sentiment classifiers benefit when trained using the opinion context text. We introduce a novel method that combines lexical, syntactical and sentiment knowledge effectively to extract opinion context for aspects. Thereafter we validate the quality of the opinion contexts extracted with human judgments using the BLEU score. Further we evaluate the usefulness of the opinion contexts for aspect-sentiment analysis. Our experiments on benchmark data sets from SemEval and a real-world dataset from the insurance domain suggests that extracting the right opinion context combining syntactical with sentiment co-occurrence knowledge leads to the best aspect-sentiment classification performance. From a commercial point of view, accurate aspect extraction, provides an elegant means to identify “pain-points” in a business. Integrating our work into a commercial CX platform (https://www.sentisum.com/) is enabling the company’s clients to better understand their customer opinions.

[1]  Zhiqiang Toh,et al.  DLIREC: Aspect Term Extraction and Term Polarity Classification System , 2014, *SEMEVAL.

[2]  Kentaro Inui,et al.  Dependency Tree-based Sentiment Classification using CRFs with Hidden Variables , 2010, NAACL.

[3]  Saif Mohammad,et al.  NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets , 2013, *SEMEVAL.

[4]  Fabrício Benevenuto,et al.  A Benchmark Comparison of State-of-the-Practice Sentiment Analysis Methods , 2015, ArXiv.

[5]  Xuanjing Huang,et al.  Phrase Dependency Parsing for Opinion Mining , 2009, EMNLP.

[6]  Daniel Dahlmeier,et al.  SAP-RI: A Constrained and Supervised Approach for Aspect-Based Sentiment Analysis , 2014, SemEval@COLING.

[7]  Yang Song,et al.  Topical Keyphrase Extraction from Twitter , 2011, ACL.

[8]  Nirmalie Wiratunga,et al.  Contextual sentiment analysis for social media genres , 2016, Knowl. Based Syst..

[9]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[10]  Arjun Mukherjee,et al.  Extracting Aspect Specific Opinion Expressions , 2016, EMNLP.

[11]  Saif Mohammad,et al.  NRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews , 2014, *SEMEVAL.

[12]  Tomas Mikolov,et al.  Bag of Tricks for Efficient Text Classification , 2016, EACL.

[13]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[14]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[15]  Pablo Gamallo Otero Comparing Window and Syntax Based Strategies for Semantic Extraction , 2008 .

[16]  Bing Liu,et al.  Review Topic Discovery with Phrases using the Pólya Urn Model , 2014, COLING.

[17]  Carolyn Penstein Rosé,et al.  Sentiment Classification using Automatically Extracted Subgraph Features , 2010, HLT-NAACL 2010.

[18]  Enric Plaza,et al.  Sentiment and Preference Guided Social Recommendation , 2014, ICCBR.

[19]  Emmanuel Morin,et al.  Improving Bilingual Lexicon Extraction from Comparable Corpora Using Window-Based and Syntax-Based Models , 2014, CICLing.

[20]  Josef Steinberger,et al.  UWB: Machine Learning Approach to Aspect-Based Sentiment Analysis , 2014, SemEval@COLING.

[21]  Aitor García Pablos,et al.  V3: Unsupervised Aspect Based Sentiment Analysis for SemEval2015 Task 12 , 2015, *SEMEVAL.

[22]  Bing Liu,et al.  Mining Opinion Features in Customer Reviews , 2004, AAAI.

[23]  Kim Schouten,et al.  COMMIT-P1WP3: A Co-occurrence Based Approach to Aspect-Level Sentiment Analysis , 2014, *SEMEVAL.