Using Structured Representation and Data: A Hybrid Model for Negation and Sentiment in Customer Service Conversations

Twitter customer service interactions have recently emerged as an effective platform to respond and engage with customers. In this work, we explore the role of negation in customer service interactions, particularly applied to sentiment analysis. We define rules to identify true negation cues and scope more suited to conversational data than existing general review data. Using semantic knowledge and syntactic structure from constituency parse trees, we propose an algorithm for scope detection that performs comparable to state of the art BiLSTM. We further investigate the results of negation scope detection for the sentiment prediction task on customer service conversation data using both a traditional SVM and a Neural Network. We propose an antonym dictionary based method for negation applied to a CNN-LSTM combination model for sentiment analysis. Experimental results show that the antonym-based method outperforms the previous lexicon-based and neural network methods.

[1]  Preslav Nakov,et al.  SemEval-2013 Task 2: Sentiment Analysis in Twitter , 2013, *SEMEVAL.

[2]  Chris Eliasmith,et al.  Hyperopt: a Python library for model selection and hyperparameter optimization , 2015 .

[3]  T. Givón,et al.  English grammar : a function-based introduction , 1995 .

[4]  Stephan Oepen,et al.  UiO1: Constituent-Based Discriminative Ranking for Negation Resolution , 2012, *SEMEVAL.

[5]  Erik Velldal,et al.  Predicting speculation: a simple disambiguation approach to hedge detection in biomedical literature , 2011, J. Biomed. Semant..

[6]  Roser Morante,et al.  A Metalearning Approach to Processing the Scope of Negation , 2009, CoNLL.

[7]  Bonggun Shin,et al.  Lexicon Integrated CNN Models with Attention for Sentiment Analysis , 2016, WASSA@EMNLP.

[8]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[9]  Wenpeng Yin,et al.  Multichannel Variable-Size Convolution for Sentence Classification , 2015, CoNLL.

[10]  Jorge Carrillo de Albornoz,et al.  UCM-I: A Rule-based Syntactic Approach for Resolving the Scope of Negation , 2012, *SEMEVAL.

[11]  Mário J. Silva,et al.  Clues for detecting irony in user-generated contents: oh...!! it's "so easy" ;-) , 2009, TSA@CIKM.

[12]  Maite Taboada,et al.  A review corpus annotated for negation, speculation and their scope , 2012, LREC.

[13]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[15]  Mário J. Silva,et al.  Automatic creation of a reference corpus for political opinion mining in user-generated content , 2009, TSA@CIKM.

[16]  Dietrich Klakow,et al.  A survey on the role of negation in sentiment analysis , 2010, NeSp-NLP@ACL.

[17]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[18]  Saif Mohammad,et al.  NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets , 2013, *SEMEVAL.

[19]  Navneet Kaur,et al.  Opinion mining and sentiment analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[20]  Chris Callison-Burch,et al.  Learning Antonyms with Paraphrases and a Morphology-Aware Neural Network , 2017, *SEM.

[21]  Eneko Agirre Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation , 2012 .

[22]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[23]  Zhiyong Luo,et al.  Combination of Convolutional and Recurrent Neural Network for Sentiment Analysis of Short Texts , 2016, COLING.

[24]  James Paul White UWashington: Negation Resolution using Machine Learning Methods , 2012, *SEM@NAACL-HLT.

[25]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[26]  Jan Svartvik,et al.  A __ comprehensive grammar of the English language , 1988 .

[27]  Laurence R. Horn A Natural History of Negation , 1989 .

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Bonnie L. Webber,et al.  Detecting negation scope is easy, except when it isn’t , 2017, EACL.

[30]  Karo Moilanen,et al.  Sentiment Composition , 2007 .

[31]  Björn Gambäck,et al.  Negation Scope Detection for Twitter Sentiment Analysis , 2015, WASSA@EMNLP.

[32]  János Csirik,et al.  The BioScope corpus: annotation for negation, uncertainty and their scope in biomedical texts , 2008, BioNLP.

[33]  Erik Velldal,et al.  An open-source tool for negation detection: a maximum-margin approach , 2017 .

[34]  Janyce Wiebe,et al.  Articles: Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis , 2009, CL.

[35]  C. Fillmore,et al.  The position of embedding transformations in a grammar . Some syntactic rules in Mandarin . Tree representations in linguistics , 1963 .

[36]  G. Tottie Negation in English speech and writing : a study in variation , 1993 .

[37]  Tomoko Ohkuma,et al.  TeamX: A Sentiment Analyzer with Enhanced Lexicon Mapping and Weighting Scheme for Unbalanced Data , 2014, *SEMEVAL.

[38]  Stephan Oepen,et al.  Speculation and Negation: Rules, Rankers, and the Role of Syntax , 2012, CL.

[39]  Saif Mohammad,et al.  Sentiment Analysis of Short Informal Texts , 2014, J. Artif. Intell. Res..

[40]  Emily M. Bender,et al.  Simple Negation Scope Resolution through Deep Parsing: A Semantic Solution to a Semantic Problem , 2014, ACL.

[41]  Graeme Hirst,et al.  Book Reviews: Longman Grammar of Spoken and Written English , 2001, Computational Linguistics.

[42]  Bonnie L. Webber,et al.  Neural Networks For Negation Scope Detection , 2016, ACL.

[43]  Erik Velldal,et al.  UiO 2: Sequence-labeling Negation Using Dependency Features , 2012, *SEMEVAL.

[44]  Tejashri Inadarchand Jain,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2010 .

[45]  Ming Zhou,et al.  Coooolll: A Deep Learning System for Twitter Sentiment Classification , 2014, *SEMEVAL.

[46]  Peter D. Turney,et al.  Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon , 2010, HLT-NAACL 2010.

[47]  Philip S. Yu,et al.  A holistic lexicon-based approach to opinion mining , 2008, WSDM '08.

[48]  Roser Morante,et al.  Learning the Scope of Negation in Biomedical Texts , 2008, EMNLP.

[49]  Roser Morante,et al.  *SEM 2012 Shared Task: Resolving the Scope and Focus of Negation , 2012, *SEMEVAL.

[50]  Isaac G. Councill,et al.  What's great and what's not: learning to classify the scope of negation for improved sentiment analysis , 2010, NeSp-NLP@ACL.