Learning with Compositional Semantics as Structural Inference for Subsentential Sentiment Analysis

Determining the polarity of a sentiment-bearing expression requires more than a simple bag-of-words approach. In particular, words or constituents within the expression can interact with each other to yield a particular overall polarity. In this paper, we view such subsentential interactions in light of compositional semantics, and present a novel learning-based approach that incorporates structural inference motivated by compositional semantics into the learning procedure. Our experiments show that (1) simple heuristics based on compositional semantics can perform better than learning-based methods that do not incorporate compositional semantics (accuracy of 89.7% vs. 89.1%), but (2) a method that integrates compositional semantics into learning performs better than all other alternatives (90.7%). We also find that "content-word negators", not widely employed in previous work, play an important role in determining expression-level polarity. Finally, in contrast to conventional wisdom, we find that expression-level classification accuracy uniformly decreases as additional, potentially disambiguating, context is considered.

[1]  Karo Moilanen,et al.  Sentiment Composition , 2007 .

[2]  Dan Klein,et al.  Structure compilation: trading structure for features , 2008, ICML '08.

[3]  Steven P. Abney Partial parsing via finite-state cascades , 1996, Natural Language Engineering.

[4]  Alistair Kennedy,et al.  Sentiment Classification of Movie and Product Reviews Using Contextual Valence Shifters , 2005 .

[5]  Carlo Strapparava,et al.  SemEval-2007 Task 14: Affective Text , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[6]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[7]  Stephen G. Pulman,et al.  Multi-entity Sentiment Scoring , 2009, RANLP.

[8]  Soo-Min Kim,et al.  Determining the Sentiment of Opinions , 2004, COLING.

[9]  David R. Dowty,et al.  Introduction to Montague semantics , 1980 .

[10]  Mitsuru Ishizuka,et al.  Assessing Sentiment of Text by Semantic Dependency and Contextual Valence Analysis , 2007, ACII.

[11]  Koby Crammer,et al.  Ultraconservative Online Algorithms for Multiclass Problems , 2001, J. Mach. Learn. Res..

[12]  Mike Wells,et al.  Structured Models for Fine-to-Coarse Sentiment Analysis , 2007, ACL.

[13]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[14]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[15]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[16]  Jianhua Li,et al.  Analysis of Polarity Information in Medical Text , 2005, AMIA.

[17]  R. Montague Formal philosophy; selected papers of Richard Montague , 1974 .

[18]  C. Condoravdi,et al.  Computing relative polarity for textual inference , 2006 .

[19]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.