Affective State Prediction of Contextualized Concepts

Most studies on affective analysis of text focus on the sentiment or emotion expressed by a whole sentence or document. In this paper, we propose a novel approach to predict the affective states of a described event through the predictions of the corresponding subject, action and object involved in the described event. Rather than using a sentiment label or discrete emotion categories, the affective state is represented using the three dimensional evaluation-potency-activity (EPA) model. The main idea is to use automatically obtained word embedding as word representation and to use the Long Short-Term Memory (LSTM) network as the prediction model. Compared to the linear model used in the Affective Control Theory which uses manually annotated EPA lexicon, our proposed LSTM learning method using word embedding outperforms the linear model and word embedding also performs better than EPA lexicon. Most importantly, our work shows that automatically obtained word embedding outperforms manually constructed affective lexicons.

[1]  Omer Levy,et al.  Reconsidering Cross-lingual Word Embeddings , 2016, ArXiv.

[2]  Amy Beth Warriner,et al.  Norms of valence, arousal, and dominance for 13,915 English lemmas , 2013, Behavior Research Methods.

[3]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[4]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[5]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[6]  Peter D. Turney,et al.  Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon , 2010, HLT-NAACL 2010.

[7]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[8]  Sunghwan Mac Kim,et al.  EMOTIONS IN TEXT: DIMENSIONAL AND CATEGORICAL MODELS , 2013, Comput. Intell..

[9]  Bing Liu,et al.  Mining Aspect-Specific Opinion using a Holistic Lifelong Topic Model , 2016, WWW.

[10]  Erik Cambria,et al.  SenticNet 3: A Common and Common-Sense Knowledge Base for Cognition-Driven Sentiment Analysis , 2014, AAAI.

[11]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.

[12]  Miryung Kim,et al.  Validity concerns in software engineering research , 2010, FoSER '10.

[13]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[14]  Werner Ceusters,et al.  The Emotion Ontology: Enabling Interdisciplinary Research in the Affective Sciences , 2011, CONTEXT.

[15]  David R. Heise Affect control theory: Concepts and model , 1987 .

[16]  Georgiana Dinu,et al.  Don’t count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors , 2014, ACL.

[17]  Chunyan Miao,et al.  A Generative Word Embedding Model and its Low Rank Positive Semidefinite Solution , 2015, EMNLP.

[18]  Jingwei Zhang,et al.  Word Semantic Representations using Bayesian Probabilistic Tensor Factorization , 2014, EMNLP.

[19]  Lung-Hao Lee,et al.  Building Chinese Affective Resources in Valence-Arousal Dimensions , 2016, NAACL.

[20]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[21]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[22]  David R. Heise Surveying Cultures: Discovering Shared Conceptions and Sentiments , 2010 .

[23]  Saif Mohammad,et al.  NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets , 2013, *SEMEVAL.

[24]  Jure Leskovec,et al.  Inducing Domain-Specific Sentiment Lexicons from Unlabeled Corpora , 2016, EMNLP.

[25]  Claire Cardie,et al.  Opinion Mining with Deep Recurrent Neural Networks , 2014, EMNLP.

[26]  Jesse Hoey,et al.  Good News or Bad News: Using Affect Control Theory to Analyze Readers’ Reaction Towards News Articles , 2015, NAACL.

[27]  Saif Mohammad,et al.  CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON , 2013, Comput. Intell..

[28]  Ting Liu,et al.  Document Modeling with Gated Recurrent Neural Network for Sentiment Classification , 2015, EMNLP.

[29]  Ming Zhou,et al.  Building Large-Scale Twitter-Specific Sentiment Lexicon : A Representation Learning Approach , 2014, COLING.

[30]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[31]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[32]  David R. Heise Expressive Order: Confirming Sentiments in Social Actions , 2006 .

[33]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[34]  Zhenyu He,et al.  A Sentence Vector Based Over-Sampling Method for Imbalanced Emotion Classification , 2014, CICLing.

[35]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[36]  Jesse Hoey,et al.  Bayesian Affect Control Theory , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[37]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[38]  M. Minsky The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind , 2006 .

[39]  Mirella Lapata,et al.  Composition in Distributional Models of Semantics , 2010, Cogn. Sci..