Sentence-Level Emotion and Valence Tagging

The paper proposes the tagging of sentence-level emotion and valence based on the word-level constituents on the SemEval 2007 affect sensing news corpus. The baseline system for each emotion class assigns the class label to each word, while the WordNet Affect lists updated using the SentiWordNet were also used as the lexicon-based system. Though the inclusion of morphology into the lexicon-based system improves the performance of the word-level emotion tagging, the Conditional Random Field-based machine-learning framework was employed for the word-level emotion-tagging system, and it outperforms both the baseline- and lexicon-based systems. Six separate sense scores for six emotion types are calculated from the SentiWordNet and applied to word-level emotion tagged constituents for identifying sentential emotion scores. Three emotion scoring methods followed by a post-processing technique were employed for identifying the sentence-level emotion tags. In addition to that, the best two emotion tags corresponding to the maximum obtained sense scores are assigned to the sentences, whereas the sentence-level valence is identified based on the total sense scores of the word-level emotion tags along with their polarity. Evaluation was carried out with respect to the best two emotion tags on 250 gold standard test sentences and achieved satisfactory results for sentence-level emotion and valence tagging.

[1]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[2]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[3]  Dipankar Das,et al.  Word to Sentence Level Emotion Tagging for Bengali Blogs , 2009, ACL/IJCNLP.

[4]  Henry Lieberman,et al.  A model of textual affect sensing using real-world knowledge , 2003, IUI '03.

[5]  Jan Svartvik,et al.  A __ comprehensive grammar of the English language , 1988 .

[6]  Dipankar Das,et al.  Sentence level emotion tagging , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[7]  R. Gunderman,et al.  Emotional intelligence. , 2011, Journal of the American College of Radiology : JACR.

[8]  Janyce Wiebe,et al.  Learning Subjective Language , 2004, CL.

[9]  Hsin-Hsi Chen,et al.  Overview of Opinion Analysis Pilot Task at NTCIR-6 , 2007, NTCIR.

[10]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[11]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[12]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[13]  Kathleen R. McKeown,et al.  Predicting the semantic orientation of adjectives , 1997 .

[14]  Peter D. Turney.  Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[15]  Gilad Mishne,et al.  Capturing Global Mood Levels using Blog Posts , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[16]  Dipankar Das,et al.  Developing Japanese WordNet Affect for Analyzing Emotions , 2011, WASSA@ACL.

[17]  Hsin-Hsi Chen,et al.  What emotions do news articles trigger in their readers? , 2007, SIGIR.

[18]  Mirella Lapata,et al.  Discourse Chunking and its Application to Sentence Compression , 2005, HLT.

[19]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[20]  Cecilia Ovesdotter Alm,et al.  Emotions from Text: Machine Learning for Text-based Emotion Prediction , 2005, HLT.

[21]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[22]  Christopher D. Manning,et al.  Enriching the Knowledge Sources Used in a Maximum Entropy Part-of-Speech Tagger , 2000, EMNLP.

[23]  Claire Cardie,et al.  Combining Low-Level and Summary Representations of Opinions for Multi-Perspective Question Answering , 2003, New Directions in Question Answering.

[24]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[25]  Carlo Strapparava,et al.  WordNet Affect: an Affective Extension of WordNet , 2004, LREC.

[26]  Janyce Wiebe,et al.  Just How Mad Are You? Finding Strong and Weak Opinion Clauses , 2004, AAAI.

[27]  Carlo Strapparava,et al.  SemEval-2007 Task 14: Affective Text , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[28]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[29]  Pablo Gervás,et al.  A Hybrid Approach to Emotional Sentence Polarity and Intensity Classification , 2010, CoNLL.

[30]  Sara Owsley Sood,et al.  ESSE: Exploring mood on the web , 2009 .

[31]  Marilyn A. Walker.  Can We Talk? Methods for Evaluation and Training of Spoken Dialogue Systems , 2005, Lang. Resour. Evaluation.

[32]  Shingo Kuroiwa,et al.  A Preliminary Research of Chinese Emotion Classification Model , 2006 .

[33]  Shady Shehata,et al.  Enhancing Search Engine Quality Using Concept-based Text Retrieval , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[34]  Hsin-Hsi Chen,et al.  Emotion Classification Using Web Blog Corpora , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[35]  Gregory Grefenstette,et al.  Coupling Niche Browsers and Affect Analysis for an Opinion Mining Application , 2004, RIAO.

[36]  Hsin-Hsi Chen,et al.  Opinion Extraction, Summarization and Tracking in News and Blog Corpora , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[37]  François-Régis Chaumartin,et al.  UPAR7: A knowledge-based system for headline sentiment tagging , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[38]  Dipankar Das,et al.  Identifying Emotional Expressions, Intensities and Sentence Level Emotion Tags Using a Supervised Framework , 2010, PACLIC.

[39]  Iadh Ounis,et al.  Overview of the TREC 2008 Blog Track , 2008, TREC.