Recognizing emotions in text using ensemble of classifiers

Emotions constitute a key factor in human nature and behavior. The most common way for people to express their opinions, thoughts and communicate with each other is via written text. In this paper, we present a sentiment analysis system for automatic recognition of emotions in text, using an ensemble of classifiers. The designed ensemble classifier schema is based on the notion of combining knowledge-based and statistical machine learning classification methods aiming to benefit from their merits and minimize their drawbacks. The ensemble schema is based on three classifiers; two are statistical (a Naive Bayes and a Maximum Entropy learner) and the third one is a knowledge-based tool performing deep analysis of the natural language sentences. The knowledge-based tool analyzes the sentence's text structure and dependencies and implements a keyword-based approach, where the emotional state of a sentence is derived from the emotional affinity of the sentence's emotional parts. The ensemble classifier schema has been extensively evaluated on various forms of text such as, news headlines, articles and social media posts. The experimental results indicate quite satisfactory performance regarding the ability to recognize emotion presence in text and also to identify the polarity of the emotions.

[1]  Tru H. Cao,et al.  A High-Order Hidden Markov Model for Emotion Detection from Textual Data , 2012, PKAW.

[2]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[3]  François-Régis Chaumartin,et al.  UPAR7: A knowledge-based system for headline sentiment tagging , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[4]  Pawel Dybala,et al.  A System for Affect Analysis of Utterances in Japanese Supported with Web Mining , 2009 .

[5]  Jian Ma,et al.  Sentiment classification: The contribution of ensemble learning , 2014, Decis. Support Syst..

[6]  Ioannis Hatzilygeroudis,et al.  Conversation Emotional Modeling in Social Networks , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.

[7]  Rui Xia,et al.  Ensemble of feature sets and classification algorithms for sentiment classification , 2011, Inf. Sci..

[8]  P. Wilson,et al.  The Nature of Emotions , 2012 .

[9]  Andrew McCallum,et al.  Using Maximum Entropy for Text Classification , 1999 .

[10]  Xia Wang,et al.  Sentiment Classification through Combining Classifiers with Multiple Feature Sets , 2007, 2007 International Conference on Natural Language Processing and Knowledge Engineering.

[11]  Munmun De Choudhury,et al.  Happy, Nervous or Surprised? Classification of Human Affective States in Social Media , 2012, ICWSM.

[12]  Kang Liu,et al.  Book Review: Sentiment Analysis: Mining Opinions, Sentiments, and Emotions by Bing Liu , 2015, CL.

[13]  Cecilia Ovesdotter Alm,et al.  Emotions from Text: Machine Learning for Text-based Emotion Prediction , 2005, HLT.

[14]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[15]  T. Dalgleish.  Basic Emotions , 2004 .

[16]  Helmut Schmidt,et al.  Probabilistic part-of-speech tagging using decision trees , 1994 .

[17]  Lin Qiu,et al.  You are what you tweet: Personality expression and perception on Twitter , 2012 .

[18]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[19]  Philip J. Stone,et al.  Extracting Information. (Book Reviews: The General Inquirer. A Computer Approach to Content Analysis) , 1967 .

[20]  Ioannis Hatzilygeroudis,et al.  Recognizing Emotion Presence in Natural Language Sentences , 2013, EANN.

[21]  Walaa Medhat,et al.  Sentiment analysis algorithms and applications: A survey , 2014 .

[22]  Ronen Feldman,et al.  Techniques and applications for sentiment analysis , 2013, CACM.

[23]  W. Bruce Croft,et al.  Computing Attitude and Affect in Text : , 2006 .

[24]  Diana Inkpen,et al.  Using a Heterogeneous Dataset for Emotion Analysis in Text , 2011, Canadian Conference on AI.

[25]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[26]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[27]  Kenji Araki,et al.  Affect analysis in context of characters in narratives , 2013, Expert Syst. Appl..

[28]  Emiliano Lorini,et al.  Computational Modeling of Emotion: Toward Improving the Inter- and Intradisciplinary Exchange , 2013, IEEE Transactions on Affective Computing.

[29]  Christopher D. Manning,et al.  Generating Typed Dependency Parses from Phrase Structure Parses , 2006, LREC.

[30]  Estevam R. Hruschka,et al.  Tweet sentiment analysis with classifier ensembles , 2014, Decis. Support Syst..

[31]  T. Danisman,et al.  Feeler: Emotion Classification of Text Using Vector Space Model , 2008 .

[32]  Kate Smith-Miles.  Applications of neural networks , 2005, Comput. Oper. Res..

[33]  Mike Thelwall,et al.  Sentiment strength detection for the social web , 2012, J. Assoc. Inf. Sci. Technol..

[34]  Vajrapu Anusha,et al.  A Learning Based Emotion Classifier with Semantic Text Processing , 2014, ISI.

[35]  Björn W. Schuller,et al.  New Avenues in Opinion Mining and Sentiment Analysis , 2013, IEEE Intelligent Systems.

[36]  Elisabeth André,et al.  Lexical Affect Sensing: Are Affect Dictionaries Necessary to Analyze Affect? , 2007, ACII.

[37]  K. Scherer,et al.  Evidence for universality and cultural variation of differential emotion response patterning. , 1994, Journal of personality and social psychology.

[38]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[39]  Rosalind W. Picard.  Affective Computing , 1997 .

[40]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[41]  W. G. Parrott,et al.  Emotions in social psychology : essential readings , 2001 .

[42]  Lei Zhang,et al.  A Survey of Opinion Mining and Sentiment Analysis , 2012, Mining Text Data.

[43]  Carlo Strapparava,et al.  WordNet Affect: an Affective Extension of WordNet , 2004, LREC.

[44]  Carlo Strapparava,et al.  SemEval-2007 Task 14: Affective Text , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[45]  Katia Kermanidis,et al.  Mood Classification Using Lyrics and Audio: A Case-Study in Greek Music , 2012, AIAI.

[46]  Yichen Wang,et al.  Detecting Emotions in Social Media: A Constrained Optimization Approach , 2015, IJCAI.

[47]  Suad Alhojely,et al.  Sentiment Analysis and Opinion Mining: A Survey , 2016 .

[48]  Michael C. Fairhurst,et al.  Classifier Ensemble Generation for the Majority Vote Rule , 2008, CIARP.

[49]  M. Yik.  A circumplex model of affect and its relation to personality : a five-language study , 1999 .

[50]  Mitsuru Ishizuka,et al.  Textual Affect Sensing for Sociable and Expressive Online Communication , 2007, ACII.

[51]  R. Plutchik.  The Nature of Emotions , 2001 .

[52]  Christopher D. Manning,et al.  Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling , 2005, ACL.

[53]  Hazem M. Hajj,et al.  Emotion Recognition from Text Based on Automatically Generated Rules , 2014, 2014 IEEE International Conference on Data Mining Workshop.