ESTeR: Combining Word Co-occurrences and Word Associations for Unsupervised Emotion Detection

Accurate detection of emotions in user- generated text was shown to have several applications for e-commerce, public well-being, and disaster management. Currently, the state-of-the-art performance for emotion detection in text is obtained using complex, deep learning models trained on domain-specific, labeled data. In this paper, we propose ESTeR , an unsupervised model for identifying emotions using a novel similarity function based on random walks on graphs. Our model combines large-scale word co-occurrence information with word-associations from lexicons avoiding not only the dependence on labeled datasets, but also an explicit mapping of words to latent spaces used in emotion-enriched word embeddings. Our similarity function can also be computed efficiently. We study a range of datasets including recent tweets related to COVID-19 to illustrate the superior performance of our model and report insights on public emotions during the on-going pandemic.

[1]  Aijun An,et al.  Learning Emotion-enriched Word Representations , 2018, COLING.

[2]  Sepandar D. Kamvar,et al.  An Analytical Comparison of Approaches to Personalizing PageRank , 2003 .

[3]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[4]  Roman Klinger,et al.  IMS at EmoInt-2017: Emotion Intensity Prediction with Affective Norms, Automatically Extended Resources and Deep Learning , 2017, WASSA@EMNLP.

[5]  S. Tokuno,et al.  Mental status assessment of disaster relief personnel by vocal affect display based on voice emotion recognition , 2017, Disaster and Military Medicine.

[6]  Chunyan Miao,et al.  Knowledge-Enriched Transformer for Emotion Detection in Textual Conversations , 2019, EMNLP.

[7]  Peng Xu,et al.  Emo2Vec: Learning Generalized Emotion Representation by Multi-task Training , 2018, WASSA@EMNLP.

[8]  Muhammad Abdul-Mageed,et al.  EmoNet: Fine-Grained Emotion Detection with Gated Recurrent Neural Networks , 2017, ACL.

[9]  Stefan Wermter,et al.  Multimodal emotional state recognition using sequence-dependent deep hierarchical features , 2015, Neural Networks.

[10]  Taher H. Haveliwala Topic-Sensitive PageRank: A Context-Sensitive Ranking Algorithm for Web Search , 2003, IEEE Trans. Knowl. Data Eng..

[11]  Paul Ekman,et al.  What Scientists Who Study Emotion Agree About , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[12]  Andrei Popescu-Belis,et al.  A Random Walk Framework to Compute Textual Semantic Similarity: A Unified Model for Three Benchmark Tasks , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[13]  Rada Mihalcea,et al.  TextRank: Bringing Order into Text , 2004, EMNLP.

[14]  Salma Elgayar,et al.  Emotion Detection from Text: Survey , 2017 .

[15]  Endang Wahyu Pamungkas Emotionally-Aware Chatbots: A Survey , 2019, ArXiv.

[16]  Saif Mohammad,et al.  Stance and Sentiment in Tweets , 2016, ACM Trans. Internet Techn..

[17]  Roman Klinger,et al.  An Analysis of Annotated Corpora for Emotion Classification in Text , 2018, COLING.

[18]  Jeremy Barnes,et al.  Annotation, Modelling and Analysis of Fine-Grained Emotions on a Stance and Sentiment Detection Corpus , 2017, WASSA@EMNLP.

[19]  Chen Liu,et al.  DENS: A Dataset for Multi-class Emotion Analysis , 2019, EMNLP.

[20]  Jinho D. Choi,et al.  Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networks , 2017, AAAI Workshops.

[21]  Saif Mohammad,et al.  SemEval-2018 Task 1: Affect in Tweets , 2018, *SEMEVAL.

[22]  Manuel Montes-y-Gómez,et al.  Detecting Depression in Social Media using Fine-Grained Emotions , 2019, NAACL.

[23]  Martha Lewis,et al.  Modelling the interplay of metaphor and emotion through multitask learning , 2019, EMNLP.

[24]  Mona T. Diab,et al.  Emotion Detection and Classification in a Multigenre Corpus with Joint Multi-Task Deep Learning , 2018, COLING.

[25]  Florian Boudin,et al.  A Comparison of Centrality Measures for Graph-Based Keyphrase Extraction , 2013, IJCNLP.

[26]  Cornelia Caragea,et al.  Sentiment analysis during Hurricane Sandy in emergency response , 2017 .

[27]  Z. Zlatev Computational Methods for General Sparse Matrices , 1991 .

[28]  Rada Mihalcea,et al.  DialogueRNN: An Attentive RNN for Emotion Detection in Conversations , 2018, AAAI.

[29]  Wlodek Zadrozny,et al.  Emotion Detection in Text: a Review , 2018, ArXiv.

[30]  Jasmine Novak,et al.  PageRank Computation and the Structure of the Web: Experiments and Algorithms , 2002 .

[31]  Yi-Shin Chen,et al.  CARER: Contextualized Affect Representations for Emotion Recognition , 2018, EMNLP.

[32]  Yu-Chiang Frank Wang,et al.  Learning Deep Latent Spaces for Multi-Label Classification , 2017, ArXiv.

[33]  Georg M. Goerg,et al.  Improving semantic topic clustering for search queries with word co-occurrence and bigraph co-clustering , 2016 .

[34]  Giovanni Semeraro,et al.  A Comparison of Word-Embeddings in Emotion Detection from Text using BiLSTM, CNN and Self-Attention , 2019, UMAP.

[35]  Robert E. Mercer,et al.  Multi-Channel Convolutional Neural Network for Twitter Emotion and Sentiment Recognition , 2019, NAACL.

[36]  Hao Wang,et al.  Capturing Semantic Similarity for Words in Wikipedia with Random Walk , 2018, 2018 5th IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS).

[37]  Hung-Yu Kao,et al.  Word Co-occurrence Augmented Topic Model in Short Text , 2015, Int. J. Comput. Linguistics Chin. Lang. Process..

[38]  P. Ekman An argument for basic emotions , 1992 .

[39]  Tao Chen,et al.  Word Embedding Composition for Data Imbalances in Sentiment and Emotion Classification , 2015, Cognitive Computation.

[40]  Arch W. Naylor,et al.  Linear Operator Theory in Engineering and Science , 1971 .

[41]  Ying Zhang,et al.  Text Emotion Distribution Learning via Multi-Task Convolutional Neural Network , 2018, IJCAI.

[42]  R. Plutchik Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice , 2016 .

[43]  Marco Guerini,et al.  Depeche Mood: a Lexicon for Emotion Analysis from Crowd Annotated News , 2014, ACL.

[44]  Lun-Wei Ku,et al.  SocialNLP 2018 EmotionX Challenge Overview: Recognizing Emotions in Dialogues , 2018, SocialNLP@ACL.

[45]  Udo Hahn,et al.  Emotion Representation Mapping for Automatic Lexicon Construction (Mostly) Performs on Human Level , 2018, COLING.

[46]  Chao Wang,et al.  Multimodal and Multi-view Models for Emotion Recognition , 2019, ACL.

[47]  Lyle H. Ungar,et al.  Modelling Valence and Arousal in Facebook posts , 2016, WASSA@NAACL-HLT.

[48]  Johan Bollen,et al.  Modeling Public Mood and Emotion: Twitter Sentiment and Socio-Economic Phenomena , 2009, ICWSM.

[49]  Ming Zhou,et al.  Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification , 2014, ACL.

[50]  Pan Zhou,et al.  Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction , 2019, CIKM.

[51]  Sunghwan Mac Kim,et al.  Evaluation of Unsupervised Emotion Models to Textual Affect Recognition , 2010, HLT-NAACL 2010.

[52]  Wlodek Zadrozny,et al.  Can Word Embeddings Help Find Latent Emotions in Text? Preliminary Results , 2017, FLAIRS Conference.

[53]  Marco Guerini,et al.  DepecheMood++: A Bilingual Emotion Lexicon Built Through Simple Yet Powerful Techniques , 2018, IEEE Transactions on Affective Computing.

[54]  Ayu Purwarianti,et al.  Emotion classification on youtube comments using word embedding , 2017, 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA).

[55]  Cornelia Caragea,et al.  Fine-Grained Emotion Detection in Health-Related Online Posts , 2018, EMNLP.

[56]  Svetha Venkatesh,et al.  Mood sensing from social media texts and its applications , 2013, Knowledge and Information Systems.

[57]  Puneet Agrawal,et al.  Understanding Emotions in Text Using Deep Learning and Big Data , 2019, Comput. Hum. Behav..

[58]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[59]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[60]  Xiaohui Yan,et al.  A biterm topic model for short texts , 2013, WWW.

[61]  Jiebo Luo,et al.  Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media , 2018, CHI.

[62]  Mandar Deshpande,et al.  Depression detection using emotion artificial intelligence , 2017, 2017 International Conference on Intelligent Sustainable Systems (ICISS).

[63]  Saif Mohammad,et al.  #Emotional Tweets , 2012, *SEMEVAL.

[64]  Saif Mohammad,et al.  CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON , 2013, Comput. Intell..

[65]  Wenyin Liu,et al.  Affective topic model for social emotion detection , 2014, Neural Networks.

[66]  Shourya Roy,et al.  Fine-Grained Emotion Detection in Contact Center Chat Utterances , 2017, PAKDD.