EmpNa at WASSA 2021: A Lightweight Model for the Prediction of Empathy, Distress and Emotions from Reactions to News Stories

This paper describes our submission for the WASSA 2021 shared task regarding the prediction of empathy, distress and emotions from news stories. The solution is based on combining the frequency of words, lexicon-based information, demographics of the annotators and personality of the annotators into a linear model. The prediction of empathy and distress is performed using Linear Regression while the prediction of emotions is performed using Logistic Regression. Both tasks are performed using the same features. Our models rank 4th for the prediction of emotions and 2nd for the prediction of empathy and distress. These results are particularly interesting when considered that the computational requirements of the solution are minimal.

[1]  German Rigau,et al.  Simple, Robust and (almost) Unsupervised Generation of Polarity Lexicons for Multiple Languages , 2014, EACL.

[2]  Kaushal Kumar Shukla,et al.  Prayas at EmoInt 2017: An Ensemble of Deep Neural Architectures for Emotion Intensity Prediction in Tweets , 2017, WASSA@EMNLP.

[3]  Orphée De Clercq,et al.  WASSA 2021 Shared Task: Predicting Empathy and Emotion in Reaction to News Stories , 2021, WASSA.

[4]  Saif Mohammad,et al.  NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets , 2013, *SEMEVAL.

[5]  Finn Årup Nielsen,et al.  A New ANEW: Evaluation of a Word List for Sentiment Analysis in Microblogs , 2011, #MSM.

[6]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[7]  Amy Beth Warriner,et al.  Norms of valence, arousal, and dominance for 13,915 English lemmas , 2013, Behavior Research Methods.

[8]  Saif Mohammad,et al.  IEST: WASSA-2018 Implicit Emotions Shared Task , 2018, WASSA@EMNLP.

[9]  Alon Rozental,et al.  Amobee at IEST 2018: Transfer Learning from Language Models , 2018, WASSA@EMNLP.

[10]  Cornelia Caragea,et al.  Identifying Empathetic Messages in Online Health Communities , 2017, IJCNLP.

[11]  Joao Sedoc,et al.  Learning Word Ratings for Empathy and Distress from Document-Level User Responses , 2019, LREC.

[12]  Lyle H. Ungar,et al.  Modeling Empathy and Distress in Reaction to News Stories , 2018, EMNLP.

[13]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[14]  Jason Baldridge,et al.  Twitter Polarity Classification with Label Propagation over Lexical Links and the Follower Graph , 2011, ULNLP@EMNLP.

[15]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[16]  Ewan Klein,et al.  Natural Language Processing with Python , 2009 .

[17]  Erik Cambria,et al.  SenticNet: A Publicly Available Semantic Resource for Opinion Mining , 2010, AAAI Fall Symposium: Commonsense Knowledge.

[18]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[19]  Janyce Wiebe,et al.  +/-EffectWordNet: Sense-level Lexicon Acquisition for Opinion Inference , 2014, EMNLP.

[20]  Saif Mohammad,et al.  WASSA-2017 Shared Task on Emotion Intensity , 2017, WASSA@EMNLP.