Us vs. Them: A Dataset of Populist Attitudes, News Bias and Emotions

Computational modelling of political discourse tasks has become an increasingly important area of research in the field of natural language processing. Populist rhetoric has risen across the political sphere in recent years; however, due to its complex nature, computational approaches to it have been scarce. In this paper, we present the new Us vs. Them dataset, consisting of 6861 Reddit comments annotated for populist attitudes and the first large-scale computational models of this phenomenon. We investigate the relationship between populist mindsets and social groups, as well as a range of emotions typically associated with these. We set a baseline for two tasks associated with populist attitudes and present a set of multi-task learning models that leverage and demonstrate the importance of emotion and group identification as auxiliary tasks.

[1]  Ekaterina Shutova,et al.  The Pragmatics behind Politics: Modelling Metaphor, Framing and Emotion in Political Discourse , 2020, FINDINGS.

[2]  E. Anduiza,et al.  Empowered and enraged: Political efficacy, anger and support for populism in Europe , 2020, European Journal of Political Research.

[3]  Matthijs Rooduijn,et al.  Hot Politics? Affective Responses to Political Rhetoric , 2020, American Political Science Review.

[4]  Preslav Nakov,et al.  FANG: Leveraging Social Context for Fake News Detection Using Graph Representation , 2020, CIKM.

[5]  Helen Yannakoudakis,et al.  Graph-based Modeling of Online Communities for Fake News Detection , 2020, ArXiv.

[6]  Luke Munn,et al.  Angry by design: toxic communication and technical architectures , 2020, Humanities and Social Sciences Communications.

[7]  M. Estellés,et al.  The Educational Implications of Populism, Emotions and Digital Hate Speech: A Dialogue with Scholars from Canada, Chile, Spain, the UK, and the US , 2020, Sustainability.

[8]  Preslav Nakov,et al.  SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020) , 2020, SEMEVAL.

[9]  Alan S. Cowen,et al.  GoEmotions: A Dataset of Fine-Grained Emotions , 2020, ACL.

[10]  Soon-Gyo Jung,et al.  Topic-driven toxicity: Exploring the relationship between online toxicity and news topics , 2020, PloS one.

[11]  Jeremy Blackburn,et al.  The Pushshift Reddit Dataset , 2020, ICWSM.

[12]  R'emi Louf,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[13]  R. Dolan,et al.  What Underlies Political Polarization? A Manifesto for Computational Political Psychology , 2019, Trends in Cognitive Sciences.

[14]  Xavier-Andoni Tibau,et al.  Why Cohen’s Kappa should be avoided as performance measure in classification , 2019, PloS one.

[15]  Helen Yannakoudakis,et al.  Tackling Online Abuse: A Survey of Automated Abuse Detection Methods , 2019, ArXiv.

[16]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[17]  Dan Goldwasser,et al.  Encoding Social Information with Graph Convolutional Networks forPolitical Perspective Detection in News Media , 2019, ACL.

[18]  David P. Redlawsk,et al.  Reprehensible, Laughable: The Role of Contempt in Negative Campaigning , 2019, American Politics Research.

[19]  Benno Stein,et al.  SemEval-2019 Task 4: Hyperpartisan News Detection , 2019, *SEMEVAL.

[20]  Dipanjan Das,et al.  BERT Rediscovers the Classical NLP Pipeline , 2019, ACL.

[21]  C. Reinemann,et al.  The effects of populism as a social identity frame on persuasion and mobilisation: Evidence from a 15‐country experiment , 2019, European Journal of Political Research.

[22]  Isabelle Augenstein,et al.  Issue Framing in Online Discussion Fora , 2019, NAACL.

[23]  Preslav Nakov,et al.  SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval) , 2019, *SEMEVAL.

[24]  Christopher Nguyen.  Emotions and Populist Support , 2019 .

[25]  Hillary Anger Elfenbein,et al.  The primacy of categories in the recognition of 12 emotions in speech prosody across two cultures , 2019, Nature Human Behaviour.

[26]  Limor Gultchin,et al.  Populism in Power Around the World , 2018 .

[27]  Matthijs Rooduijn,et al.  The Paradox of Well-being: Do Unfavorable Socioeconomic and Sociocultural Contexts Deepen or Dampen Radical Left and Right Voting Among the Less Well-Off? , 2018 .

[28]  G. Haddock,et al.  Sharing the Same Political Ideology Yet Endorsing Different Values: Left- and Right-Wing Political Supporters Are More Heterogeneous Than Moderates , 2018, Social Psychological and Personality Science.

[29]  W. Wirth,et al.  The Effects of Right-Wing Populist Communication on Emotions and Cognitions toward Immigrants , 2018, The International Journal of Press/Politics.

[30]  C. Mudde,et al.  Studying Populism in Comparative Perspective: Reflections on the Contemporary and Future Research Agenda , 2018, Comparative Political Studies.

[31]  G. Mazzoleni,et al.  Socially mediated populism: the communicative strategies of political leaders on Facebook , 2018, Palgrave Communications.

[32]  Mai ElSherief,et al.  Hate Lingo: A Target-based Linguistic Analysis of Hate Speech in Social Media , 2018, ICWSM.

[33]  David P. Redlawsk,et al.  Donald Trump, contempt, and the 2016 GOP Iowa Caucuses , 2018 .

[34]  E. Anduiza,et al.  The Emotional Underpinnings of Populism: How Anger and Fear Affect Populist Attitudes , 2017 .

[35]  Christian von Scheve,et al.  Emotional roots of right-wing political populism , 2017 .

[36]  M. Pajnik,et al.  Populist political communication in mediatized society , 2017 .

[37]  Luca Manucci,et al.  Why The Big Picture Matters: Political and Media Populism in Western Europe since the 1970s. , 2017 .

[38]  Claes H. de Vreese,et al.  “They Did It”: The Effects of Emotionalized Blame Attribution in Populist Communication , 2017, Commun. Res..

[39]  Lyle H. Ungar,et al.  Beyond Binary Labels: Political Ideology Prediction of Twitter Users , 2017, ACL.

[40]  Dan Goldwasser,et al.  Leveraging Behavioral and Social Information for Weakly Supervised Collective Classification of Political Discourse on Twitter , 2017, ACL.

[41]  Adrienne Massanari,et al.  #Gamergate and The Fappening: How Reddit’s algorithm, governance, and culture support toxic technocultures , 2017, New Media Soc..

[42]  Noah A. Smith,et al.  Neural Discourse Structure for Text Categorization , 2017, ACL.

[43]  Pippa Norris,et al.  Trump, Brexit, and the Rise of Populism: Economic Have-Nots and Cultural Backlash , 2016 .

[44]  K. Roe,et al.  Leitkultur and discourse hegemonies: German mainstream media coverage on the integration debate between 2009 and 2014 , 2016 .

[45]  Paris Aslanidis.  Is Populism an Ideology? A Refutation and a New Perspective , 2016 .

[46]  Fabrício Benevenuto,et al.  Analyzing the Targets of Hate in Online Social Media , 2016, ICWSM.

[47]  Pete Burnap,et al.  Us and them: identifying cyber hate on Twitter across multiple protected characteristics , 2016, EPJ Data Science.

[48]  Noah A. Smith,et al.  The Media Frames Corpus: Annotations of Frames Across Issues , 2015, ACL.

[49]  Tom Louwerse,et al.  Populists in Parliament: Comparing Left-Wing and Right-Wing Populism in the Netherlands , 2015 .

[50]  Philip Resnik,et al.  Political Ideology Detection Using Recursive Neural Networks , 2014, ACL.

[51]  B. Krämer.  Media Populism: A Conceptual Clarification and Some Theses on its Effects , 2014 .

[52]  K. Scherer,et al.  Appraisal Theories of Emotion: State of the Art and Future Development , 2013 .

[53]  Matthijs Rooduijn,et al.  Measuring Populism: Comparing Two Methods of Content Analysis , 2011 .

[54]  Jacob Ratkiewicz,et al.  Predicting the Political Alignment of Twitter Users , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[55]  Ana-Maria Popescu,et al.  Democrats, republicans and starbucks afficionados: user classification in twitter , 2011, KDD.

[56]  Oliver Christ,et al.  Explaining radical group behavior: Developing emotion and efficacy routes to normative and nonnormative collective action. , 2011, Journal of personality and social psychology.

[57]  John C. Turner,et al.  The story of social identity , 2010 .

[58]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[59]  Ira J. Roseman,et al.  Beat them or ban them: the characteristics and social functions of anger and contempt. , 2007, Journal of personality and social psychology.

[60]  Matt Thomas,et al.  Get out the vote: Determining support or opposition from Congressional floor-debate transcripts , 2006, EMNLP.

[61]  Nicolas Demertzis.  Emotions and Populism , 2006 .

[62]  Anne C. Frenzel,et al.  Emotional intelligence in the context of learning and achievement , 2005 .

[63]  C. Mudde,et al.  The Populist Zeitgeist , 2004, Government and Opposition.

[64]  M. Laver,et al.  Extracting Policy Positions from Political Texts Using Words as Data , 2003, American Political Science Review.

[65]  G. Marcus.  The Sentimental Citizen: Emotion in Democratic Politics , 2002 .

[66]  R. Lazarus.  Relational meaning and discrete emotions. , 2001 .

[67]  Rich Caruana,et al.  Multitask Learning: A Knowledge-Based Source of Inductive Bias , 1993, ICML.

[68]  Yasunori Fujikoshi,et al.  Two-way ANOVA models with unbalanced data , 1993, Discret. Math..

[69]  Craig A. Smith,et al.  Appraisal components, core relational themes, and the emotions , 1993 .

[70]  D. Cicchetti.  Emotion and Adaptation , 1993 .

[71]  P. Ekman.  An argument for basic emotions , 1992 .

[72]  J. G. Carlson,et al.  Psychology of Emotion , 1991 .

[73]  Robert M. Entman,et al.  Framing: Toward Clarification of a Fractured Paradigm , 1993 .

[74]  E. J. Williams.  The Comparison of Regression Variables , 1959 .

[75]  K. Hawkins.  Measuring Populist Discourse : The Global Populism Database , 2022 .