How Metaphors Impact Political Discourse: A Large-Scale Topic-Agnostic Study Using Neural Metaphor Detection

Metaphors are widely used in political rhetoric as an effective framing device. While the efficacy of specific metaphors such as the war metaphor in political discourse has been documented before, those studies often rely on small number of hand-coded instances of metaphor use. Larger-scale topic-agnostic studies are required to establish the general persuasiveness of metaphors as a device, and to shed light on the broader patterns that guide their persuasiveness. In this paper, we present a large-scale data-driven study of metaphors used in political discourse. We conduct this study on a publicly available dataset of over 85K posts made by 412 US politicians in their Facebook public pages, up until Feb 2017. Our contributions are threefold: we show evidence that metaphor use correlates with ideological leanings in complex ways that depend on concurrent political events such as winning or losing elections; we show that posts with metaphors elicit more engagement from their audience overall even after controlling for various socio-political factors such as gender and political party affiliation; and finally, we demonstrate that metaphoricity is indeed the reason for increased engagement of posts, through a fine-grained linguistic analysis of metaphorical vs. literal usages of 513 words across 70K posts. Metaphorical expressions arise in the presence of systematic metaphorical associations, or conceptual metaphors, mapping one concept or domain to another (Lakoff and Johnson 1980). For instance, when we talk about “curing juvenile delinquency” or “diagnosing corruption”, we view crime (the target domain) in terms of a disease (the source domain) and map various elements of the disease knowledge system to our reasoning about crime. Since recognizing metaphorical expressions is critical in order to correctly interpret their intended meanings, computational approaches to metaphor detection has long been an active area of research in Natural Language Processing (NLP) (Shutova 2010). While recent research has achieved great advances in automatic metaphor detection performance (Gutiérrez et al. 2016; Bulat, Clark, and Shutova 2017; Rei et al. 2017; Gao et al. 2018; Dankers et al. 2019), not much research has investigated whether Copyright © 2021, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved. metaphor detection, when employed at scale, could help answer some of the fundamental questions in social sciences about metaphors and their ability to shape the public discourse. Social scientists have demonstrated the importance of metaphors in political rhetoric — their role as a framing technique (Lakoff 1991; Tannen 1993; Entman 2003), their tendency to elicit stronger emotions than their literal counterparts (Citron and Goldberg 2014), and their effectiveness in influencing decision-making (Thibodeau and Boroditsky 2011). For instance, metaphors help with the framing of an issue by selecting and emphasising its facets that reinforce a particular point of view (Lakoff 1991; Musolff 2000; Lakoff and Wehling 2012). Discussing war as a competitive game emphasizes the victory vs. defeat aspect of war, while neglecting its human cost, a strategy politicians could use to arouse a pro-war sentiment in the public (Lakoff 1991). While the role metaphors play in shaping the public discourse has been documented before, these qualitative studies are often limited to a few specific domains or topics (e.g., the war domain above) and the metaphors used in them. In this paper, aided by a neural network based metaphor detection approach, we present a large-scale domainagnostic study of the effects of metaphors in political discourse. Our study is conducted on a dataset of 85K Facebook status message posts made by 412 US politicians over a period of around nine years. Our three main findings are: • We find that politicians’ rate of metaphor use is correlated with their ideological leanings in complex ways that depend on contemporaneous political events. Specifically, our analysis found that Democratic politicians used significantly more metaphors during the three months immediately after the 2016 election loss, compared to themselves in prior months, as well as to Republican politicians during the same period of time or prior months. • We find that politicians’ posts that include metaphorical language tend to have significantly higher engagement from their audience. The scale of our study enabled us to control for various socio-political factors, such as gender and party affiliation, strengthening our findings compared to prior studies. • We also conduct a finer-grained linguistic analysis that reveals (1) that metaphorical uses of source domain words ar X iv :2 10 4. 03 92 8v 1 [ cs .C L ] 8 A pr 2 02 1 lead to a higher engagement than their literal usage, and (2) aspects of target domains (i.e. specific political issues) that receive a greater engagement when described metaphorically, as compared to literally. To our knowledge, this is the first computational study of this scale on the impact of metaphor use in political communication in a topic-agnostic manner.

[1]  D. Bates,et al.  Newton-Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data , 1988 .

[2]  G. Lakoff Metaphor and War: The Metaphor System Used to Justify War in the Gulf , 1992 .

[3]  Martha Lewis,et al.  Modelling the interplay of metaphor and emotion through multitask learning , 2019, EMNLP.

[4]  G. Lakoff Moral Politics: How Liberals and Conservatives Think , 1996 .

[5]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[6]  Jon M. Kleinberg,et al.  WWW 2009 MADRID! Track: Data Mining / Session: Opinions How Opinions are Received by Online Communities: A Case Study on Amazon.com Helpfulness Votes , 2022 .

[7]  Tomek Strzalkowski,et al.  Robust Extraction of Metaphor from Novel Data , 2013 .

[8]  Jure Leskovec,et al.  What's in a Name? Understanding the Interplay between Titles, Content, and Communities in Social Media , 2013, ICWSM.

[9]  G. Lakoff,et al.  The Little Blue Book: The Essential Guide to Thinking and Talking Democratic , 2012 .

[10]  Dwight L. Bolinger Language – The Loaded Weapon , 1980 .

[11]  Yorick Wilks,et al.  Automatic Metaphor Detection using Large-Scale Lexical Resources and Conventional Metaphor Extraction , 2013 .

[12]  Gözde Özbal,et al.  Exploring Text Virality in Social Networks , 2011, ICWSM.

[13]  Diyi Yang,et al.  Let’s Make Your Request More Persuasive: Modeling Persuasive Strategies via Semi-Supervised Neural Nets on Crowdfunding Platforms , 2019, NAACL.

[14]  Julia Hirschberg,et al.  Charisma perception from text and speech , 2009, Speech Commun..

[15]  D. Schmuck,et al.  What drives interaction in political actors’ Facebook posts? Profile and content predictors of user engagement and political actors’ reactions , 2019 .

[16]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[17]  Yulia Tsvetkov,et al.  RtGender: A Corpus for Studying Differential Responses to Gender , 2018, LREC.

[18]  Adele E. Goldberg,et al.  Metaphorical Sentences Are More Emotionally Engaging than Their Literal Counterparts , 2014, Journal of Cognitive Neuroscience.

[19]  Florian Michahelles,et al.  Online engagement factors on Facebook brand pages , 2013, Social Network Analysis and Mining.

[20]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[21]  Owen Rambow,et al.  Staying on Topic: An Indicator of Power in Political Debates , 2014, EMNLP.

[22]  Gerard J. Steen,et al.  A method for linguistic metaphor identification : from MIP to MIPVU , 2010 .

[23]  Ralph Weischedel,et al.  Automatic Extraction of Linguistic Metaphors with LDA Topic Modeling , 2013 .

[24]  Yulia Tsvetkov,et al.  Metaphor Detection with Cross-Lingual Model Transfer , 2014, ACL.

[25]  L. Cameron Metaphor in Educational Discourse , 2003 .

[26]  Jon M. Kleinberg,et al.  You Had Me at Hello: How Phrasing Affects Memorability , 2012, ACL.

[27]  Ekaterina Shutova,et al.  Metaphor Identification as Interpretation , 2013, *SEMEVAL.

[28]  Ekaterina Shutova,et al.  Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection , 2017, EMNLP.

[29]  Ekaterina Shutova,et al.  Models of Metaphor in NLP , 2010, ACL.

[30]  Andreas Musolff,et al.  Mirror Images of Europe: Metaphors in the Public Debate About Europe in Britain and Germany , 2000 .

[31]  Carlos Muñiz,et al.  Engagement of politicians and citizens in the cyber campaign on Facebook: a comparative analysis between Mexico and Spain , 2019 .

[32]  Jonathan Dunn,et al.  Evaluating the Premises and Results of Four Metaphor Identification Systems , 2013, CICLing.

[33]  Tyler Marghetis,et al.  Literal and Metaphorical Senses in Compositional Distributional Semantic Models , 2016, ACL.

[34]  Dorée D. Seligmann,et al.  Who Had the Upper Hand? Ranking Participants of Interactions Based on Their Relative Power , 2013, IJCNLP.

[35]  Saif Mohammad,et al.  Metaphor as a Medium for Emotion: An Empirical Study , 2016, *SEMEVAL.

[36]  Beata Beigman Klebanov,et al.  Semantic classifications for detection of verb metaphors , 2016, ACL.

[37]  Stephen Clark,et al.  Modelling metaphor with attribute-based semantics , 2017, EACL.

[38]  Jean Maillard,et al.  Black Holes and White Rabbits: Metaphor Identification with Visual Features , 2016, NAACL.

[39]  L. Boroditsky,et al.  Metaphors We Think With: The Role of Metaphor in Reasoning , 2011, PloS one.

[40]  Eunsol Choi,et al.  Neural Metaphor Detection in Context , 2018, EMNLP.

[41]  Michael Mohler,et al.  Semantic Signatures for Example-Based Linguistic Metaphor Detection , 2013 .

[42]  Yair Neuman,et al.  Literal and Metaphorical Sense Identification through Concrete and Abstract Context , 2011, EMNLP.

[43]  L. Elizabeth Crawford,et al.  Conceptual Metaphors of Affect , 2009 .

[44]  Bo Pang,et al.  The effect of wording on message propagation: Topic- and author-controlled natural experiments on Twitter , 2014, ACL.

[45]  Carolyn Penstein Rosé,et al.  Finding Structure in Figurative Language: Metaphor Detection with Topic-based Frames , 2017, SIGDIAL Conference.

[46]  Deborah Tannen,et al.  Framing in Discourse , 1993 .

[47]  Carlo Strapparava,et al.  Trusting Politicians' Words (for Persuasive NLP) , 2008, CICLing.

[48]  Ekaterina Shutova,et al.  Computational approaches to figurative language , 2011 .

[49]  Mark Johnson,et al.  An Improved Non-monotonic Transition System for Dependency Parsing , 2015, EMNLP.