Detecting and understanding moral biases in news

We describe work in progress on detecting and understanding the moral biases of news sources by combining framing theory with natural language processing. First we draw connections between issue-specific frames and moral frames that apply to all issues. Then we analyze the connection between moral frame presence and news source political leaning. We develop and test a simple classification model for detecting the presence of a moral frame, highlighting the need for more sophisticated models. We also discuss some of the annotation and frame detection challenges that can inform future research in this area.

[1]  J. Druckman.  The Decline of the Death Penalty and the Discovery of Innocence , 2008 .

[2]  Noah A. Smith,et al.  The Media Frames Corpus: Annotations of Frames Across Issues , 2015, ACL.

[3]  Elisha Elovic,et al.  Testing and Comparing Computational Approaches for Identifying the Language of Framing in Political News , 2015, NAACL.

[4]  Daan Odijk,et al.  Teaching the Computer to Code Frames in News: Comparing Two Supervised Machine Learning Approaches to Frame Analysis , 2014 .

[5]  William G. Jacoby.  Issue Framing and Public Opinion on Government Spending , 2000 .

[6]  Robert M. Entman,et al.  Framing: Toward Clarification of a Fractured Paradigm , 1993 .

[7]  Amber E. Boydstun,et al.  Identifying Media Frames and Frame Dynamics Within and Across Policy Issues , 2013 .

[8]  Stephen P. Nicholson,et al.  Framing Support for the Supreme Court in the Aftermath of Bush v. Gore , 2003 .

[9]  Héctor Perla.  Explaining Public Support for the Use of Military Force: The Impact of Reference Point Framing and Prospective Decision Making , 2011, International Organization.

[10]  David Lazer,et al.  Exploring the Ideological Nature of Journalists' Social Networks on Twitter and Associations with News Story Content , 2017, ArXiv.

[11]  Rishemjit Kaur,et al.  Quantifying moral foundations from various topics on Twitter conversations , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[12]  S. Valenzuela,et al.  Behavioral Effects of Framing on Social Media Users: How Conflict, Economic, Human Interest, and Morality Frames Drive News Sharing , 2017 .

[13]  Kate M. Johnson,et al.  Morality Between the Lines : Detecting Moral Sentiment In Text , 2016 .

[14]  Lyle H. Ungar,et al.  An Empirical Exploration of Moral Foundations Theory in Partisan News Sources , 2016, LREC.

[15]  T. Rudolph,et al.  Value Conflict, Group Affect, and the Issue of Campaign Finance , 2003 .

[16]  J. Graham,et al.  Moral Foundations Theory: The Pragmatic Validity of Moral Pluralism , 2012 .

[17]  Noah A. Smith,et al.  Neural Discourse Structure for Text Categorization , 2017, ACL.

[18]  J. Graham,et al.  Tracing the threads: How five moral concerns (especially Purity) help explain culture war attitudes , 2012 .

[19]  Philipp Blandfort,et al.  Annotating Social Media Data From Vulnerable Populations: Evaluating Disagreement Between Domain Experts and Graduate Student Annotators , 2019, HICSS.

[20]  Michal Jacovi,et al.  Crowd-sourcing annotation of complex NLU tasks: A case study of argumentative content annotation , 2019, EMNLP.

[21]  Brian A. Nosek,et al.  Liberals and conservatives rely on different sets of moral foundations. , 2009, Journal of personality and social psychology.

[22]  Dan Goldwasser,et al.  Leveraging Behavioral and Social Information for Weakly Supervised Collective Classification of Political Discourse on Twitter , 2017, ACL.

[23]  Dan Goldwasser,et al.  Ideological Phrase Indicators for Classification of Political Discourse Framing on Twitter , 2017, NLP+CSS@ACL.

[24]  Brendan T. O'Connor,et al.  Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks , 2008, EMNLP.

[25]  David Lazer,et al.  A Frame of Mind: Using Statistical Models for Detection of Framing and Agenda Setting Campaigns , 2015, ACL.

[26]  Pietro Perona,et al.  Online crowdsourcing: Rating annotators and obtaining cost-effective labels , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[27]  Robert M. Entman,et al.  Framing American politics , 2005 .

[28]  Noah A. Smith,et al.  Analyzing Framing through the Casts of Characters in the News , 2016, EMNLP.