Controlled Neural Sentence-Level Reframing of News Articles

Framing a news article means to portray the reported event from a specific perspective, e.g., from an economic or a health perspective. Reframing means to change this perspective. Depending on the audience or the submessage, reframing can become necessary to achieve the desired effect on the readers. Reframing is related to adapting style and sentiment, which can be tackled with neural text generation techniques. However, it is more challenging since changing a frame requires rewriting entire sentences rather than single phrases. In this paper, we study how to computationally reframe sentences in news articles while maintaining their coherence to the context. We treat reframing as a sentence-level fill-in-the-blank task for which we train neural models on an existing media frame corpus. To guide the training, we propose three strategies: framed-language pretraining, named-entity preservation, and adversarial learning. We evaluate respective models automatically and manually for topic consistency, coherence, and successful reframing. Our results indicate that generating properlyframed text works well but with tradeoffs.

[1]  Wei-Fan Chen,et al.  Analyzing Political Bias and Unfairness in News Articles at Different Levels of Granularity , 2020, NLPCSS.

[2]  Robert M. Entman,et al.  Framing: Toward Clarification of a Fractured Paradigm , 1993 .

[3]  Lysandre Debut,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[4]  Smaranda Muresan,et al.  ENTRUST: Argument Reframing with Language Models and Entailment , 2021, NAACL.

[5]  Noah A. Smith,et al.  The Media Frames Corpus: Annotations of Frames Across Issues , 2015, ACL.

[6]  Benno Stein,et al.  Learning to Flip the Bias of News Headlines , 2018, INLG.

[7]  Benno Stein,et al.  Modeling Frames in Argumentation , 2019, EMNLP.

[8]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[9]  Noah A. Smith,et al.  Plug and Play Autoencoders for Conditional Text Generation , 2020, EMNLP.

[10]  W. Gamson,et al.  Media Discourse and Public Opinion on Nuclear Power: A Constructionist Approach , 1989, American Journal of Sociology.

[11]  Wei-Fan Chen,et al.  Detecting Media Bias in News Articles using Gaussian Bias Distributions , 2020, FINDINGS.

[12]  Carsten Eickhoff,et al.  Are "Undocumented Workers" the Same as "Illegal Aliens"? Disentangling Denotation and Connotation in Vector Spaces , 2020, ArXiv.

[13]  R. Sellars Rhetoric , 1996, The Classical Review.

[14]  Matthew Shardlow,et al.  A Survey of Automated Text Simplification , 2014 .

[15]  Trevor Cohn,et al.  Framing Unpacked: A Semi-Supervised Interpretable Multi-View Model of Media Frames , 2021, NAACL.

[16]  Regina Barzilay,et al.  Educating Text Autoencoders: Latent Representation Guidance via Denoising , 2020, ICML.

[17]  Regina Barzilay,et al.  Style Transfer from Non-Parallel Text by Cross-Alignment , 2017, NIPS.

[18]  Graeme Hirst,et al.  Classifying Frames at the Sentence Level in News Articles , 2017, RANLP.

[19]  Isabelle Augenstein,et al.  Issue Framing in Online Discussion Fora , 2019, NAACL.

[20]  Amber E. Boydstun,et al.  Identifying Media Frames and Frame Dynamics Within and Across Policy Issues , 2013 .

[21]  Colin Raffel,et al.  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer , 2019, J. Mach. Learn. Res..

[22]  C. D. Vreese,et al.  News framing: Theory and typology , 2005 .

[23]  James N. Druckman,et al.  F RAMING T HEORY , 2007 .