OpenFraming: Open-sourced Tool for Computational Framing Analysis of Multilingual Data

When journalists cover a news story, they can cover the story from multiple angles or perspectives. These perspectives are called “frames,” and usage of one frame or another may influence public perception and opinion of the issue at hand. We develop a web-based system for analyzing frames in multilingual text documents. We propose and guide users through a five-step end-to-end computational framing analysis framework grounded in media framing theory in communication research. Users can use the framework to analyze multilingual text data, starting from the exploration of frames in user’s corpora and through review of previous framing literature (step 1-3) to frame classification (step 4) and prediction (step 5). The framework combines unsupervised and supervised machine learning and leverages a state-of-the-art (SoTA) multilingual language model, which can significantly enhance frame prediction performance while requiring a considerably small sample of manual annotations. Through the interactive website, anyone can perform the proposed computational framing analysis, making advanced computational analysis available to researchers without a programming background and bridging the digital divide within the communication research discipline in particular and the academic community in general. The system is available online at http://www.openframing.org, via an API http://www.openframing.org:5000/docs/, or through our GitHub page https://github.com/vibss2397/openFraming.

[1]  Mohammad Sadegh Rasooli,et al.  Cultural and Geographical Influences on Image Translatability of Words across Languages , 2021, NAACL.

[2]  Mohammad Sadegh Rasooli,et al.  "Wikily" Neural Machine Translation Tailored to Cross-Lingual Tasks , 2021, ArXiv.

[3]  Kate K. Mays,et al.  What Makes Gun Violence a (Less) Prominent Issue? A Computational Analysis of Compelling Arguments and Selective Agenda Setting , 2021, Mass Communication and Society.

[4]  Derry Tanti Wijaya,et al.  IndoCollex: A Testbed for Morphological Transformation of Indonesian Word Colloquialism , 2021, FINDINGS.

[5]  Margrit Betke,et al.  Multi-Label and Multilingual News Framing Analysis , 2020, ACL.

[6]  Felix Hamborg,et al.  Media Bias, the Social Sciences, and NLP: Automating Frame Analyses to Identify Bias by Word Choice and Labeling , 2020, ACL.

[7]  Lieven De Marez,et al.  (What) Can Journalism Studies Learn from Supervised Machine Learning? , 2020, Journalism Studies.

[8]  Bryan A. Plummer,et al.  Learning to Scale Multilingual Representations for Vision-Language Tasks , 2020, ECCV.

[9]  Noah A. Smith,et al.  Social Bias Frames: Reasoning about Social and Power Implications of Language , 2019, ACL.

[10]  Myle Ott,et al.  Unsupervised Cross-lingual Representation Learning at Scale , 2019, ACL.

[11]  Bryan A. Plummer,et al.  MULE: Multimodal Universal Language Embedding , 2019, AAAI.

[12]  BIG SOCIAL DATA ANALYTICS 1 Big Social Data Analytics in Journalism and Mass Communication: Comparing Dictionary-based Text Analysis and Unsupervised Topic Modeling , 2020 .

[13]  Margrit Betke,et al.  Detecting Frames in News Headlines and Its Application to Analyzing News Framing Trends Surrounding U.S. Gun Violence , 2019, CoNLL.

[14]  Jakob-Moritz Eberl,et al.  Computational Communication Science| When the Journey Is as Important as the Goal: A Roadmap to Multilingual Dictionary Construction , 2019 .

[15]  Andrew McCallum,et al.  Energy and Policy Considerations for Deep Learning in NLP , 2019, ACL.

[16]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[17]  Yulia Tsvetkov,et al.  Framing and Agenda-setting in Russian News: a Computational Analysis of Intricate Political Strategies , 2018, EMNLP.

[18]  Chris Callison-Burch,et al.  Learning Translations via Images with a Massively Multilingual Image Dataset , 2018, ACL.

[19]  Wouter van Atteveldt,et al.  When Communication Meets Computation: Opportunities, Challenges, and Pitfalls in Computational Communication Science , 2018 .

[20]  Silke Adam,et al.  Applying LDA Topic Modeling in Communication Research: Toward a Valid and Reliable Methodology , 2018 .

[21]  Viorela Dan Integrative Framing Analysis: Framing Health through Words and Visuals , 2017 .

[22]  Antal Wozniak,et al.  Global Multimodal News Frames on Climate Change , 2016 .

[23]  Khalil Sima'an,et al.  A Shared Task on Multimodal Machine Translation and Crosslingual Image Description , 2016, WMT.

[24]  Thomas E. Powell,et al.  A Clearer Picture: The Contribution of Visuals and Text to Framing Effects , 2015 .

[25]  Kevin Drakulich,et al.  Explicit and Hidden Racial Bias in the Framing of Social Problems , 2015 .

[26]  Noah A. Smith,et al.  The Media Frames Corpus: Annotations of Frames Across Issues , 2015, ACL.

[27]  R. Coleman,et al.  Image and Emotion in Voter Decisions: The Affect Agenda , 2015 .

[28]  A. Arvidsson,et al.  Echo Chamber or Public Sphere? Predicting Political Orientation and Measuring Political Homophily in Twitter Using Big Data , 2014 .

[29]  Shahira S Fahmy,et al.  Analyzing the Spell of War: A War/Peace Framing Analysis of the 2009 Visual Coverage of the Sri Lankan Civil War in Western Newswires , 2012 .

[30]  Matthew C. Nisbet,et al.  Knowledge Into Action: Framing the Debates Over Climate Change and Poverty , 2010 .

[31]  Thomas A. Birkland,et al.  Media Framing and Policy Change After Columbine , 2009 .

[32]  Ingo Rohlfing,et al.  What You See and What You Get , 2008 .

[33]  Stephen D. Reese The Framing Project: A Bridging Model for Media Research Revisited , 2007 .

[34]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[35]  James W. Dearing,et al.  Framing Public Life: Perspectives on Media and Our Understanding of the Social World , 2002 .

[36]  P. Messaris,et al.  The Role of Images in Framing News Stories , 2001 .

[37]  August E. Grant,et al.  Prologue—Framing Public Life: A Bridging Model for Media Research , 2001 .

[38]  Karen Callaghan, Frauke Schnell,et al.  Assessing the Democratic Debate: How the News Media Frame Elite Policy Discourse , 2001 .

[39]  P. Valkenburg,et al.  Framing European politics: a content analysis of press and television news , 2000 .

[40]  Stephen D. Reese,et al.  Mediating the Message: Theories of Influences on Mass Media Content , 1995 .

[41]  Ann N. Crigler,et al.  Common Knowledge: News and the Construction of Political Meaning. , 1993 .

[42]  Robert M. Entman,et al.  Framing: Toward Clarification of a Fractured Paradigm , 1993 .

[43]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .