Political relevance in the eye of the beholder: Determining the substantiveness of TV shows and political debates with Twitter data

Addressing the call to move beyond a simple genre classification of TV shows as either substantive (hard) news or non-substantive (soft) infotainment, we propose using social media reactions to determine a program’s political relevance. Such an approach provides information that goes beyond genre or content characteristics and reflects what really reaches an audience. Analyzing tweets about two Dutch talk shows and four U.S. primary debates, we show that audience responses to television programs differ considerably regarding their political relevance. Thereby, we demonstrate how examining online audience reactions can be employed as a sophisticated and valid way to assess the political relevance of TV programs.

[1]  Daniel Gayo-Avello,et al.  A Meta-Analysis of State-of-the-Art Electoral Prediction From Twitter Data , 2012, ArXiv.

[2]  Lukas Otto,et al.  The Softening of Journalistic Political Communication—A Critical Review of Sensationalism, Soft News, Infotainment, and Tabloidization and a Comprehensive Framework Model , 2016 .

[3]  Mark Boukes,et al.  Soft News With Hard Consequences? Introducing a Nuanced Measure of Soft Versus Hard News Exposure and Its Relationship With Political Cynicism , 2015, Commun. Res..

[4]  John Mcmanus,et al.  A Market-Based Model of News Production , 1995 .

[5]  Paul Dekker,et al.  Gescheiden werelden? : Een verkenning van sociaal-culturele tegenstellingen in Nederland , 2014 .

[6]  Scott L. Althaus What's Good and Bad in Political Communication Research? Normative Standards for Evaluating Media and Citizen Performance , 2011 .

[7]  D. Trilling Two Different Debates? Investigating the Relationship Between a Political Debate on TV and Simultaneous Comments on Twitter , 2015 .

[8]  Michel M. Haigh,et al.  Late-Night Iraq: Monologue Joke Content and Tone From 2003 to 2007 , 2010 .

[9]  Trilling,et al.  UvA-DARE (Digital Academic Repository) Investigating people’s news diets: how online news users use offline news , 2015 .

[10]  Evelien D'heer,et al.  Second screen applications and tablet users: constellation, awareness, experience, and interest , 2012, EuroITV.

[11]  Jason Rittenberg,et al.  Media Preferences and Democracy: Refining the “Relative Entertainment Preference” Hypothesis , 2012 .

[12]  Piet J. M. Bakker,et al.  Communicatiekaart van Nederland: overzicht van media en communicatie. - 8e dr. , 2011 .

[13]  Damian Trilling,et al.  Taking Stock of the Toolkit , 2016, Rethinking Research Methods in an Age of Digital Journalism.

[14]  David A. Shamma,et al.  Tweet the debates: understanding community annotation of uncollected sources , 2009, WSM@MM.

[15]  Bruce A. Williams,et al.  After Broadcast News: Media Regimes, Democracy, and the New Information Environment , 2011 .

[16]  Isabell M. Welpe,et al.  Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment , 2010, ICWSM.

[17]  Julia R. Fox,et al.  No Joke: A Comparison of Substance in The Daily Show with Jon Stewart and Broadcast Network Television Coverage of the 2004 Presidential Election Campaign , 2007 .

[18]  David A. Shamma,et al.  Tweetgeist : Can the Twitter Timeline Reveal the Structure of Broadcast Events ? , 2009 .

[19]  Barbie Zelizer Introduction: On Finding New Ways of Thinking About Journalism , 2007 .

[20]  Paul Rayson,et al.  Comparing Corpora using Frequency Profiling , 2000, Proceedings of the workshop on Comparing corpora -.

[21]  S. Lehman-Wilzig,et al.  Hard news, soft news, ‘general’ news: The necessity and utility of an intermediate classification , 2010 .

[22]  Alec C. Tefertiller,et al.  With or without you: Connected viewing and co-viewing Twitter activity for traditional appointment and asynchronous broadcast television models , 2015, First Monday.

[23]  T. P. Bakker,et al.  Citizens as political participants: The myth of the active online audience? , 2013 .

[24]  Barry A. Hollander Tuned Out: Why Americans under 40 Don't Follow the News , 2005 .

[25]  Julia R. Fox,et al.  Hype Versus Substance in Network Television Coverage of Presidential Election Campaigns , 2005 .

[26]  P. Franses,et al.  Live audience responses to live televised election debates: time series analysis of issue salience and party salience on audience behavior , 2016 .

[27]  Adrian Rauchfleisch,et al.  The Swiss “Tina Fey Effect”: The Content of Late-Night Political Humor and the Negative Effects of Political Parody on the Evaluation of Politicians , 2013 .

[28]  Arzucan Özgür,et al.  Identifying Topics in Microblogs Using Wikipedia , 2016, PloS one.

[29]  W. de Nooy,et al.  When do attacks work? Moderated effects on voters’ candidate evaluation in a televised debate , 2015 .

[30]  Klaus Schoenbach,et al.  Interest in News and Politics—or Situational Determinants? Why People Watch the News , 2011 .

[31]  Jürgen Gerhards,et al.  Four models of the public sphere in modern democracies , 2002 .

[32]  James Stanyer,et al.  Hard and soft news: A review of concepts, operationalizations and key findings , 2012 .

[33]  M. Just Soft News Goes to War: Public Opinion and American Foreign Policy in the New Media Age , 2006, Perspectives on Politics.

[34]  Bernhard Rieder,et al.  Programmed method: developing a toolset for capturing and analyzing tweets , 2014, Aslib J. Inf. Manag..

[35]  Linda Bos,et al.  Gescheiden media? Sociaal-culturele verschillen in mediaconsumptie , 2014 .

[36]  Evelien D'heer,et al.  What social media data mean for audience studies: a multidimensional investigation of Twitter use during a current affairs TV programme , 2015 .

[37]  David A. Shamma,et al.  Characterizing debate performance via aggregated twitter sentiment , 2010, CHI.

[38]  William L. Benoit,et al.  A meta-analysis of the effects of viewing U.S. presidential debates , 2003 .

[39]  Christopher Buschow,et al.  Tweeting television: Exploring communication activities on Twitter while watching TV , 2014 .

[40]  C. Puschmann Analyzing political communication with digital trace data: the role of twitter messages in social science research , 2016 .

[41]  A. L. Peeters,et al.  Arousing News Characteristics in Dutch Television News 1990–2004: An Exploration of Competitive Strategies , 2010 .

[42]  Frank M. Schneider,et al.  Seriously Entertained: Antecedents and Consequences of Hedonic and Eudaimonic Entertainment Experiences With Political Talk Shows on TV , 2014 .

[43]  Andreas Jungherr,et al.  Digital Trace Data in the Study of Public Opinion , 2017 .

[44]  White Paper on Televised Political Campaign Debates , 2002 .