Self-Reported Versus Digitally Recorded: Measuring Political Activity on Facebook

Facebook has been credited with expanding political activity by simultaneously lowering barriers to participation and creating new ways to engage. However, many of these findings rely on subjects’ abilities to accurately report their Facebook use and political activity on the platform. This study combines survey responses and digital trace data from 828 American adults to determine whether subjects over- or underreport a range of political activities on Facebook, including whether they like political pages or share news links. The results show that individuals underestimate their frequency of status posting and overestimate their frequency of sharing news links on Facebook. Political interest is associated with a decrease in underreporting several political activities, while increasing the likelihood of overreporting the frequency of sharing news links. Furthermore, political interest serves a moderating effect, improving self-reports for high-volume users. The findings suggest that political interest not only predicts political activity but also shapes awareness of that activity and improves self-reports among heavy users.

[1]  Deen Freelon,et al.  On the Interpretation of Digital Trace Data in Communication and Social Computing Research , 2014 .

[2]  Maeve Duggan,et al.  Social Media Update 2016 , 2016 .

[3]  Andreas Jungherr,et al.  Normalizing Digital Trace Data , 2018, Digital Discussions.

[4]  N. Schwarz,et al.  Asking Questions About Behavior: Cognition, Communication, and Questionnaire Construction , 2001 .

[5]  Panagiotis G. Ipeirotis,et al.  Demographics and Dynamics of Mechanical Turk Workers , 2018, WSDM.

[6]  Bruce Bimber,et al.  Digital Media and Political Participation , 2015 .

[7]  Anamaria Dutceac Segesten,et al.  Political participation on Facebook during Brexit: Does user engagement on media pages stimulate engagement with campaigns? , 2018 .

[8]  W. Bennett,et al.  Communicating Civic Engagement: Contrasting Models of Citizenship in the Youth Web Sphere , 2011 .

[9]  Michael Jensen,et al.  Parsimonious data: How a single Facebook like predicts voting behavior in multiparty systems , 2017, PloS one.

[10]  D. Boyd,et al.  CRITICAL QUESTIONS FOR BIG DATA , 2012 .

[11]  Luisa Doldi,et al.  Civic Life Online: Learning How Digital Media Can Engage Youth , 2009 .

[12]  Andreas Jungherr,et al.  Forecasting the pulse: How deviations from regular patterns in online data can identify offline phenomena , 2013, Internet Res..

[13]  M. Prior,et al.  Improving Media Effects Research through Better Measurement of News Exposure , 2009, The Journal of Politics.

[14]  Jeffrey Boase,et al.  No Such Effect? The Implications of Measurement Error in Self-Report Measures of Mobile Communication Use , 2012 .

[15]  H. G. D. Zúñiga,et al.  Social Media, Political Expression, and Political Participation: Panel Analysis of Lagged and Concurrent Relationships , 2014 .

[16]  D. Stolle,et al.  The Internet and new modes of political participation: online versus offline participation , 2014 .

[17]  Anna L. Cox,et al.  Estimating Usage Can Reduce the Stress of Social Networking , 2013 .

[18]  Isidoropaolo Casteltrione.  Facebook and political participation: Virtuous circle and participation intermediaries , 2016 .

[19]  Henry E. Brady,et al.  Weapon of the Strong? Participatory Inequality and the Internet , 2010, Perspectives on Politics.

[20]  Cliff Lampe,et al.  It's Complicated: Facebook Users' Political Participation in the 2008 Election , 2011, Cyberpsychology Behav. Soc. Netw..

[21]  M. Prior,et al.  You’ve Either Got It or You Don’t? The Stability of Political Interest over the Life Cycle , 2010 .

[22]  Henry E. Brady,et al.  Voice and Equality: Civic Voluntarism in American Politics , 1996 .

[23]  Jennifer Gibbs,et al.  Social media as a catalyst for online deliberation? Exploring the affordances of Facebook and YouTube for political expression , 2013, Comput. Hum. Behav..

[24]  Aaron S. Veenstra,et al.  Digital Democracy: Reimagining Pathways to Political Participation , 2010 .

[25]  Michael Scharkow,et al.  The Accuracy of Self-Reported Internet Use—A Validation Study Using Client Log Data , 2016 .

[26]  Kevin Crowston,et al.  Validity Issues in the Use of Social Network Analysis with Digital Trace Data , 2011, J. Assoc. Inf. Syst..

[27]  Emily K. Vraga,et al.  Blurred lines: Defining social, news, and political posts on Facebook , 2016 .

[28]  K. H. Kwon,et al.  Unspeaking on Facebook? Testing network effects on self-censorship of political expressions in social network sites , 2015 .

[29]  Robert M. Bond,et al.  Quantifying Social Media’s Political Space: Estimating Ideology from Publicly Revealed Preferences on Facebook , 2015, American Political Science Review.

[30]  R. Gibson,et al.  Conceptualizing and Measuring Participation in the Age of the Internet: Is Online Political Engagement Really Different to Offline? , 2013 .

[31]  Birk Diedenhofen,et al.  cocor: A Comprehensive Solution for the Statistical Comparison of Correlations , 2015, PloS one.

[32]  Melanie Revilla,et al.  Using Passive Data From a Meter to Complement Survey Data in Order to Study Online Behavior , 2017 .

[33]  Rich Ling,et al.  Measuring Mobile Phone Use: Self-Report Versus Log Data , 2013, J. Comput. Mediat. Commun..

[34]  Shelley Boulianne.  Social media use and participation: a meta-analysis of current research , 2015 .

[35]  Lada A. Adamic,et al.  Exposure to ideologically diverse news and opinion on Facebook , 2015, Science.

[36]  Peter Dahlgren.  The Internet, Public Spheres, and Political Communication: Dispersion and Deliberation , 2005 .

[37]  Andreas Jungherr.  Analyzing Political Communication with Digital Trace Data: The Role of Twitter Messages in Social Science Research , 2015 .

[38]  Peter Neijens,et al.  How Much Time Do You Spend Online? Understanding and Improving the Accuracy of Self-Reported Measures of Internet Use , 2017 .

[39]  What is Political Participation , 2016 .

[40]  Chris Wells,et al.  Combining Big Data and Survey Techniques to Model Effects of Political Content Flows in Facebook , 2017 .

[41]  John E. Hunter,et al.  Theory Testing and Measurement Error. , 1999 .

[42]  D. Karpf.  SOCIAL SCIENCE RESEARCH METHODS IN INTERNET TIME , 2012 .

[43]  W. Bennett.  Changing Citizenship in the Digital Age , 2008 .

[44]  B. Nyhan,et al.  Selective exposure to misinformation: Evidence from the consumption of fake news during the 2016 U.S. presidential campaign , 2018 .

[45]  Reynol Junco,et al.  Comparing actual and self-reported measures of Facebook use , 2013, Comput. Hum. Behav..