How Readers Understand Causal and Correlational Expressions Used in News Headlines

Science-related news stories can have a profound impact on how the public make decisions. The current study presents 4 experiments that examine how participants understand scientific expressions used in news headlines. The expressions concerned causal and correlational relationships between variables (e.g., “being breast fed makes children behave better”). Participants rated or ranked headlines according to the extent that one variable caused the other. Our results suggest that participants differentiate between 3 distinct categories of relationship: direct cause statements (e.g., “makes,” “increases”), which were interpreted as the most causal; can cause statements (e.g., “can make,” “can increase”); and moderate cause statements (e.g., “might cause,” “linked,” “associated with”), but do not consistently distinguish within the last group despite the logical distinction between cause and association. On the basis of this evidence, we make recommendations for appropriately communicating cause and effect in news headlines.

[1]  Connie A. Korpan,et al.  University Students' Interpretation of Media Reports of Science and its Relationship to Background Knowledge, Interest, and Reading Difficulty , 2003 .

[2]  A. Avramides Studies in the Way of Words , 1992 .

[3]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[4]  N. Allum,et al.  Science in Society: Re-Evaluating the Deficit Model of Public Attitudes , 2004 .

[5]  Jean M. Brechman,et al.  Lost in Translation? , 2009, Science communication.

[6]  Steven Woloshin,et al.  Press Releases by Academic Medical Centers: Not So Academic? , 2009, Annals of Internal Medicine.

[7]  B. Goldacre,et al.  The quality of the evidence for dietary advice given in UK national newspapers , 2012, Public understanding of science.

[8]  Daniel Dor,et al.  On newspaper headlines as relevance optimizers , 2003 .

[9]  Gary Schwitzer,et al.  How Do US Journalists Cover Treatments, Tests, Products, and Procedures? An Evaluation of 500 Stories , 2008, PLoS medicine.

[10]  Zoltan Dienes,et al.  Using Bayes to get the most out of non-significant results , 2014, Front. Psychol..

[11]  M. Ramsay Measles: the legacy of low vaccine coverage , 2013, Archives of Disease in Childhood.

[12]  Petroc Sumner,et al.  The association between exaggeration in health related science news and academic press releases: retrospective observational study , 2014, BMJ : British Medical Journal.

[13]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[14]  Ullrich K. H. Ecker,et al.  The effects of subtle misinformation in news headlines. , 2014, Journal of experimental psychology. Applied.

[15]  April Bleske-Rechek,et al.  Causal Inference from Descriptions of Experimental and Non-Experimental Research: Public Understanding of Correlation-Versus-Causation , 2015, The Journal of general psychology.

[16]  Jason L. G. Braasch,et al.  Processing Inaccurate Information: Theoretical and Applied Perspectives from Cognitive Science and the Educational Sciences , 2014 .

[17]  D. Allison,et al.  Use of Causal Language in Observational Studies of Obesity and Nutrition , 2010, Obesity Facts.

[18]  Petroc Sumner,et al.  Exaggerations and Caveats in Press Releases and Health-Related Science News , 2016, PloS one.

[19]  Ullrich K. H. Ecker,et al.  Misinformation and Its Correction , 2012, Psychological science in the public interest : a journal of the American Psychological Society.

[20]  Ullrich K. H. Ecker,et al.  Correcting misinformation—A challenge for education and cognitive science. , 2014 .

[21]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[22]  J. Kitzinger Framing Abuse: Media Influence and Public Understanding of Sexual Violence Against Children , 2004 .

[23]  S. Duffy,et al.  Degree of causal relatedness and memory , 1987 .

[24]  M. Pickering,et al.  What are implicit causality and consequentiality? , 2007 .

[25]  Heather M. Coon,et al.  Undergraduates’ Ability to Recognize Correlational and Causal Language Before and After Explicit Instruction , 2013 .

[26]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[27]  I. Boutron,et al.  Interpretation of Results of Studies Evaluating an Intervention Highlighted in Google Health News: A Cross-Sectional Study of News , 2015, PloS one.

[28]  Brian Leveson An inquiry into the culture, practices and ethics of the press , 2012 .

[29]  A. White MAKING SENSE OF STATISTICS , 2001 .

[30]  R. Hastie,et al.  Causal knowledge and categories: the effects of causal beliefs on categorization, induction, and similarity. , 2001, Journal of experimental psychology. General.

[31]  Stephen P. Norris,et al.  Interpreting pragmatic meaning when reading popular reports of science , 1994 .

[32]  Philip M. Newton,et al.  When Medical News Comes from Press Releases—A Case Study of Pancreatic Cancer and Processed Meat , 2015, PloS one.

[33]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[34]  Graeme Kennedy 4. Variation in the distribution of modal verbs in the British National Corpus , 2002 .

[35]  Isabelle Boutron,et al.  Misrepresentation of Randomized Controlled Trials in Press Releases and News Coverage: A Cohort Study , 2012, PLoS medicine.

[36]  Isabelle Boutron,et al.  Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention , 2015, BMC Medical Research Methodology.

[37]  Douglas Biber,et al.  Using corpora to explore linguistic variation , 2002 .

[38]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .

[39]  Z. Dienes Bayesian Versus Orthodox Statistics: Which Side Are You On? , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[40]  Thomas Boraud,et al.  Misrepresentation of Neuroscience Data Might Give Rise to Misleading Conclusions in the Media: The Case of Attention Deficit Hyperactivity Disorder , 2011, PloS one.

[41]  誼余夫 波多野,et al.  Young children's naive thinking about the biological world , 2002 .

[42]  D. Budescu,et al.  Consistency in interpretation of probabilistic phrases , 1985 .