Communicating scientific uncertainty

All science has uncertainty. Unless that uncertainty is communicated effectively, decision makers may put too much or too little faith in it. The information that needs to be communicated depends on the decisions that people face. Are they (i) looking for a signal (e.g., whether to evacuate before a hurricane), (ii) choosing among fixed options (e.g., which medical treatment is best), or (iii) learning to create options (e.g., how to regulate nanotechnology)? We examine these three classes of decisions in terms of how to characterize, assess, and convey the uncertainties relevant to each. We then offer a protocol for summarizing the many possible sources of uncertainty in standard terms, designed to impose a minimal burden on scientists, while gradually educating those whose decisions depend on their work. Its goals are better decisions, better science, and better support for science.

[1]  H. Brachinger,et al.  Decision analysis , 1997 .

[2]  D. Altman,et al.  Assessing Risk of Bias in Included Studies , 2008 .

[3]  F. Mosteller,et al.  Reporting standards and research strategies for controlled trials , 1980 .

[4]  I. Erev,et al.  Verbal versus numerical probabilities: Efficiency, biases, and the preference paradox☆ , 1990 .

[5]  M. G. Morgan,et al.  Subjective judgments by climate experts. , 1995, Environmental science & technology.

[6]  Jacob Cohen,et al.  The statistical power of abnormal-social psychological research: a review. , 1962, Journal of abnormal and social psychology.

[7]  Prior Storm Experience Moderates Water Surge Perception and Risk , 2013, PloS one.

[8]  H. Welch,et al.  Women's understanding of the mammography screening debate. , 2000, Archives of internal medicine.

[9]  Baruch Fischhoff,et al.  Analyzing disaster risks and plans: An avian flu example , 2006 .

[10]  Baruch Fischhoff,et al.  The sciences of science communication , 2013, Proceedings of the National Academy of Sciences.

[11]  V. Reyna.  A new intuitionism: Meaning, memory, and development in Fuzzy-Trace Theory. , 2012, Judgment and decision making.

[12]  Elizabeth A. Casman,et al.  An Integrated Risk Model of a Drinking‐Water – Borne Cryptosporidiosis Outbreak , 2000, Risk analysis : an official publication of the Society for Risk Analysis.

[13]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[14]  Ali Balaid,et al.  Knowledge maps: A systematic literature review and directions for future research , 2016, Int. J. Inf. Manag..

[15]  A. H. Murphy,et al.  Misinterpretations of precipitation probability forecasts , 1980 .

[16]  Cosma Rohilla Shalizi,et al.  Philosophy and the practice of Bayesian statistics. , 2010, The British journal of mathematical and statistical psychology.

[17]  Amnon Rapoport,et al.  Structures in the subjective lexicon , 1971 .

[18]  David V. Budescu,et al.  Improving Communication of Uncertainty in the Reports of the Intergovernmental Panel on Climate Change , 2009, Psychological science.

[19]  D. Angus,et al.  Sources of non-compliance with clinical practice guidelines in trauma triage: a decision science study , 2012, Implementation Science.

[20]  Mitchell J. Small,et al.  Climate Change and Cryptosporidiosis: A Qualitative Analysis , 2001 .

[21]  Susan T. Fiske,et al.  Gaining trust as well as respect in communicating to motivated audiences about science topics , 2014, Proceedings of the National Academy of Sciences.

[22]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[23]  F. J. Roethlisberger,et al.  Management and the Worker , 1941 .

[24]  Teddy Seidenfeld.  Why I am not an objective Bayesian; some reflections prompted by Rosenkrantz , 1979 .

[25]  James D. Brown,et al.  Uncertainty and Risk , 2009 .

[26]  J. Baron,et al.  Outcome bias in decision evaluation. , 1988, Journal of personality and social psychology.

[27]  B. Fischhoff,et al.  Hindsight is not equal to foresight: The effect of outcome knowledge on judgment under uncertainty. , 1975 .

[28]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[29]  Baruch Fischhoff,et al.  The Hawthorne effect and energy awareness , 2013, Proceedings of the National Academy of Sciences.

[30]  F. J. Roethlisberger,et al.  Management and the Worker , 2003 .

[31]  Richard R. Lau,et al.  Behavioral Decision-Making , 2013 .

[32]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[33]  B. Fischhoff,et al.  Hindsight ≠ foresight: the effect of outcome knowledge on judgment under uncertainty* , 2003 .

[34]  William J. Burns,et al.  Covariance structure models and influence diagrams , 1993 .

[35]  B Fischhoff,et al.  Giving advice. Decision theory perspectives on sexual assault. , 1992, The American psychologist.

[36]  A. Bostrom,et al.  Assessing what to address in science communication , 2013, Proceedings of the National Academy of Sciences.

[37]  Clint A. Bowers,et al.  Team Training in the Skies: Does Crew Resource Management (CRM) Training Work? , 2001, Hum. Factors.

[38]  Eastman Ab,et al.  Resources for optimal care of the injured patient--1993. , 1994 .

[39]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2011, BMJ : British Medical Journal.

[40]  Alexander L. Davis,et al.  Setting a standard for electricity pilot studies , 2013 .

[41]  Gabrielle Wong-Parodi,et al.  Team science for science communication , 2014, Proceedings of the National Academy of Sciences.

[42]  P. West,et al.  'What does the phrase "safer sex" mean to you?' Understanding among Glaswegian 18-year-olds in 1990. , 1993, AIDS.

[43]  JOHN COHEN,et al.  Evaluation of Compound Probabilities in Sequential Choice , 1971, Nature.

[44]  Timothy J Wilt,et al.  Screening for breast cancer: U.S. Preventive Services Task Force recommendation statement. , 2009, Annals of internal medicine.

[45]  W A MAHON,et al.  A METHOD FOR THE ASSESSMENT OF REPORTS OF DRUG TRIALS. , 1964, Canadian Medical Association journal.

[46]  Alexander L. Davis,et al.  Communicating uncertain experimental evidence. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[47]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[48]  B. Fischhoff,et al.  Communicating Risks and Benefits: An Evidence Based User's Guide , 2012 .

[49]  Baruch Fischhoff,et al.  Communicating uncertainty: Fulfilling the duty to inform , 2012 .

[50]  C. E. M. Hansel,et al.  A QUANTITATIVE STUDY OF MEANING , 1958 .

[51]  P. Gärdenfors,et al.  Unreliable probabilities, risk taking, and decision making , 1982, Synthese.

[52]  P. Johnson-Laird.  How We Reason , 2006 .

[53]  Claire Hoertz Badaracco,et al.  Public Opinion Research , 1997 .

[54]  Baruch Fischhoff,et al.  Nonpersuasive communication about matters of greatest urgency: climate change. , 2007, Environmental science & technology.

[55]  Timothy J Wilt,et al.  Screening for breast cancer: U.S. Preventive Services Task Force recommendation statement. , 2009, Annals of internal medicine.

[56]  George Wright,et al.  Behavioral Decision Making , 2011 .

[57]  Steven Woloshin,et al.  The Drug Facts Box: Improving the communication of prescription drug information , 2013, Proceedings of the National Academy of Sciences.

[58]  NIH Consensus Statement. Breast cancer screening for women ages 40-49. , 1997, NIH consensus statement.

[59]  Detlof von Winterfeldt,et al.  Bridging the gap between science and decision making , 2013 .

[60]  Jerome R. Ravetz,et al.  Uncertainty and Quality in Science for Policy , 1990 .

[61]  B. Johnson.  Risk Communication: A Mental Models Approach , 2002 .

[62]  Brian A. Nosek,et al.  Scientific Utopia: I. Opening Scientific Communication , 2012, ArXiv.

[63]  Victor F. Weisskopf,et al.  Reactor safety study , 1976 .

[64]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[65]  Jie W Weiss,et al.  Bayesian Statistical Inference for Psychological Research , 2008 .

[66]  Detlof von Winterfeldt,et al.  Bridging the gap between science and decision making , 2013, Proceedings of the National Academy of Sciences.

[67]  Peter Urbach,et al.  Scientific Reasoning: The Bayesian Approach , 1989 .

[68]  Glynis M. Breakwell,et al.  Risk: a very short introduction , 2012 .

[69]  M. G. Morgan.  Use (and abuse) of expert elicitation in support of decision making for public policy , 2014, Proceedings of the National Academy of Sciences.

[70]  C. Wickens,et al.  Applied Attention Theory , 2007 .