Methods for Communicating the Complexity and Uncertainty of Oil Spill Response Actions and Tradeoffs

ABSTRACT Complexity and uncertainty influence opinions, beliefs, and decisions about health, safety, and other kinds of risk, as demonstrated in research on health, climate change, storm forecasts, pandemic disease, and in other domains. Drawing from this research, this article summarizes insights into how people understand and process uncertain or complex information and explores key oil spill and oil spill response-relevant issues regarding the communication of complexity and uncertainty—from the presentation of uncertainties around forecast parameters to the deployment of online oil spill response simulation tools. Recommended practices from this article include (a) to continue to develop and evaluate interactive Web-based oil spill response simulations to help users explore tradeoffs in response decisions, (b) to take how people simplify information into account in designing communications processes and products (and evaluate), (c) to provide numbers along with verbal probability descriptions, and (d) if using graphics, to communicate probability or uncertainty, using simple graphics and testing them, as effects may not be predictable and some kinds of graphics are easier to understand than others, depending on context, numeracy, and graphicacy.

[1]  D. Budescu,et al.  Preferences and reasons for communicating probabilistic information in verbal or numerical terms , 1993 .

[2]  K. J. Craik,et al.  The nature of explanation , 1944 .

[3]  P. Slovic,et al.  Presenting uncertainty in health risk assessment: initial studies of its effects on risk perception and trust. , 1995, Risk analysis : an official publication of the Society for Risk Analysis.

[4]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[5]  B. Fischhoff,et al.  Judgment and decision making. , 2012, Wiley interdisciplinary reviews. Cognitive science.

[6]  Margaret G. Meloy,et al.  The Distortion of Information during Decisions , 1996 .

[7]  Mathew P. White,et al.  Risk interpretation and action: A conceptual framework for responses to natural hazards , 2012 .

[8]  H. Chua,et al.  Risk avoidance: Graphs versus numbers , 2006, Memory & cognition.

[9]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[10]  John W. Payne,et al.  A Constructive Process View of Decision Making: Multiple Strategies in Judgment and Choice , 1992 .

[11]  M. G. Morgan,et al.  What Do We Know About Making Risk Comparisons , 1990 .

[12]  M. Sebrechts.  Ignorance and Uncertainty: Emerging Paradigms , 1989 .

[13]  Schneider,et al.  All Frames Are Not Created Equal: A Typology and Critical Analysis of Framing Effects. , 1998, Organizational behavior and human decision processes.

[14]  John D. Sterman,et al.  Does formal system dynamics training improve people's understanding of accumulation? , 2010 .

[15]  Andrew M. Parker,et al.  Published online in Wiley InterScience (www.interscience.wiley.com) DOI: 10.1002/bdm.481 Decision-making Competence: External Validation through an Individual-differences Approach , 2005 .

[16]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[17]  D. Berlyne.  Curiosity and exploration. , 1966, Science.

[18]  Robert Gramling,et al.  Scientific Certainty Argumentation Methods (SCAMs): Science and the Politics of Doubt* , 2008 .

[19]  Kate Starbird,et al.  Social Media, Public Participation, and the 2010 BP Deepwater Horizon Oil Spill , 2015 .

[20]  Robert Sugden,et al.  On Nudging: A Review of Nudge: Improving Decisions About Health, Wealth and Happiness by Richard H. Thaler and Cass R. Sunstein , 2009 .

[21]  Susan L Joslyn,et al.  Uncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error. , 2012, Journal of experimental psychology. Applied.

[22]  R. Thaler,et al.  Nudge: Improving Decisions About Health, Wealth, and Happiness , 2008 .

[23]  Kate Starbird,et al.  What-If Scenario Modeling to Support Oil Spill Preparedness and Response Decision-Making , 2015 .

[24]  Edward L. Miles,et al.  On the Increasing Vulnerability of the World Ocean to Multiple Stresses , 2009 .

[25]  Chris Arney.  Nudge: Improving Decisions about Health, Wealth, and Happiness , 2015 .

[26]  B. Fischhoff,et al.  Communicating Risks and Benefits: An Evidence Based User's Guide , 2012 .

[27]  N. McGlynn.  Thinking fast and slow. , 2014, Australian veterinary journal.

[28]  Anthony Leiserowitz,et al.  Misinterpretations of the “Cone of Uncertainty” in Florida during the 2004 Hurricane Season , 2007 .

[29]  Nicholas Frank Pidgeon,et al.  Transforming the UK energy system: public values, attitudes and acceptability: summary findings from a survey conducted August 2012 , 2013 .

[30]  Joel Huber,et al.  Communication of ambiguous risk information , 1991 .

[31]  Paul Slovic,et al.  Lay views on uncertainty in environmental health risk assessment , 1998 .

[32]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[33]  John D. Sterman,et al.  Bathtub dynamics: initial results of a systems thinking inventory , 2000 .

[34]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[35]  Cara L Cuite,et al.  A Test of Numeric Formats for Communicating Risk Probabilities , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[36]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[37]  J. Pligt,et al.  Influencing risk-preference in decision-making: The effects of framing and salience , 1995 .

[38]  Donald F. Boesch,et al.  Wicked Challenges at Land's End: Managing Coastal Vulnerability Under Climate Change , 2012 .

[39]  Baruch Fischhoff,et al.  The sciences of science communication , 2013, Proceedings of the National Academy of Sciences.

[40]  Susan Joslyn,et al.  The Benefits and Challenges of Predictive Interval Forecasts and Verification Graphics for End Users , 2013 .

[41]  Olivier Oullier.  Behavioural insights are vital to policy-making , 2013, Nature.

[42]  Barbara Reynolds,et al.  Crisis and Emergency Risk Communication , 2005 .

[43]  N. Epley,et al.  The Anchoring-and-Adjustment Heuristic , 2006, Psychological science.

[44]  Megumi Kano,et al.  Communicating Actionable Risk for Terrorism and Other Hazards⋆ , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[45]  Thomas Dietz,et al.  Modellers' and Outreach Professionals' Views on the Role of Models in Watershed Management† , 2011 .

[46]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[47]  Limor Nadav-Greenberg,et al.  The effects of wording on the understanding and use of uncertainty information in a threshold forecasting decision , 2009 .

[48]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[49]  Branden B Johnson,et al.  Are Some Risk Comparisons More Effective Under Conflict?: A Replication and Extension of Roth et al. , 2003, Risk analysis : an official publication of the Society for Risk Analysis.

[50]  J. Beegle-Krause,et al.  GENERAL NOAA OIL MODELING ENVIRONMENT (GNOME): A NEW SPILL TRAJECTORY MODEL , 2001 .

[51]  Michelene T. H. Chi,et al.  Expertise in Problem Solving. , 1981 .

[52]  P. S. Hart,et al.  The role of numeracy in moderating the influence of statistics in climate change messages , 2013, Public understanding of science.

[53]  A. K. Saysel,et al.  Misperceptions of global climate change: information policies , 2009 .

[54]  E. Peters,et al.  Dissecting the risky-choice framing effect: Numeracy as an individual-difference factor in weighting risky and riskless options , 2008, Judgment and Decision Making.

[55]  Ann Bostrom,et al.  Lead is like mercury: risk comparisons, analogies and mental models1 , 2008 .

[56]  Ellen Peters,et al.  Same numbers, different meanings: How numeracy influences the importance of numbers for pro-social behavior , 2013 .

[57]  H. Simon,et al.  Theories of Decision-Making in Economics and Behavioural Science , 1966 .

[58]  James G. March,et al.  A primer on decision making : how decisions happen , 1994 .

[59]  J. Sterman.  Communicating climate change risks in a skeptical world , 2011 .

[60]  Rami Zwick,et al.  Comparing the calibration and coherence of numerical and verbal probability judgments , 1993 .

[61]  P. Johnson-Laird.  Mental models , 1989 .

[62]  W. H. F. Barnes.  The Nature of Explanation , 1944, Nature.

[63]  Paul Slovic,et al.  What Should We Know About Making Risk Comparisons?1 , 1990 .

[64]  S. Iyengar.  Framing responsibility for political issues: The case of poverty , 1990 .

[65]  David V. Budescu,et al.  A review of human linguistic probability processing: General principles and empirical evidence , 1995, The Knowledge Engineering Review.

[66]  R. Dawes.  Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[67]  S. Joslyn,et al.  The Advantages of Predictive Interval Forecasts for Non‐Expert Users and the Impact of Visualizations , 2013 .

[68]  Priti Shah,et al.  Bar and Line Graph Comprehension: An Interaction of Top-Down and Bottom-Up Processes , 2011, Top. Cogn. Sci..

[69]  Michael Smithson,et al.  The Many Faces and Masks of Uncertainty , 2008 .

[70]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[71]  V. S. Ramachandran,et al.  Analogical Reasoning , 2012 .

[72]  Liz Eckermann,et al.  Uncertainty and risk : multidisciplinary perspectives , 2011 .

[73]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[74]  Marcia McNutt,et al.  Black swans, wicked problems, and science during crises , 2011 .

[75]  Paul Slovic,et al.  From Shakespeare to Simon: speculations--and some evidence-- about man's ability to process information , 1972 .

[76]  Kate Starbird,et al.  Communication Practices for Oil Spills: Stakeholder Engagement During Preparedness and Response , 2015 .

[77]  R. McClellan.  A commentary on the NRC report "Science and judgment in risk assessment". , 1994, Regulatory toxicology and pharmacology : RTP.

[78]  Priti Shah,et al.  The Comprehension of Quantitative Information in Graphical Displays. , 2005 .

[79]  Valerie F. Reyna,et al.  Coherence and Correspondence Criteria for Rationality: Experts' Estimation of Risks of Sexually Transmitted Infections. , 2005 .

[80]  C. K. Mertz,et al.  PSYCHOLOGICAL SCIENCE Research Article Numeracy and Decision Making , 2022 .

[81]  David V. Budescu,et al.  Improving Communication of Uncertainty in the Reports of the Intergovernmental Panel on Climate Change , 2009, Psychological science.

[82]  Colin Camerer,et al.  Recent developments in modeling preferences: Uncertainty and ambiguity , 1992 .

[83]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[84]  Kate Starbird,et al.  Oil Spill Response Risk Judgments, Decisions, and Mental Models: Findings from Surveying U.S. Stakeholders and Coastal Residents , 2015 .

[85]  B. Johnson.  Risk Communication: A Mental Models Approach , 2002 .

[86]  Jessica S. Ancker,et al.  The Practice of Informatics: Design Features of Graphs in Health Risk Communication: A Systematic Review , 2006, J. Am. Medical Informatics Assoc..

[87]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[88]  John D. Sterman,et al.  Thinking about systems: student and teacher conceptions of natural and social systems , 2007 .

[89]  Mary Frances Luce,et al.  Boundary Conditions on Unconscious Thought in Complex Decision Making , 2008, Psychological science.

[90]  Jacqueline MacDonald Gibson,et al.  Communicating quantitative information about unexploded ordnance risks to the public. , 2013, Environmental science & technology.

[91]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[92]  Eric J. Johnson,et al.  Mindful judgment and decision making. , 2009, Annual review of psychology.

[93]  Eric R. Stone,et al.  Effects of numerical and graphical displays on professed risk-taking behavior. , 1997 .

[94]  D. Gentner,et al.  The analogical mind : perspectives from cognitive science , 2001 .

[95]  Mary Hegarty,et al.  Thinking about the weather: How display salience and knowledge affect performance in a graphic inference task. , 2010, Journal of experimental psychology. Learning, memory, and cognition.