Non-expert interpretations of hurricane forecast uncertainty visualizations

Uncertainty represented in visualizations is often ignored or misunderstood by the non-expert user. The National Hurricane Center displays hurricane forecasts using a track forecast cone, depicting the expected track of the storm and the uncertainty in the forecast. Our goal was to test whether different graphical displays of a hurricane forecast containing uncertainty would influence a decision about storm characteristics. Participants viewed one of five different visualization types. Three varied the currently used forecast cone, one presented a track with no uncertainty, and one presented an ensemble of multiple possible hurricane tracks. Results show that individuals make different decisions using uncertainty visualizations with different visual properties, demonstrating that basic visual properties must be considered in visualization design and communication.

[1]  Angela Schwering,et al.  Usability of Spatio-Temporal Uncertainty Visualisation Methods , 2012, AGILE Conf..

[2]  Tobias Isenberg,et al.  Evaluating Sketchiness as a Visual Variable for the Depiction of Qualitative Uncertainty , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Donald H. House,et al.  Visualizing Uncertainty in Predicted Hurricane Tracks , 2013 .

[4]  Sarah H. Creem-Regehr,et al.  The influence of different graphical displays on nonexpert decision making under uncertainty. , 2015, Journal of experimental psychology. Applied.

[5]  Carla S. Prater,et al.  Effects of Track and Threat Information on Judgments of Hurricane Strike Probability , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[6]  Mary Hegarty,et al.  Comparing Graphical and Verbal Representations of Measurement Error In Test Score Reports , 2014 .

[7]  Ann M. Bisantz,et al.  Utilizing Graphical Formats to Convey Uncertainty in a Decision Making Task , 2000 .

[8]  Brian J Scholl,et al.  Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias , 2012, Psychonomic bulletin & review.

[9]  Elisabeth Stephens,et al.  Communicating probabilistic information from climate model ensembles—lessons from numerical weather prediction , 2012 .

[10]  Bin Jiang,et al.  Visualization support for fuzzy spatial analysis , 1994 .

[11]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[12]  Igor Drecki,et al.  Visualisation of Uncertainty in Geographical Data , 2002 .

[13]  Daniel J Bauer,et al.  Fitting multilevel models with ordinal outcomes: performance of alternative specifications and methods of estimation. , 2011, Psychological methods.

[14]  Alan M. MacEachren,et al.  How to Assess Visual Communication of Uncertainty? A Systematic Review of Geospatial Uncertainty Visualisation User Studies , 2014 .

[15]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[16]  David Howard,et al.  Interface Design for Geographic Visualization: Tools for Representing Reliability , 1996 .

[17]  Hierarchical Linear Modeling (HLM) , 2013 .

[18]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[19]  Mark Gahegan,et al.  Visual Semiotics & Uncertainty Visualization: An Empirical Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[20]  Anthony Leiserowitz,et al.  Misinterpretations of the “Cone of Uncertainty” in Florida during the 2004 Hurricane Season , 2007 .

[21]  A. H. Murphy,et al.  Misinterpretations of precipitation probability forecasts , 1980 .

[22]  Michael Gleicher,et al.  Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error , 2014, IEEE Transactions on Visualization and Computer Graphics.

[23]  Penny Rheingans,et al.  Point-based probabilistic surfaces to show surface uncertainty , 2004, IEEE Transactions on Visualization and Computer Graphics.

[24]  Mark Gahegan,et al.  Visualizing Geospatial Information Uncertainty: What We Know and What We Need to Know , 2005 .

[25]  Kenneth Broad,et al.  Dynamic Simulation as an Approach to Understanding Hurricane Risk Response: Insights from the Stormview Lab , 2013, Risk analysis : an official publication of the Society for Risk Analysis.