Explicit Versus Actionable Knowledge: The Influence of Explaining Graphical Conventions on Interpretation of Hurricane Forecast Visualizations

Visualizations of uncertainty in data are often presented to the public without explanations of their graphical conventions and are often misunderstood by nonexperts. The “cone of uncertainty” used to visualize hurricane forecasts is a case in point. Here we examined the effects of explaining graphical conventions on understanding of the cone of uncertainty. In two experiments, participants were given instructions with and without an explanation of these graphical conventions. We examined the effect of these instructions on both explicit statements of common misconceptions and users interpretation of hurricane forecasts, specifically their predictions of damage from the hurricane over space and time. Enhanced instructions reduced misconceptions about the cone of uncertainty as expressed in explicit beliefs, and in one experiment also reduced predictions of damage overall. Examination of individual response profiles for the damage estimate task revealed qualitative differences between individuals that were not evident in aggregate response profiles. This research reveals mixed results for the effectiveness of instructions on comprehension of uncertainty visualizations and suggests a more nuanced approach that focuses on the individual’s knowledge and beliefs about the domain and visualization.

[1]  Stephen Michael Kosslyn,et al.  Graph Design for the Eye and Mind , 2006 .

[2]  Michael Gleicher,et al.  Error Bars Considered Harmful , 2013 .

[3]  Donald H. House,et al.  Non-expert interpretations of hurricane forecast uncertainty visualizations , 2016, CogSci.

[4]  Richard E. Mayer,et al.  When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons. , 1996 .

[5]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[6]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[7]  Cynthia A. Brewer Cartography: thematic map design, 3rd edition , 1994 .

[8]  Mark Gahegan,et al.  Visual Semiotics & Uncertainty Visualization: An Empirical Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[9]  Anthony Leiserowitz,et al.  Misinterpretations of the “Cone of Uncertainty” in Florida during the 2004 Hurricane Season , 2007 .

[10]  Michael Gleicher,et al.  Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error , 2014, IEEE Transactions on Visualization and Computer Graphics.

[11]  Sarah H. Creem-Regehr,et al.  Effects of ensemble and summary displays on interpretations of geospatial uncertainty data , 2017, Cognitive Research: Principles and Implications.

[12]  Alan M. MacEachren,et al.  How to Assess Visual Communication of Uncertainty? A Systematic Review of Geospatial Uncertainty Visualisation User Studies , 2014 .

[13]  Mary Hegarty,et al.  Where are you? The Effect of Uncertainty and its Visual Representation on Location Judgments in GPS-like Displays , 2016, CogSci.

[14]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[15]  Barbara Tversky,et al.  Visualizing Thought , 2011, Top. Cogn. Sci..

[16]  G. Cumming,et al.  Inference by eye: confidence intervals and how to read pictures of data. , 2005, The American psychologist.

[17]  Mary Hegarty,et al.  Assessing the effectiveness of different visualizations for judgments of positional uncertainty , 2016, Int. J. Geogr. Inf. Sci..

[18]  W. Hays Semiology of Graphics: Diagrams Networks Maps. , 1985 .

[19]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[20]  Susan Joslyn,et al.  Probabilistic Interval Forecasts: An Individual Differences Approach to Understanding Forecast Communication , 2017 .

[21]  Donald H. House,et al.  Visualizing Uncertainty in Predicted Hurricane Tracks , 2013 .

[22]  B. Marx The Visual Display of Quantitative Information , 1985 .

[23]  Donald H. House,et al.  Uncertainty Visualization by Representative Sampling from Prediction Ensembles , 2017, IEEE Transactions on Visualization and Computer Graphics.

[24]  Jiajie Zhang,et al.  A representational analysis of relational information displays , 1996, Int. J. Hum. Comput. Stud..

[25]  Jeffrey D. Karpicke,et al.  Test-Enhanced Learning , 2006, Psychological science.

[26]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[27]  R. Mayer,et al.  Cognitive constraints on multimedia learning: When presenting more material results in less understanding. , 2001 .

[28]  S. Joslyn,et al.  The Advantages of Predictive Interval Forecasts for Non‐Expert Users and the Impact of Visualizations , 2013 .

[29]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[30]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[31]  Mary Hegarty,et al.  The Cognitive Science of Visual-Spatial Displays: Implications for Design , 2011, Top. Cogn. Sci..

[32]  Alan M. MacEachren,et al.  Evaluating the effect of visually represented geodata uncertainty on decision-making: systematic review, lessons learned, and recommendations , 2017 .

[33]  Mike Pearson,et al.  Visualizing Uncertainty About the Future , 2022 .