The influence of different graphical displays on nonexpert decision making under uncertainty.

Understanding how people interpret and use visually presented uncertainty data is an important yet seldom studied aspect of data visualization applications. Current approaches in visualization often display uncertainty as an additional data attribute without a well-defined context. Our goal was to test whether different graphical displays (glyphs) would influence a decision about which of 2 weather forecasts was a more accurate predictor of an uncertain temperature forecast value. We used a statistical inference task based on fictional univariate normal distributions, each characterized by a mean and standard deviation. Participants viewed 1 of 5 different glyph types representing 2 weather forecast distributions. Three of these used variations in spatial encoding to communicate the distributions and the other 2 used nonspatial encoding (brightness or color). Four distribution pairs were created with different relative standard deviations (uncertainty of the forecasts). We found that there was a difference in how decisions were made with spatial versus nonspatial glyphs, but no difference among the spatial glyphs themselves. Furthermore, the effect of different glyph types changed as a function of the variability of the distributions. The results are discussed in the context of how visualizations might improve decision making under uncertainty.

[1]  Ann M. Bisantz,et al.  Displaying Uncertainty: Investigating the Effects of Display Format and Specificity , 2005, Hum. Factors.

[2]  Mary Hegarty,et al.  Comparing Graphical and Verbal Representations of Measurement Error In Test Score Reports , 2014 .

[3]  Robert S. Laramee,et al.  Uncertainty Visualization Methods in Isosurface Rendering , 2003, Eurographics.

[4]  Brian J Scholl,et al.  Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias , 2012, Psychonomic bulletin & review.

[5]  David Howard,et al.  Interface Design for Geographic Visualization: Tools for Representing Reliability , 1996 .

[6]  Susan L Joslyn,et al.  Uncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error. , 2012, Journal of experimental psychology. Applied.

[7]  Mark Gahegan,et al.  Visual Semiotics & Uncertainty Visualization: An Empirical Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[8]  Anthony Leiserowitz,et al.  Misinterpretations of the “Cone of Uncertainty” in Florida during the 2004 Hurricane Season , 2007 .

[9]  Alex T. Pang,et al.  Glyphs for Visualizing Uncertainty in Vector Fields , 1996, IEEE Trans. Vis. Comput. Graph..

[10]  G. Cumming,et al.  Inference by eye: confidence intervals and how to read pictures of data. , 2005, The American psychologist.

[11]  M. Sheelagh T. Carpendale,et al.  Visualization of Uncertainty and Reasoning , 2007, Smart Graphics.

[12]  Beverley J. Evans,et al.  Dynamic display of spatial data-reliability: does it benefit the map user? , 1997 .

[13]  T. Hengl,et al.  Visualisation of uncertainty using the HSI colour model : computations with colours , 2003 .

[14]  Habib N. Najm,et al.  Stochastic spectral methods for efficient Bayesian solution of inverse problems , 2005, J. Comput. Phys..

[15]  Susan Joslyn,et al.  Communicating forecast uncertainty: public perception of weather forecast uncertainty , 2010 .

[16]  Donald H. House,et al.  Visualizing Uncertainty in Predicted Hurricane Tracks , 2013 .

[17]  Gerd Gigerenzer,et al.  Fast and frugal heuristics: The adaptive toolbox. , 1999 .

[18]  Susan Joslyn,et al.  The Benefits and Challenges of Predictive Interval Forecasts and Verification Graphics for End Users , 2013 .

[19]  David Borland,et al.  Rainbow Color Map (Still) Considered Harmful , 2007 .

[20]  Raja Parasuraman,et al.  Effects of Situation-Specific Reliability on Trust and Usage of Automated Air Traffic Control Decision Aids , 2003 .

[21]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[22]  G. Loftus,et al.  Why Figures with Error Bars Should Replace p Values Some Conceptual Arguments and Empirical Demonstrations , 2015 .

[23]  Bin Jiang,et al.  Visualization support for fuzzy spatial analysis , 1994 .

[24]  Limor Nadav-Greenberg,et al.  Reducing probabilistic weather forecasts to the worst-case scenario: anchoring effects. , 2011, Journal of experimental psychology. Applied.

[25]  A. Morone,et al.  DISPLAYING UNCERTAIN INFORMATION ABOUT PROBABILITY: EXPERIMENTAL EVIDENCE , 2012 .

[26]  Geoff Cumming,et al.  Inference by Eye: Pictures of Confidence Intervals and Thinking About Levels of Confidence , 2007 .

[27]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[28]  Andrew Mercer,et al.  Noodles: A Tool for Visualization of Numerical Weather Model Ensemble Uncertainty , 2010, IEEE Transactions on Visualization and Computer Graphics.

[29]  Edward T. Cokely,et al.  Science Current Directions in Psychological , 2010 .

[30]  Keith C. Clarke,et al.  Testing Popular Visualization Techniques for Representing Model Uncertainty , 2003 .

[31]  Mark Gahegan,et al.  Visualizing Geospatial Information Uncertainty: What We Know and What We Need to Know , 2005 .

[32]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[33]  Robert J. Moorhead,et al.  A User Study to Compare Four Uncertainty Visualization Methods for 1D and 2D Datasets , 2009, IEEE Transactions on Visualization and Computer Graphics.