Effects of ensemble and summary displays on interpretations of geospatial uncertainty data

Ensemble and summary displays are two widely used methods to represent visual-spatial uncertainty; however, there is disagreement about which is the most effective technique to communicate uncertainty to the general public. Visualization scientists create ensemble displays by plotting multiple data points on the same Cartesian coordinate plane. Despite their use in scientific practice, it is more common in public presentations to use visualizations of summary displays, which scientists create by plotting statistical parameters of the ensemble members. While prior work has demonstrated that viewers make different decisions when viewing summary and ensemble displays, it is unclear what components of the displays lead to diverging judgments. This study aims to compare the salience of visual features – or visual elements that attract bottom-up attention – as one possible source of diverging judgments made with ensemble and summary displays in the context of hurricane track forecasts. We report that salient visual features of both ensemble and summary displays influence participant judgment. Specifically, we find that salient features of summary displays of geospatial uncertainty can be misunderstood as displaying size information. Further, salient features of ensemble displays evoke judgments that are indicative of accurate interpretations of the underlying probability distribution of the ensemble data. However, when participants use ensemble displays to make point-based judgments, they may overweight individual ensemble members in their decision-making process. We propose that ensemble displays are a promising alternative to summary displays in a geospatial context but that decisions about visualization methods should be informed by the viewer’s task.

[1]  S. Joslyn,et al.  The Advantages of Predictive Interval Forecasts for Non‐Expert Users and the Impact of Visualizations , 2013 .

[2]  Donald H. House,et al.  Uncertainty Visualization by Representative Sampling from Prediction Ensembles , 2017, IEEE Transactions on Visualization and Computer Graphics.

[3]  Timothy D. Sweeny,et al.  Ensemble perception of size in 4-5-year-old children. , 2014, Developmental science.

[4]  Michael W. Dobson,et al.  PERCEPTION OF CONTINUOUSLY SHADED MAPS , 1980 .

[5]  D. Ariely Seeing Sets: Representation by Statistical Properties , 2001, Psychological science.

[6]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[7]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[8]  G. Alvarez Representing multiple objects as an ensemble enhances visual cognition , 2011, Trends in Cognitive Sciences.

[9]  J. Bittner,et al.  Cognitive Research : Principles and Implications , 2017 .

[10]  Alex Pang,et al.  Visualizing Uncertainty in Natural Hazards , 2008 .

[11]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[12]  Andrew Mercer,et al.  Noodles: A Tool for Visualization of Numerical Weather Model Ensemble Uncertainty , 2010, IEEE Transactions on Visualization and Computer Graphics.

[13]  Jeffrey S. Torguson,et al.  Cartography: Thematic Map Design , 1990 .

[14]  Daniel J Bauer,et al.  Fitting multilevel models with ordinal outcomes: performance of alternative specifications and methods of estimation. , 2011, Psychological methods.

[15]  John C. Davis,et al.  Contouring: A Guide to the Analysis and Display of Spatial Data , 1992 .

[16]  Steven Franconeri,et al.  Four types of ensemble coding in data visualizations. , 2016, Journal of vision.

[17]  D. Whitney,et al.  Ensemble crowd perception: a viewpoint-invariant mechanism to represent average crowd identity. , 2013, Journal of vision.

[18]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[19]  Brian J Scholl,et al.  Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias , 2012, Psychonomic bulletin & review.

[20]  Ken Brodlie,et al.  A Review of Uncertainty in Data Visualization , 2012, Expanding the Frontiers of Visual Analytics and Visualization.

[21]  Mary Hegarty,et al.  The Roles of Mental Animations and External Animations in Understanding Mechanical Systems , 2003 .

[22]  Mary Hegarty,et al.  Where are you? The Effect of Uncertainty and its Visual Representation on Location Judgments in GPS-like Displays , 2016, CogSci.

[23]  Ruth Rosenholtz,et al.  A computational form of the statistical saliency model for visual search , 2005 .

[24]  Ronald A. Rensink On the Prospects for a Science of Visualization , 2014, Handbook of Human Centric Visualization.

[25]  Ross T. Whitaker,et al.  Contour Boxplots: A Method for Characterizing Uncertainty in Feature Sets from Simulation Ensembles , 2013, IEEE Transactions on Visualization and Computer Graphics.

[26]  Valerio Pascucci,et al.  Ensemble-Vis: A Framework for the Statistical Visualization of Ensemble Data , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[27]  Olivier R. Joubert,et al.  How long to get to the “gist” of real-world natural scenes? , 2005 .

[28]  Ross T. Whitaker,et al.  Curve Boxplot: Generalization of Boxplot for Ensembles of Curves , 2014, IEEE Transactions on Visualization and Computer Graphics.

[29]  Mario A. Gomarasca,et al.  Elements of Cartography , 2009 .

[30]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[31]  Robert J. Moorhead,et al.  A User Study to Compare Four Uncertainty Visualization Methods for 1D and 2D Datasets , 2009, IEEE Transactions on Visualization and Computer Graphics.

[32]  Jason M Haberman,et al.  From Textures to Crowds : Multiple Levels of Summary Statistical Perception , 2017 .

[33]  Alan M. MacEachren,et al.  Evaluating the effect of visually represented geodata uncertainty on decision-making: systematic review, lessons learned, and recommendations , 2017 .

[34]  Jeffrey Heer,et al.  Regression by Eye: Estimating Trends in Bivariate Visualizations , 2017, CHI.

[35]  Tobias Isenberg,et al.  A Systematic Review on the Practice of Evaluating Visualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[36]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[37]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[38]  Robert Kosara,et al.  Judgment Error in Pie Chart Variations , 2016, EuroVis.

[39]  Mary Hegarty,et al.  Thinking about the weather: How display salience and knowledge affect performance in a graphic inference task. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Mary Hegarty,et al.  Cognitively Inspired and Perceptually Salient Graphic Displays for Efficient Spatial Inference Making , 2010 .

[41]  Michael Gleicher,et al.  Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error , 2014, IEEE Transactions on Visualization and Computer Graphics.

[42]  Manuel Menezes de Oliveira Neto,et al.  Overview and State-of-the-Art of Uncertainty Visualization , 2014, Scientific Visualization.

[43]  Donald H. House,et al.  Non-expert interpretations of hurricane forecast uncertainty visualizations , 2016, CogSci.

[44]  J. Henderson Regarding Scenes , 2007 .

[45]  Robert L. Harris,et al.  Information Graphics: A Comprehensive Illustrated Reference , 1996 .

[46]  Michael W. Dobson,et al.  Choropleth Maps Without Class Intervals?: A Comment , 2010 .

[47]  Ronald A. Rensink The nature of correlation perception in scatterplots , 2016, Psychonomic bulletin & review.

[48]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[49]  Robert McGill,et al.  An Experiment in Graphical Perception , 1986, Int. J. Man Mach. Stud..

[50]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[51]  Donald H. House,et al.  Visualizing Uncertainty in Predicted Hurricane Tracks , 2013 .