Uncertainty Visualization by Representative Sampling from Prediction Ensembles

Data ensembles are often used to infer statistics to be used for a summary display of an uncertain prediction. In a spatial context, these summary displays have the drawback that when uncertainty is encoded via a spatial spread, display glyph area increases in size with prediction uncertainty. This increase can be easily confounded with an increase in the size, strength or other attribute of the phenomenon being presented. We argue that by directly displaying a carefully chosen subset of a prediction ensemble, so that uncertainty is conveyed implicitly, such misinterpretations can be avoided. Since such a display does not require uncertainty annotation, an information channel remains available for encoding additional information about the prediction. We demonstrate these points in the context of hurricane prediction visualizations, showing how we avoid occlusion of selected ensemble elements while preserving the spatial statistics of the original ensemble, and how an explicit encoding of uncertainty can also be constructed from such a selection. We conclude with the results of a cognitive experiment demonstrating that the approach can be used to construct storm prediction displays that significantly reduce the confounding of uncertainty with storm size, and thus improve viewers’ ability to estimate potential for storm damage.

[1]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[2]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[3]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[4]  Laurynas Gedminas,et al.  Evaluating hurricane advisories using eye-tracking and biometric data , 2011 .

[5]  J. Mark Introduction to radial basis function networks , 1996 .

[6]  Cem Yuksel,et al.  Sample Elimination for Generating Poisson Disk Sample Sets , 2015, Comput. Graph. Forum.

[7]  Daniel J Bauer,et al.  Fitting multilevel models with ordinal outcomes: performance of alternative specifications and methods of estimation. , 2011, Psychological methods.

[8]  Donald H. House,et al.  Non-expert interpretations of hurricane forecast uncertainty visualizations , 2016, CogSci.

[9]  Li-Yi Wei Multi-class blue noise sampling , 2010, ACM Trans. Graph..

[10]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[11]  Greg Humphreys,et al.  A spatial data structure for fast Poisson-disk sample generation , 2006, SIGGRAPH 2006.

[12]  Paul Rosen,et al.  From Quantification to Visualization: A Taxonomy of Uncertainty Visualization Approaches , 2011, WoCoUQ.

[13]  David B. Stephenson,et al.  Statistical methods for interpreting Monte Carlo ensemble forecasts , 2000 .

[14]  Sheng Chen,et al.  Regularized orthogonal least squares algorithm for constructing radial basis function networks , 1996 .

[15]  Eugene Fiume,et al.  Hierarchical Poisson disk sampling distributions , 1992 .

[16]  Ross T. Whitaker,et al.  Curve Boxplot: Generalization of Boxplot for Ensembles of Curves , 2014, IEEE Transactions on Visualization and Computer Graphics.

[17]  Donald H. House,et al.  Visualizing Time‐Specific Hurricane Predictions, with Uncertainty, from Storm Path Ensembles , 2015, Comput. Graph. Forum.

[18]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[19]  Donald H. House,et al.  Visualizing Uncertainty in Predicted Hurricane Tracks , 2013 .

[20]  Anthony Leiserowitz,et al.  Misinterpretations of the “Cone of Uncertainty” in Florida during the 2004 Hurricane Season , 2007 .

[21]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[22]  Ross T. Whitaker,et al.  Contour Boxplots: A Method for Characterizing Uncertainty in Feature Sets from Simulation Ensembles , 2013, IEEE Transactions on Visualization and Computer Graphics.

[23]  Martin D. Buhmann,et al.  Radial Basis Functions: Theory and Implementations: Preface , 2003 .

[24]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties , 1989 .

[25]  Regina Y. Liu On a Notion of Data Depth Based on Random Simplices , 1990 .

[26]  Kun Zhou,et al.  Visual Abstraction and Exploration of Multi-class Scatterplots , 2014, IEEE Transactions on Visualization and Computer Graphics.

[27]  Alex Pang,et al.  Visualizing Uncertainty in Natural Hazards , 2008 .

[28]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..