The perception of visual uncertainty representation by non-experts

We tested how non-experts judge point probability for seven different visual representations of uncertainty, using a case from an unfamiliar domain. Participants (n=140) rated the probability that the boundary between two earth layers passed through a given point, for seven different visualizations of the positional uncertainty of the boundary. For all types of visualizations, most observers appear to construct an internal model of the uncertainty distribution that closely resembles a normal distribution. However, the visual form of the uncertainty range (i.e., the visualization type) affects this internal model and the internal model relates to participants’ numeracy. We conclude that perceived certainty is affected by its visual representation. In a follow-up experiment we found no indications that the absence (or presence) of a prominent center line in the visualization affects the internal model. We discuss if and how our results inform which visual representation is most suitable for representing uncertainty and make suggestions for future

[1]  P. Ubel,et al.  Measuring Numeracy without a Math Test: Development of the Subjective Numeracy Scale , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  Priti Shah,et al.  Bar and Line Graph Comprehension: An Interaction of Top-Down and Bottom-Up Processes , 2011, Top. Cogn. Sci..

[3]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[4]  Ann M. Bisantz,et al.  Displaying Uncertainty: Investigating the Effects of Display Format and Specificity , 2005, Hum. Factors.

[5]  Ann M. Bisantz,et al.  Comparing Uncertainty Visualizations for a Dynamic Decision-Making Task , 2011 .

[6]  Sam Huf,et al.  Visualizing Uncertainty to Improve Operators' Spatial Proximity Judgments in Uncertain Surroundings , 2006 .

[7]  Heidrun Schumann,et al.  The Visualization of Uncertain Data: Methods and Problems , 2006, SimVis.

[8]  Robert J. Moorhead,et al.  A User Study to Compare Four Uncertainty Visualization Methods for 1D and 2D Datasets , 2009, IEEE Transactions on Visualization and Computer Graphics.

[9]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[10]  G. Cumming,et al.  Replication and Researchers' Understanding of Confidence Intervals and Standard Error Bars. , 2004 .

[11]  Anthony D. Andre,et al.  Displaying Uncertainty in Advanced Navigation Systems , 1998 .

[12]  Gerd Gigerenzer,et al.  “A 30% Chance of Rain Tomorrow”: How Does the Public Understand Probabilistic Weather Forecasts? , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[13]  P. Rheingans,et al.  Procedural annotation of uncertain information , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[14]  Maria Riveiro,et al.  Evaluation of uncertainty visualization techniques for information fusion , 2007, 2007 10th International Conference on Information Fusion.

[15]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[16]  Bernt Schiele,et al.  Evaluating the Effects of Displaying Uncertainty in Context-Aware Applications , 2004, UbiComp.

[17]  Limor Nadav-Greenberg,et al.  Uncertainty Forecasts Improve Decision Making Among Nonexperts , 2009 .

[18]  Ann M. Bisantz,et al.  Utilizing Graphical Formats to Convey Uncertainty in a Decision Making Task , 2000 .

[19]  Beverley J. Evans,et al.  Dynamic display of spatial data-reliability: does it benefit the map user? , 1997 .

[20]  Richard T. Stone,et al.  Visual Representations of Meta-Information , 2009 .

[21]  Timothy S. Newman,et al.  On visualizing uncertainty in volumetric data: techniques and their evaluation , 2004, J. Vis. Lang. Comput..