Investigating Representation Alternatives for Communicating Uncertainty to Non-experts

Non-experts are confronted with uncertainty of predictions everyday when, e.g., using a navigation device or looking at the weather forecast. However, there are no standards for representing uncertain information and representations could be easily misleading. Thus, we selected twelve representations that provide different levels of uncertainty information. We compared the representations in an online survey with 90 participants where we asked participants to judge their support in decision-making, familiarity, easiness to understand, and visual appeal. We further evaluated the four most promising representations in a turn-based online game. Players had to make decisions in a farming scenario based on a displayed weather forecast. The results of the survey and the game indicate that a function graph of a probability distribution function is the best way to communicate uncertain information. Nevertheless, our results also show that presenting more uncertainty information does not necessarily lead to better decisions.

[1]  A. Tversky,et al.  On the elicitation of preferences for alternative therapies. , 1982, The New England journal of medicine.

[2]  Florian Pappenberger,et al.  Visualizing probabilistic flood forecast information: expert preferences and perceptions of best practice in uncertainty communication , 2011 .

[3]  Amnon Rapoport,et al.  Measuring the Vague Meanings of Probability Terms , 1986 .

[4]  M. Sheelagh T. Carpendale,et al.  Theoretical analysis of uncertainty visualizations , 2006, Electronic Imaging.

[5]  Gary E. Bolton,et al.  A Laboratory Study of the Benefits of Including Uncertainty Information in Weather Forecasts , 2006 .

[6]  Michael Gleicher,et al.  Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error , 2014, IEEE Transactions on Visualization and Computer Graphics.

[7]  Susan L Joslyn,et al.  Uncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error. , 2012, Journal of experimental psychology. Applied.

[8]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[9]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[10]  Alexander Toet,et al.  The Perception of Visual UncertaintyRepresentation by Non-Experts , 2014, IEEE Transactions on Visualization and Computer Graphics.

[11]  Rebecca E. Morss,et al.  Communicating Uncertainty in Weather Forecasts: A Survey of the U.S. Public , 2008 .

[12]  Jock D. Mackinlay,et al.  Visualizing data with bounded uncertainty , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[13]  M. Granger Morgan,et al.  Graphical Communication of Uncertain Quantities to Nontechnical People , 1987 .

[14]  B. Rimer,et al.  General Performance on a Numeracy Scale among Highly Educated Samples , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Joe Michael Kniss,et al.  Visualizing Summary Statistics and Uncertainty , 2010, Comput. Graph. Forum.