Practice Improves Performance of a 2D Uncertainty Integration Task Within and Across Visualizations

Information uncertainty is ubiquitous in everyday life, including in domains as diverse as weather forecasts, investments, and health risks. Knowing how to interpret and integrate this uncertain information is vital for making good decisions, but this can be difficult for experts and novices alike. In this study, we examine whether brief, focused practice can improve people's ability to understand and integrate bivariate Gaussian uncertainty visualized via ensemble displays, summary displays, and distributional displays, and we examine whether this is influenced by the complexity of the displayed information. In two experiments (N=118 and 56), decision making was faster and more accurate after practice relative to before practice. Furthermore, the performance improvements transferred to use of display types that were not practiced. This suggests that practice with feedback may improve underlying skills in probabilistic reasoning and provides a promising approach to improve people's decision making under uncertainty.

[1]  Sara Irina Fabrikant,et al.  Effects of Uncertainty Visualization on Map-Based Decision Making Under Time Pressure , 2020, Frontiers in Computer Science.

[2]  Gianluca Iaccarino,et al.  Design exploration and optimization under uncertainty , 2020 .

[3]  Katharina Reinecke,et al.  Controlling for Participants’ Viewing Distance in Large-Scale, Psychophysical Online Experiments Using a Virtual Chinrest , 2020, Scientific Reports.

[4]  Michael A Webster,et al.  Individual differences and their implications for color perception , 2019, Current Opinion in Behavioral Sciences.

[5]  Joseph J. LaViola,et al.  Examining Training Comprehension and External Cognition in Evaluations of Uncertainty Visualizations to Support Decision Making , 2019, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[6]  Jessica Hullman,et al.  Why Authors Don't Visualize Uncertainty , 2019, IEEE Transactions on Visualization and Computer Graphics.

[7]  David J. Spiegelhalter,et al.  Communicating uncertainty about facts, numbers and science , 2019, Royal Society Open Science.

[8]  Donald H. House,et al.  Visualizing Uncertain Tropical Cyclone Predictions using Representative Samples from Ensembles of Forecast Tracks , 2019, IEEE Transactions on Visualization and Computer Graphics.

[9]  Sarah H. Creem-Regehr,et al.  Decision making with visualizations: a cognitive framework across disciplines , 2018, Cognitive Research: Principles and Implications.

[10]  Mary Hegarty,et al.  Explicit Versus Actionable Knowledge: The Influence of Explaining Graphical Conventions on Interpretation of Hurricane Forecast Visualizations , 2018, Journal of experimental psychology. Applied.

[11]  Joseph J. LaViola,et al.  Determining the Effect of Training on Uncertainty Visualization Evaluations , 2018, Advances in Usability, User Experience and Assistive Technology.

[12]  Kimberly A. Pollard,et al.  Prevention Focus Relates to Performance on a Loss-Framed Inhibitory Control Task , 2018, Front. Psychol..

[13]  Albrecht Schmidt,et al.  Uncertainty Visualization Influences how Humans Aggregate Discrepant Information , 2018, CHI.

[14]  Sarah H. Creem-Regehr,et al.  Effects of ensemble and summary displays on interpretations of geospatial uncertainty data , 2017, Cognitive Research: Principles and Implications.

[15]  Donald H. House,et al.  Uncertainty Visualization by Representative Sampling from Prediction Ensembles , 2017, IEEE Transactions on Visualization and Computer Graphics.

[16]  Sean A. Munson,et al.  When (ish) is My Bus?: User-centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems , 2016, CHI.

[17]  Mary Hegarty,et al.  Assessing the effectiveness of different visualizations for judgments of positional uncertainty , 2016, Int. J. Geogr. Inf. Sci..

[18]  Donald H. House,et al.  Non-expert interpretations of hurricane forecast uncertainty visualizations , 2016, CogSci.

[19]  Klaus Mueller,et al.  Learning Visualizations by Analogy: Promoting Visual Literacy through Visualization Morphing , 2015, IEEE Transactions on Visualization and Computer Graphics.

[20]  Bret Kellihan,et al.  Towards a Translational Method for Studying the Influence of Motivational and Affective Variables on Performance During Human-Computer Interactions , 2015, HCI.

[21]  E. Penning-Rowsell,et al.  Flood risk assessments at different spatial scales , 2015, Mitigation and Adaptation Strategies for Global Change.

[22]  Antonio Maldonado,et al.  Improving risk understanding across ability levels: Encouraging active processing with dynamic icon arrays. , 2015, Journal of experimental psychology. Applied.

[23]  Jeffrey N. Rouder,et al.  Robust misinterpretation of confidence intervals , 2013, Psychonomic bulletin & review.

[24]  Hugh P. Possingham,et al.  Incorporating uncertainty associated with habitat data in marine reserve design , 2013 .

[25]  George E. Newman,et al.  Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias , 2012, Psychonomic Bulletin & Review.

[26]  Edward T. Cokely,et al.  Measuring Risk Literacy: The Berlin Numeracy Test , 2012, Judgment and Decision Making.

[27]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[28]  Matthew E. Watts,et al.  Conservation planning under climate change : Toward accounting for uncertainty in predicted species distributions to increase confidence in conservation investments in space and time , 2011 .

[29]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[30]  Mia Hubert,et al.  An adjusted boxplot for skewed distributions , 2008, Comput. Stat. Data Anal..

[31]  Stephen Michael Kosslyn,et al.  Graph Design for the Eye and Mind , 2006 .

[32]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[33]  Edward J. Mulrow,et al.  The Visual Display of Quantitative Information , 1985, Technometrics.

[34]  R. Ryan,et al.  Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. , 1982 .

[35]  Ronald A. Rensink On the Prospects for a Science of Visualization , 2014, Handbook of Human Centric Visualization.

[36]  Desa,et al.  Thematic map design , 2013 .

[37]  O. John,et al.  Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. , 2008 .

[38]  E. Higgins,et al.  Achievement orientations from subjective histories of success: Promotion pride versus prevention pride , 2001 .

[39]  S. Frederick,et al.  Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .