Evaluating Bayesian Model Visualisations

Fig. 1. Evaluation UI supporting standardised task-based evaluation of Bayesian Model Visualisations. It includes the task Context, the Query to be answered, the Answer Input, and Acknowledgement on the left, and the Model Visualisation on the right. The specific answer input widget and model visualisation are generated dynamically from the task specification. TheMultiBet answer input is proposed here for capturing distributions of decisions. The Interactive Boxplot updates based on possibly conditional resampling from the Bayesian model back-end, triggered by user interactions.

[1]  Joe Faith.  Targeted Projection Pursuit for Interactive Exploration of High- Dimensional Data Sets , 2007, 2007 11th International Conference Information Visualization (IV '07).

[2]  K. Shadan,et al.  Available online: , 2012 .

[3]  J. Canton.  An Essay towards solving a Problem in the Doctrine of Chances . By the late Rev . Mr . Bayes , communicated by Mr . Price , in a letter to , 1999 .

[4]  Sean A. Munson,et al.  Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making , 2018, CHI.

[5]  Jennifer Tsai,et al.  Interactive Visualizations to Improve Bayesian Reasoning , 2011 .

[6]  Richard McElreath,et al.  Statistical Rethinking: A Bayesian Course with Examples in R and Stan , 2015 .

[7]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[8]  G. Gigerenzer,et al.  Teaching Bayesian reasoning in less than two hours. , 2001, Journal of experimental psychology. General.

[9]  D. Humphries,et al.  Reckoning with risk: learning to live with uncertainty , 2003, British Journal of Sports Medicine.

[10]  Mike Pearson,et al.  Visualizing Uncertainty About the Future , 2022 .

[11]  José G. Borges,et al.  A Bayesian Modelling of Wildfires in Portugal , 2015 .

[12]  P. Resnick,et al.  Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering , 2015, PloS one.

[13]  Matthew Kay,et al.  Imagining Replications: Graphical Prediction & Discrete Visualizations Improve Recall & Estimation of Effect Uncertainty , 2018, IEEE Transactions on Visualization and Computer Graphics.

[14]  Simon Breslav,et al.  Mimic: visual analytics of online micro-interactions , 2014, AVI.

[15]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[16]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[17]  Matthew Kay,et al.  Researcher-Centered Design of Statistics: Why Bayesian Statistics Better Fit the Culture and Incentives of HCI , 2016, CHI.

[18]  Matthew Kay,et al.  In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation , 2019, IEEE Transactions on Visualization and Computer Graphics.

[19]  S. Bhatt,et al.  Report 13: Estimating the number of infections and the impact of non-pharmaceutical interventions on COVID-19 in 11 European countries , 2020 .

[20]  William G. Cole,et al.  Understanding Bayesian reasoning via graphical displays , 1989, CHI '89.

[21]  Orit Shaer,et al.  Designing for Uncertainty in HCI: When Does Uncertainty Help? , 2017, CHI Extended Abstracts.

[22]  Carmen Díaz,et al.  Assessing Students’ Difficulties with Conditional Probability and Bayesian Reasoning , 2007, International Electronic Journal of Mathematics Education.

[23]  John Salvatier,et al.  Probabilistic programming in Python using PyMC3 , 2016, PeerJ Comput. Sci..

[24]  José M. Bernardo,et al.  Bayesian Statistics , 2011, International Encyclopedia of Statistical Science.

[25]  Sean A. Munson,et al.  When (ish) is My Bus?: User-centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems , 2016, CHI.

[26]  Leif D. Nelson,et al.  Psychology's Renaissance , 2018, Annual review of psychology.

[27]  S. Joslyn,et al.  Decisions With Uncertainty: The Glass Half Full , 2013 .

[28]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[29]  Nir Friedman,et al.  Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning , 2009 .

[30]  Niels Henze,et al.  Input Controls for Entering Uncertain Data: Probability Distribution Sliders , 2017, PACMHCI.

[31]  Katharina Reinecke,et al.  Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data , 2017, CHI.

[32]  Pierre Dragicevic,et al.  Increasing the Transparency of Research Papers with Explorable Multiverse Analyses , 2019, CHI.

[33]  Evdoxia Taka,et al.  Increasing Interpretability of Bayesian Probabilistic Programming Models Through Interactive Representations , 2020, Frontiers in Computer Science.

[34]  Shakir Mohamed,et al.  Variational Inference with Normalizing Flows , 2015, ICML.