Increasing Interpretability of Bayesian Probabilistic Programming Models Through Interactive Representations

Bayesian probabilistic modeling is supported by powerful computational tools like probabilistic programming and efficient Markov Chain Monte Carlo (MCMC) sampling. However, the results of Bayesian inference are challenging for users to interpret in tasks like decision-making under uncertainty or model refinement. Decision-makers need simultaneous insight into both the model's structure and its predictions, including uncertainty in inferred parameters. This enables better assessment of the risk overall possible outcomes compatible with observations and thus more informed decisions. To support this, we see a need for visualization tools that make probabilistic programs interpretable to reveal the interdependencies in probabilistic models and their inherent uncertainty. We propose the automatic transformation of Bayesian probabilistic models, expressed in a probabilistic programming language, into an interactive graphical representation of the model's structure at varying levels of granularity, with seamless integration of uncertainty visualization. This interactive graphical representation supports the exploration of the prior and posterior distribution of MCMC samples. The interpretability of Bayesian probabilistic programming models is enhanced through the interactive graphical representations, which provide human users with more informative, transparent, and explainable probabilistic models. We present a concrete implementation that translates probabilistic programs to interactive graphical representations and show illustrative examples for a variety of Bayesian probabilistic models.

[1]  J. Canton LII . An Essay towards solving a Problem in the Doctrine of Chances . By the late Rev . Mr . Bayes , communicated by Mr . Price , in a letter to , 1999 .

[2]  J. Koehler The base rate fallacy reconsidered: Descriptive, normative, and methodological challenges , 1996, Behavioral and Brain Sciences.

[3]  Joe Faith Targeted Projection Pursuit for Interactive Exploration of High- Dimensional Data Sets , 2007, 2007 11th International Conference Information Visualization (IV '07).

[4]  G. Gigerenzer,et al.  Teaching Bayesian reasoning in less than two hours. , 2001, Journal of experimental psychology. General.

[5]  Susan Holmes,et al.  Interactive Visualization of Hierarchically Structured Data , 2018, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[6]  Katharina Reinecke,et al.  Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data , 2017, CHI.

[7]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[8]  H. Stern,et al.  Posterior predictive model checking in hierarchical models , 2003 .

[9]  Matthew Kay,et al.  Imagining Replications: Graphical Prediction & Discrete Visualizations Improve Recall & Estimation of Effect Uncertainty , 2018, IEEE Transactions on Visualization and Computer Graphics.

[10]  Francis Tuerlinckx,et al.  Increasing Transparency Through a Multiverse Analysis , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[11]  T. Bayes LII. An essay towards solving a problem in the doctrine of chances. By the late Rev. Mr. Bayes, F. R. S. communicated by Mr. Price, in a letter to John Canton, A. M. F. R. S , 1763, Philosophical Transactions of the Royal Society of London.

[12]  Nir Friedman,et al.  Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning , 2009 .

[13]  José M. Bernardo,et al.  Bayesian Statistics , 2011, International Encyclopedia of Statistical Science.

[14]  Andrew Thomas,et al.  The BUGS project: Evolution, critique and future directions , 2009, Statistics in medicine.

[15]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[16]  José G. Borges,et al.  A Bayesian Modelling of Wildfires in Portugal , 2015 .

[17]  Katharina Reinecke,et al.  Data Through Others' Eyes: The Impact of Visualizing Others' Expectations on Visualization Interpretation , 2018, IEEE Transactions on Visualization and Computer Graphics.

[18]  Osvaldo A. Martin,et al.  ArviZ a unified library for exploratory analysis of Bayesian models in Python , 2019, J. Open Source Softw..

[19]  Carmen Díaz,et al.  Assessing Students’ Difficulties with Conditional Probability and Bayesian Reasoning , 2007, International Electronic Journal of Mathematics Education.

[20]  Emden R. Gansner,et al.  Graphviz and Dynagraph – Static and Dynamic Graph Drawing Tools , 2003 .

[21]  John Salvatier,et al.  Probabilistic programming in Python using PyMC3 , 2016, PeerJ Comput. Sci..

[22]  Jennifer Tsai,et al.  Interactive Visualizations to Improve Bayesian Reasoning , 2011 .

[23]  Pierre Dragicevic,et al.  Increasing the Transparency of Research Papers with Explorable Multiverse Analyses , 2019, CHI.

[24]  J. Kruschke Chapter 8 – JAGS , 2015 .

[25]  Aki Vehtari,et al.  Visualization in Bayesian workflow , 2017, Journal of the Royal Statistical Society: Series A (Statistics in Society).