Sensitivity estimations for Bayesian inference models solved by MCMC methods

The advent of Markov Chain Monte Carlo (MCMC) methods to simulate posterior distributions has virtually revolutionized the practice of Bayesian statistics. Unfortunately, sensitivity analysis in MCMC methods is a difficult task. In this paper, a computationally low-cost method to estimate local parametric sensitivities in Bayesian models is proposed. The sensitivity measure considered here is the gradient vector of a posterior quantity with respect to the parameter. The gradient vector components are estimated by using a result based on the integral/derivative interchange. The MCMC simulations used to estimate the posterior quantity can be re-used to estimate the sensitivity measures and their errors, avoiding the need for further sampling. The proposed method is easy to apply in practice as it is shown with an illustrative example.

[1]  A. F. Smith,et al.  Conjugate likelihood distributions , 1993 .

[2]  James O. Berger,et al.  Bayesian Analysis: A Look at Today and Thoughts of Tomorrow , 2000 .

[3]  Tim Hesterberg,et al.  Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control , 2004, Technometrics.

[4]  Andrew L. Rukhin,et al.  Tools for statistical inference , 1991 .

[5]  Lynn Kuo,et al.  Bayesian and profile likelihood change point methods for modeling cognitive function over time , 2003, Comput. Stat. Data Anal..

[6]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[7]  Stephen P. Brooks,et al.  Markov chain Monte Carlo method and its application , 1998 .

[8]  Calyampudi Radhakrishna Rao,et al.  Bayesian thinking : modeling and computation , 2005 .

[9]  Siva Sivaganesan,et al.  Global and Local Robustness Approaches: Uses and Limitations , 2000 .

[10]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[11]  James O. Berger Statistical Decision Theory , 1980 .

[12]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[13]  Werner Vach,et al.  A Bayesian approach to seriation problems in archaeology , 2004, Comput. Stat. Data Anal..

[14]  Dipak K. Dey,et al.  On local sensitivity measures in Bayesian analysis , 1996 .

[15]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[16]  D. Gaver,et al.  Robust empirical bayes analyses of event rates , 1987 .

[17]  David Ríos Insua,et al.  Robust Bayesian analysis , 2000 .