Importance sampling for Bayesian sensitivity analysis

We examine the use of sensitivity analysis with a particular focus on calculating the bounds of imprecise previsions in Bayesian statistics. We explain the use of importance sampling in approximating the range of these imprecise previsions and we develop an approximation function for the imprecise posterior prevision based on generating a finite number of random variables. We develop a convergence theorem that shows that this approximation converges almost surely to the posterior prevision as we generate more and more random variables. We also develop a useful accuracy bound for the approximation for a large finite number of generated random variables. We test the efficiency of this approximation using a simple example involving the imprecise Dirichlet model.

[1]  Marcus Hutter.  Robust Estimators under the Imprecise Dirichlet Model , 2003, ISIPTA.

[2]  D. Hinkley.  On the ratio of two correlated normal random variables , 1969 .

[3]  David Ríos Insua,et al.  Robust Bayesian analysis , 2000 .

[4]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[5]  P. Walley.  Statistical Reasoning with Imprecise Probabilities , 1990 .

[6]  G. Marsaglia.  Ratios of Normal Variables and Ratios of Sums of Uniform Variables , 1965 .

[7]  J. Berger.  Robust Bayesian analysis : sensitivity to the prior , 1990 .

[8]  Jean-Marc Bernard,et al.  An introduction to the imprecise Dirichlet model for multinomial data , 2005, Int. J. Approx. Reason..

[9]  Bobby Schnabel,et al.  A modular system of algorithms for unconstrained minimization , 1985, TOMS.

[10]  Edward E. Leamer,et al.  Specification Searches: Ad Hoc Inference with Nonexperimental Data , 1980 .

[11]  B. D. Finetti,et al.  Foresight: Its Logical Laws, Its Subjective Sources , 1992 .

[12]  T. Ferguson.  A Course in Large Sample Theory , 1996 .

[13]  James O. Berger,et al.  An overview of robust Bayesian analysis , 1994 .

[14]  M. Evans,et al.  Methods for Approximating Integrals in Statistics with Special Emphasis on Bayesian Integration Problems , 1995 .

[15]  J. Q. Smith,et al.  1. Bayesian Statistics 4 , 1993 .

[16]  P. Walley.  Inferences from Multinomial Data: Learning About a Bag of Marbles , 1996 .

[17]  Henry E. Kyburg,et al.  Studies in Subjective Probability , 1965 .

[18]  D. Hinkley.  Correction: On the Ratio of Two Correlated Normal Random Variables , 1970 .