Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments

Data augmentation and Gibbs sampling are two closely related, sampling-based approaches to the calculation of posterior moments. The fact that each produces a sample whose constituents are neither independent nor identically distributed complicates the assessment of convergence and numerical accuracy of the approximations to the expected value of functions of interest under the posterior. In this paper methods for spectral analysis are used to evaluate numerical accuracy formally and construct diagnostics for convergence. These methods are illustrated in the normal linear model with informative priors, and in the Tobit-censored regression model.

[1]  J. Tobin.  Estimation of Relationships for Limited Dependent Variables , 1958 .

[2]  A. Goldberger,et al.  On Pure and Mixed Statistical Estimation in Economics , 1961 .

[3]  G. C. Tiao,et al.  Bayes's theorem and the use of prior knowledge in regression analysis , 1964 .

[4]  A. Zellner.  An Introduction to Bayesian Inference in Econometrics , 1971 .

[5]  T. Kloek,et al.  Bayesian estimates of equation system parameters, An application of integration by Monte Carlo , 1976 .

[6]  T. Wales,et al.  Sample Selectivity and the Estimation of Labor Supply Functions , 1980 .

[7]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[8]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  T. Amemiya.  Tobit models: A survey , 1984 .

[10]  James J. Heckman,et al.  Handbook of Econometrics , 1985 .

[11]  L. Devroye.  Non-Uniform Random Variate Generation , 1986 .

[12]  L. Tierney,et al.  Accurate Approximations for Posterior Moments and Marginal Densities , 1986 .

[13]  R. Fernando,et al.  Mixed-model analysis of a censored normal distribution with reference to animal breeding. , 1987, Biometrics.

[14]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[15]  T. Sweeting.  Approximate Bayesian analysis of censored survival data , 1987 .

[16]  J. Geweke,et al.  Antithetic acceleration of Monte Carlo integration in Bayesian inference , 1988 .

[17]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[18]  John S. J. Hsu,et al.  Bayesian Marginal Inference , 1989 .

[19]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[20]  John Geweke,et al.  Efficient Simulation from the Multivariate Normal and Student-t Distributions Subject to Linear Constraints and the Evaluation of Constraint Probabilities , 1991 .

[21]  S. Chib.  Bayes inference in the Tobit censored regression model , 1992 .