Bayesian comparison of econometric models

This paper integrates and extends some recent computational advances in Bayesian inference with the objective of more fully realizing the Bayesian promise of coherent inference and model comparison in economics. It combines Markov chain Monte Carlo and independence Monte Carlo with importance sampling to provide an efficient and generic method for updating posterior distributions. It exploits the multiplicative decomposition of marginalized likelihood into predictive factors, to compute posterior odds ratios efficiently and with minimal further investment in software. It argues for the use of predictive odds ratios in model comparison in economics. Finally, it suggests procedures for public reporting that will enable remote clients to conveniently modify priors, form posterior expectations of their own functions of interest, and update the posterior distribution with new observations. A series of examples explores the practicality and efficiency of these methods. This paper was initially prepared as the inaugural Colin Clark Lecture, Australasian Meetings of the Econometric Society, July 1994. I wish to acknowledge helpful comments made at this meeting, in seminars at Cambridge University, Federal Reserve System Board of Governors, Harvard-M.I.T., University of Kansas, University of Minnesota, Northwestern University, University of Pennsylvania, Princeton University, and University of Virginia, and at the 1994 summer and 1995 winter North American meetings of the Econometric Society, the 1994 North American and world meetings of the International Society for Bayesian Analysis, and the 1995 Bath international workshop on model comparison. The paper has benefited from discussions with Jim Berger, Gary Chamberlain, Jon Faust, Bill Griffiths, Peter Phillips, Christopher Sims, Mark Steel and Arnold Zellner. Remaining errors and shortcomings are entirely the author’s. Zhenyu Wang provided research assistance. This work was supported in part by National Science Foundation Grant SES-9210070. The views expressed in this paper are those of the author and not necessarily those of the Federal Reserve Bank of Minneapolis or the Federal Reserve System.

[1]  H. Jeffreys,et al.  The Theory of Probability , 1896 .

[2]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[3]  D. Lindley A STATISTICAL PARADOX , 1957 .

[4]  M. Bartlett A comment on D. V. Lindley's statistical paradox , 1957 .

[5]  Clifford Hildrethi BAYESIAN STATISTICIANS AND REMOTE CLIENTS , 1963 .

[6]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[7]  M. Degroot Optimal Statistical Decisions , 1970 .

[8]  Arnold Zellner,et al.  An Introduction to Bayesian Inference in Econometrics. , 1974 .

[9]  A. Atkinson Posterior probabilities for choosing a regression model , 1978 .

[10]  R. Engle Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[11]  D. Spiegelhalter,et al.  Bayes Factors for Linear and Log‐Linear Models with Vague Prior Information , 1982 .

[12]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[14]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[15]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[16]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[17]  John Geweke,et al.  Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments , 1991 .

[18]  M. Aitkin Posterior Bayes Factors , 1991 .

[19]  Charles J. Geyer,et al.  Practical Markov Chain Monte Carlo , 1992 .

[20]  G. Casella,et al.  Explaining the Gibbs Sampler , 1992 .

[21]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[22]  R. Chou,et al.  ARCH modeling in finance: A review of the theory and empirical evidence , 1992 .

[23]  M. Newton Approximate Bayesian-inference With the Weighted Likelihood Bootstrap , 1994 .

[24]  Peter E. Rossi,et al.  Bayesian Analysis of Stochastic Volatility Models , 1994 .

[25]  Adrian F. M. Smith,et al.  Simple conditions for the convergence of the Gibbs sampler and Metropolis-Hastings algorithms , 1994 .

[26]  A. Gelfand,et al.  Bayesian Model Choice: Asymptotics and Exact Calculations , 1994 .

[27]  L. Tierney Markov Chains for Exploring Posterior Distributions , 1994 .

[28]  John Geweke,et al.  Monte carlo simulation and numerical integration , 1995 .

[29]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[30]  J. Geweke,et al.  Bayesian reduced rank regression in econometrics , 1996 .