On MCMC sampling in hierarchical longitudinal models

Markov chain Monte Carlo (MCMC) algorithms have revolutionized Bayesian practice. In their simplest form (i.e., when parameters are updated one at a time) they are, however, often slow to converge when applied to high-dimensional statistical models. A remedy for this problem is to block the parameters into groups, which are then updated simultaneously using either a Gibbs or Metropolis-Hastings step. In this paper we construct several (partially and fully blocked) MCMC algorithms for minimizing the autocorrelation in MCMC samples arising from important classes of longitudinal data models. We exploit an identity used by Chib (1995) in the context of Bayes factor computation to show how the parameters in a general linear mixed model may be updated in a single block, improving convergence and producing essentially independent draws from the posterior of the parameters of interest. We also investigate the value of blocking in non-Gaussian mixed models, as well as in a class of binary response data longitudinal models. We illustrate the approaches in detail with three real-data examples.

[1]  A. Gelfand,et al.  Identifiability, Improper Priors, and Gibbs Sampling for Generalized Linear Models , 1999 .

[2]  L. Knorr‐Held.  Conditional Prior Proposals in Dynamic Models , 1999 .

[3]  S. Chib,et al.  Analysis of multivariate probit models , 1998 .

[4]  M. Pitt,et al.  Likelihood analysis of non-Gaussian measurement time series , 1997 .

[5]  Paul. Damien.  Gibbs sampling for Bayesian nonconjugate models using auxilliary variables , 1997 .

[6]  G. Roberts,et al.  Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler , 1997 .

[7]  Pascal Wild,et al.  Fitting Bayesian multiple random effects models , 1996, Stat. Comput..

[8]  R. Kohn,et al.  Markov chain Monte Carlo in conditionally Gaussian state space models , 1996 .

[9]  B P Carlin,et al.  Response of CD4 lymphocytes and clinical consequences of treatment using ddI or ddC in patients with advanced HIV infection. , 1996, Journal of acquired immune deficiency syndromes and human retrovirology : official publication of the International Retrovirology Association.

[10]  John M. Olin.  Calculating posterior distributions and modal estimates in Markov mixture models , 1996 .

[11]  A. Gelfand,et al.  Efficient parametrizations for generalized linear mixed models, (with discussion). , 1996 .

[12]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[13]  Walter R. Gilks,et al.  Strategies for improving MCMC , 1995 .

[14]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[15]  C. Geyer,et al.  Annealing Markov chain Monte Carlo with applications to ancestral inference , 1995 .

[16]  A. Gelfand,et al.  Efficient parametrisations for normal linear mixed models , 1995 .

[17]  J. Besag,et al.  Bayesian Computation and Stochastic Systems , 1995 .

[18]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .

[19]  R. Kohn,et al.  On Gibbs sampling for state space models , 1994 .

[20]  Jun S. Liu,et al.  The Collapsed Gibbs Sampler in Bayesian Computations with Applications to a Gene Regulation Problem , 1994 .

[21]  Jun S. Liu,et al.  Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes , 1994 .

[22]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[23]  N. Laird,et al.  A likelihood-based method for analysing longitudinal binary responses , 1993 .

[24]  W. Gilks,et al.  Adaptive Rejection Sampling for Gibbs Sampling , 1992 .

[25]  Nicholas G. Polson,et al.  A Monte Carlo Approach to Nonnormal and Nonlinear State-Space Modeling , 1992 .

[26]  A. Gelfand,et al.  Hierarchical Bayes Models for the Progression of HIV Infection Using Longitudinal CD4 T-Cell Numbers , 1992 .

[27]  Scott L. Zeger,et al.  Generalized linear models with random e ects: a Gibbs sampling approach , 1991 .

[28]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[29]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[30]  A. Dawid.  Conditional Independence in Statistical Theory , 1979 .

[31]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[32]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .