Partially Collapsed Gibbs Sampling for Linear Mixed-effects Models

This article presents a novel Bayesian analysis for linear mixed-effects models. The analysis is based on the method of partial collapsing that allows some components to be partially collapsed out of a model. The resulting partially collapsed Gibbs (PCG) sampler constructed to fit linear mixed-effects models is expected to exhibit much better convergence properties than the corresponding Gibbs sampler. In order to construct the PCG sampler without complicating component updates, we consider the reparameterization of model components by expressing a between-group variance in terms of a within-group variance in a linear mixed-effects model. The proposed method of partial collapsing with reparameterization is applied to the Merton’s jump diffusion model as well as general linear mixed-effects models with proper prior distributions and illustrated using simulated data and longitudinal data on sleep deprivation.

[1]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[2]  J. Wakefield,et al.  Bayesian inference for generalized linear mixed models. , 2010, Biostatistics.

[3]  D. V. Dyk,et al.  Fitting Mixed-Effects Models Using Efficient EM-Type Algorithms , 2000 .

[4]  D. Bates,et al.  Newton-Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data , 1988 .

[5]  N. Breslow.  Extra‐Poisson Variation in Log‐Linear Models , 1984 .

[6]  Xiao-Li Meng,et al.  Seeking efficient data augmentation schemes via conditional and marginal augmentation , 1999 .

[7]  J G Ibrahim,et al.  A semi-parametric Bayesian approach to generalized linear mixed models. , 1998, Statistics in medicine.

[8]  D. V. Dyk,et al.  Partially Collapsed Gibbs Sampling and Path-Adaptive Metropolis–Hastings in High-Energy Astrophysics , 2011 .

[9]  D. V. van Dyk,et al.  Partially Collapsed Gibbs Samplers , 2008 .

[10]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[11]  Taeyoung Park,et al.  Bayesian semi-parametric analysis of Poisson change-point regression models: application to policy-making in Cali, Colombia , 2012, Journal of applied statistics.

[12]  Scott L. Zeger,et al.  Generalized linear models with random e ects: a Gibbs sampling approach , 1991 .

[13]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[14]  Maria L. Thomas,et al.  Patterns of performance degradation and restoration during sleep restriction and subsequent recovery: a sleep dose‐response study , 2003, Journal of sleep research.

[15]  Elizabeth Thompson,et al.  MCMC in the Analysis of Genetic Data on Related Individuals , 2011 .

[16]  Janet Treasure,et al.  A longitudinal investigation of nutrition and dietary patterns in children of mothers with eating disorders. , 2013, The Journal of pediatrics.

[17]  D. V. van Dyk,et al.  Partially Collapsed Gibbs Samplers: Illustrations and Applications , 2009 .

[18]  Jun S. Liu,et al.  Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes , 1994 .

[19]  D. A. Williams,et al.  Extra‐Binomial Variation in Logistic Linear Models , 1982 .

[20]  Jun S. Liu,et al.  The Collapsed Gibbs Sampler in Bayesian Computations with Applications to a Gene Regulation Problem , 1994 .

[21]  R. C. Merton,et al.  Option pricing when underlying stock returns are discontinuous , 1976 .