Flexible modelling of random effects in linear mixed models - A Bayesian approach

Flexible modelling of random effects in linear mixed models has attracted some attention recently. In this paper, we propose the use of finite Gaussian mixtures as in Verbeke and Lesaffre [A linear mixed model with heterogeneity in the random-effects population, J. Amu. Statist. Assoc. 91, 217-221]. We adopt a fully Bayesian hierarchical framework that allows simultaneous estimation of the number of mixture components together with other model parameters. The technique employed is the Reversible Jump MCMC algorithm (Richardson and Green [On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion). J. Roy. Statist. Soc. Ser. B 59, 731-792]). This approach has the advantage of producing a direct comparison of different mixture models through posterior probabilities from a single run of the MCMC algorithm. Moreover, the Bayesian setting allows us to integrate over different mixture models to obtain a more robust density estimate of the random effects. We focus on linear mixed models with a random intercept and a random slope. Numerical results on simulated data sets and a real data set are provided to demonstrate the usefulness of the proposed method.

[1]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[2]  G. Verbeke,et al.  A Linear Mixed-Effects Model with Heterogeneity in the Random-Effects Population , 1996 .

[3]  M. Escobar.  Estimating Normal Means with a Dirichlet Process Prior , 1994 .

[4]  G. Roberts,et al.  Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions , 2003 .

[5]  B. Lindsay.  The Geometry of Mixture Likelihoods: A General Theory , 1983 .

[6]  P. Green,et al.  Mixture models in measurement error problems, with reference to epidemiological studies , 2002 .

[7]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[8]  M A Newton,et al.  An Estimation Method for the Semiparametric Mixed Effects Model , 1999, Biometrics.

[9]  S. Zeger,et al.  A Smooth Nonparametric Estimate of a Mixing Distribution Using Mixtures of Gaussians , 1996 .

[10]  J. Kalbfleisch,et al.  The effects of mixture distribution misspecification when fitting mixed-effects logistic models , 1992 .

[11]  A. Gallant,et al.  Semi-nonparametric Maximum Likelihood Estimation , 1987 .

[12]  N. Laird.  Nonparametric Maximum Likelihood Estimation of a Mixing Distribution , 1978 .

[13]  E. Lesaffre,et al.  Smooth Random Effects Distribution in a Linear Mixed Model , 2004, Biometrics.

[14]  C. Robert,et al.  Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method , 2000 .

[15]  G. Verbeke,et al.  The effect of misspecifying the random-effects distribution in linear mixed models for longitudinal data , 1997 .

[16]  M Davidian,et al.  Linear Mixed Models with Flexible Distributions of Random Effects for Longitudinal Data , 2001, Biometrics.

[17]  L. Skovgaard.  NONLINEAR MODELS FOR REPEATED MEASUREMENT DATA. , 1996 .

[18]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[19]  T A Louis,et al.  Random effects models with non-parametric priors. , 1992, Statistics in medicine.

[20]  P. Green,et al.  Hidden Markov Models and Disease Mapping , 2002 .

[21]  A. L. Pretorius,et al.  Bayesian estimation in animal breeding using the Dirichlet process prior for correlated random effects , 2003, Genetics Selection Evolution.

[22]  S. MacEachern.  Estimating normal means with a conjugate style dirichlet process prior , 1994 .