A modified EM algorithm for estimation in generalized mixed models.

Application of the EM algorithm for estimation in the generalized mixed model has been largely unsuccessful because the E-step cannot be determined in most instances. The E-step computes the conditional expectation of the complete data log-likelihood and when the random effect distribution is normal, this expectation remains an intractable integral. The problem can be approached by numerical or analytic approximations; however, the computational burden imposed by numerical integration methods and the absence of an accurate analytic approximation have limited the use of the EM algorithm. In this paper, Laplace's method is adapted for analytic approximation within the E-step. The proposed algorithm is computationally straightforward and retains much of the conceptual simplicity of the conventional EM algorithm, although the usual convergence properties are not guaranteed. The proposed algorithm accommodates multiple random factors and random effect distributions besides the normal, e.g., the log-gamma distribution. Parameter estimates obtained for several data sets and through simulation show that this modified EM algorithm compares favorably with other generalized mixed model methods.

[1]  C. R. Henderson,et al.  Best linear unbiased estimation and prediction under a selection model. , 1975, Biometrics.

[2]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[3]  Daniel W. Schafer,et al.  Covariate measurement error in generalized linear models , 1987 .

[4]  T. Louis.  Finding the Observed Information Matrix When Using the EM Algorithm , 1982 .

[5]  Donald A. Pierce,et al.  Heterogeneity in Mantel-Haenszel-type models , 1993 .

[6]  K Y Liang,et al.  Longitudinal data analysis for discrete and continuous outcomes. , 1986, Biometrics.

[7]  K. Lange.  A gradient algorithm locally equivalent to the EM algorithm , 1995 .

[8]  Scott L. Zeger,et al.  Generalized linear models with random e ects: a Gibbs sampling approach , 1991 .

[9]  D. Cox,et al.  Asymptotic techniques for use in statistics , 1989 .

[10]  N. Breslow,et al.  Bias correction in generalised linear mixed models with a single component of dispersion , 1995 .

[11]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[12]  L. Tierney,et al.  Fully Exponential Laplace Approximations to Expectations and Variances of Nonpositive Functions , 1989 .

[13]  A. Davison.  Treatment effect heterogeneity in paired data , 1992 .

[14]  R. Schall.  Estimation in generalized linear models with random effects , 1991 .

[15]  J. Ware,et al.  Random-effects models for serial observations with binary response. , 1984, Biometrics.

[16]  Xiao-Li Meng,et al.  Using EM to Obtain Asymptotic Variance-Covariance Matrices: The SEM Algorithm , 1991 .

[17]  P. Green.  Penalized Likelihood for General Semi-Parametric Regression Models. , 1987 .

[18]  C. R. Henderson.  SIRE EVALUATION AND GENETIC TRENDS , 1973 .

[19]  N. D. Bruijn.  Asymptotic methods in analysis , 1958 .

[20]  R. Kass,et al.  Approximate Bayesian Inference in Conditionally Independent Hierarchical Models (Parametric Empirical Bayes Models) , 1989 .

[21]  C. Mcgilchrist.  Estimation in Generalized Mixed Models , 1994 .

[22]  S L Zeger,et al.  Generalized linear models with random effects; salamander mating revisited. , 1992, Biometrics.

[23]  P. Albert,et al.  Models for longitudinal data: a generalized estimating equation approach. , 1988, Biometrics.

[24]  Peter McCullagh,et al.  REML Estimation with Exact Covariance in the Logistic Mixed Model , 1993 .

[25]  N. Laird,et al.  Maximum likelihood computations with repeated measures: application of the EM algorithm , 1987 .

[26]  P. Thall,et al.  Some covariance models for longitudinal count data with overdispersion. , 1990, Biometrics.

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  Guang Guo,et al.  Estimating a Multivariate Proportional Hazards Model for Clustered Data Using the EM Algorithm, with an Application to Child Survival in Guatemala , 1992 .

[29]  Estimation in generalized linear mixed models via the em algorithm , 1995 .