On Marginal Quasi-Likelihood Inference in Generalized Linear Mixed Models

In view of the cumbersome and often intractable numerical integrations required for a full likelihood analysis, several suggestions have been made recently for approximate inference in generalized linear mixed models (GLMMs). Two closely related approximate methods are the penalized quasi-likelihood (PQL) method and the marginal quasi-likelihood (MQL) method. The PQL approach generally produces biased estimates for the regression effects and the variance component of the random effects. Recently, some corrections have been proposed to remove these biases. But the corrections appear to be satisfactory only when the variance component of the random effects is small. The MQL approach has also been used for inference in the GLMMs. This approach requires the computations of the joint moments of the clustered observations, up to order four. But the derivation of these moments are not easy. Consequently, different “working” formulas have been used, especially for the mean and covariance matrix of the observations, which may not lead to desirable estimates. In this paper, we use a small variance component (of the random effects) approach and develop the MQL estimating equations for the parameters based on the joint moments of order up to four. The proposed approach thus avoids the use of the so-called “working” covariance and higher order moment matrices, leading to better estimates for the regression and the overdispersion parameters, in the sense of efficiency in particular.

[1]  P. McCullagh,et al.  Bias Correction in Generalized Linear Models , 1991 .

[2]  Xihong Lin Variance component testing in generalised linear models with random effects , 1997 .

[3]  Brajendra C. Sutradhar,et al.  On approximate likelihood inference in a poisson mixed model , 1998 .

[4]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[5]  David R. Cox,et al.  Nonlinear component of variance models , 1992 .

[6]  N. Breslow,et al.  Bias correction in generalised linear mixed models with a single component of dispersion , 1995 .

[7]  L. Zhao,et al.  Estimating equations for parameters in means and covariances of multivariate discrete and continuous responses. , 1991, Biometrics.

[8]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[9]  P. McCullagh Quasi-Likelihood Functions , 1983 .

[10]  Noreen Goldman,et al.  An assessment of estimation procedures for multilevel models with binary responses , 1995 .

[11]  Calyampudi R. Rao Large sample tests of statistical hypotheses concerning several parameters with applications to problems of estimation , 1948, Mathematical Proceedings of the Cambridge Philosophical Society.

[12]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[13]  On Joint Estimation of Regression and Overdispersion Parameters in Generalized Linear Models for Longitudinal Data , 1996 .

[14]  S. Zeger,et al.  Multivariate Regression Analyses for Categorical Data , 1992 .

[15]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[16]  B. Sutradhar,et al.  Analysing exponential family based messy data , 1995 .

[17]  David Ruppert,et al.  Robust Estimation in Heteroscedastic Linear Models. , 1982 .

[18]  Harvey Goldstein,et al.  Improved Approximations for Multilevel Models with Binary Responses , 1996 .

[19]  P. Albert,et al.  Models for longitudinal data: a generalized estimating equation approach. , 1988, Biometrics.

[20]  R. W. Wedderburn Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method , 1974 .

[21]  Kung-Yee Liang,et al.  Prediction of Random Effects in the Generalized Linear Model , 1993 .