Accuracy of Laplace approximation for discrete response mixed models

The Laplace approximation is amongst the computational methods used for estimation in generalized linear mixed models. It is computationally the fastest, but there hasn't been a clear analysis of when its accuracy is adequate. In this paper, for a few factors we do calculations for a variety of mixed models to show patterns in the asymptotic bias of the estimator based on the maximum of the Laplace approximation of the log-likelihood. The biggest factor for asymptotic bias is the amount of discreteness in the response variable; there is more bias for binary and ordinal responses than for a count response, and more bias for a count response when its support is mainly near 0. When there is bias, the bias decreases as the cluster size increases. Often, the Laplace approximation is adequate even for small cluster sizes. Even with bias, the Laplace approximation may be adequate for quick assessment of competing mixed models with different random effects and covariates.

[1]  N. Breslow,et al.  Bias Correction in Generalized Linear Mixed Models with Multiple Components of Dispersion , 1996 .

[2]  E. Demidenko,et al.  Mixed Models: Theory and Applications (Wiley Series in Probability and Statistics) , 2004 .

[3]  D. Bates,et al.  Approximations to the Log-Likelihood Function in the Nonlinear Mixed-Effects Model , 1995 .

[4]  S. Raudenbush,et al.  Maximum Likelihood for Generalized Linear Models with Nested Random Effects via High-Order, Multivariate Laplace Approximation , 2000 .

[5]  Maengseok Noh,et al.  REML estimation for binary data in GLMMs , 2007 .

[6]  N. Breslow,et al.  Bias correction in generalised linear mixed models with a single component of dispersion , 1995 .

[7]  J. Pinheiro,et al.  Efficient Laplacian and Adaptive Gaussian Quadrature Algorithms for Multilevel Generalized Linear Mixed Models , 2006 .

[8]  S. R. Searle,et al.  Generalized, Linear, and Mixed Models , 2005 .

[9]  J. Nash Compact Numerical Methods for Computers , 2018 .

[10]  Bas Engel,et al.  A Simple Illustration of the Failure of PQL, IRREML and APHL as Approximate ML Methods for Mixed Models for Binary Data , 1998 .

[11]  Marie Davidian,et al.  Nonlinear models for repeated measurement data: An overview and update , 2003 .

[12]  A. Stroud,et al.  Gaussian quadrature formulas , 1966 .

[13]  Geert Molenberghs,et al.  A pairwise likelihood approach to estimation in multilevel probit models , 2004, Comput. Stat. Data Anal..

[14]  Donald Hedeker,et al.  Longitudinal Data Analysis , 2006 .

[15]  D. B. Clarkson,et al.  Using Spherical–Radial Quadrature to Fit Generalized Linear Mixed Effects Models , 2002 .