Convergence rate of MLE in generalized linear and nonlinear mixed-effects models: Theory and applications

Abstract Generalized linear and nonlinear mixed-effects models are used extensively in the study of repeated measurements and longitudinal data analysis. Convergence rates of maximum likelihood estimates (MLEs) differ from parameter to parameter, which is not well explained in the literature. We consider the convergence rates of the MLEs for three different cases: (1) the number of subjects (clusters) n tends to infinity while the number of measurements per subject p remains finite; (2) both n and p tend to infinity; (3) n remains finite while p tends to infinity. In the three cases above, the MLE may have different convergence rates. In case (1), as we can expect, the MLE of all parameters are n -consistent under some regularity conditions; in case (2), some parameters could be np -consistent. These rates of convergence have a crucial impact on both experimental design and data analysis. Limited simulations were performed to examine the theoretical results. We illustrate applications of our results through one example and through presenting the exact convergence rates of some “approximate” MLEs such as PQL, CGEE2, etc. It is shown that the MLE for some parameters and some “approximate” MLEs may be N -consistent, here N = np is the total sample size. Also our results show that the MLE of some parameters maybe asymptotically independent of some other parameters.

[1]  W. Lu,et al.  Reliability of Pharmacodynamic Analysis by Logistic Regression: Mixed-effects Modeling , 2003, Anesthesiology.

[2]  A R Localio,et al.  Empirical Bayes Estimation of Random Effects Parameters in Mixed Effects Logistic Regression Models , 1999, Biometrics.

[3]  P. Burton,et al.  Genetic variance components analysis for binary phenotypes using generalized linear mixed models (GLMMs) and Gibbs sampling , 1999, Genetic epidemiology.

[4]  E. Vonesh,et al.  Linear and Nonlinear Models for the Analysis of Repeated Measurements , 1996 .

[5]  J. Booth,et al.  Standard Errors of Prediction in Generalized Linear Mixed Models , 1998 .

[6]  D. Hedeker,et al.  A random-effects ordinal regression model for multilevel analysis. , 1994, Biometrics.

[7]  C. McCulloch,et al.  Generalized Linear Mixed Models , 2005 .

[8]  C. McCulloch.  Maximum Likelihood Algorithms for Generalized Linear Mixed Models , 1997 .

[9]  J. Booth,et al.  Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo EM algorithm , 1999 .

[10]  F. Mcmahon,et al.  Kinetics of indomethacin absorption, elimination, and enterohepatic circulation in man , 1976, Journal of Pharmacokinetics and Biopharmaceutics.

[11]  D J Roe.  Comparison of population pharmacokinetic modeling methods using simulated data: results from the Population Modeling Workgroup. , 1997, Statistics in medicine.

[12]  Dibyen Majumdar,et al.  Generalized Least Squares, Taylor Series Linearization and Fisher's Scoring in Multivariate Nonlinear Regression , 2001 .

[13]  M Davidian,et al.  Some general estimation methods for nonlinear mixed-effects models. , 1993, Journal of biopharmaceutical statistics.

[14]  Russell D. Wolfinger,et al.  Two Taylor-series approximation methods for nonlinear mixed models , 1997 .

[15]  L. Hörmander.  The analysis of linear partial differential operators , 1990 .

[16]  Lewis B. Sheiner,et al.  Evaluation of methods for estimating population pharmacokinetic parameters. I. Michaelis-menten model: Routine clinical pharmacokinetic data , 1980, Journal of Pharmacokinetics and Biopharmaceutics.

[17]  Generalized linear mixed models for strawberry inflorescence data , 2003 .

[18]  Martin Crowder,et al.  Beta-binomial Anova for Proportions , 1978 .

[19]  Murray Aitkin,et al.  Variance Component Models with Binary Response: Interviewer Variability , 1985 .

[20]  Scott L. Zeger,et al.  Generalized linear models with random e ects: a Gibbs sampling approach , 1991 .

[21]  A. Wald.  Note on the Consistency of the Maximum Likelihood Estimate , 1949 .

[22]  H Wu,et al.  Population HIV‐1 Dynamics In Vivo: Applicable Models and Inferential Tools for Virological Data from AIDS Clinical Trials , 1999, Biometrics.

[23]  Jiming Jiang.  Consistent Estimators in Generalized Linear Mixed Models , 1998 .

[24]  Sanjoy K. Sinha,et al.  Robust Analysis of Generalized Linear Mixed Models , 2004 .

[25]  D. Bates,et al.  Nonlinear mixed effects models for repeated measures data. , 1990, Biometrics.

[26]  B. Reboussin,et al.  Mixed Effects Logistic Regression Models for Longitudinal Ordinal Functional Response Data with Multiple‐Cause Drop‐Out from the Longitudinal Study of Aging , 2000, Biometrics.

[27]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[28]  M. Karim.  Generalized Linear Models With Random Effects , 1991 .

[29]  L. Tierney,et al.  Fully Exponential Laplace Approximations to Expectations and Variances of Nonpositive Functions , 1989 .

[30]  J. Nelder,et al.  Hierarchical Generalized Linear Models , 1996 .

[31]  D. Cox,et al.  Asymptotic techniques for use in statistics , 1989 .

[32]  R. Gomeni,et al.  A two-step iterative algorithm for estimation in nonlinear mixed-effect models with an evaluation in population pharmacokinetics. , 1995, Journal of biopharmaceutical statistics.

[33]  Dibyen Majumdar,et al.  Conditional Second-Order Generalized Estimating Equations for Generalized Linear and Nonlinear Mixed-Effects Models , 2002 .

[34]  E. Vonesh,et al.  A note on the use of Laplace's approximation for nonlinear mixed-effects models , 1996 .

[35]  Jiming Jiang,et al.  Conditional inference about generalized linear mixed models , 1999 .

[36]  Ralph A. Bradley,et al.  The asymptotic properties of ML estimators when sampling from associated populations , 1962 .

[37]  L. Nie,et al.  Strong Consistency of the Maximum Likelihood Estimator in Generalized Linear and Nonlinear Mixed-Effects Models , 2006 .

[38]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .