Testing multiple variance components in linear mixed-effects models.

Testing zero variance components is one of the most challenging problems in the context of linear mixed-effects (LME) models. The usual asymptotic chi-square distribution of the likelihood ratio and score statistics under this null hypothesis is incorrect because the null is on the boundary of the parameter space. During the last two decades many tests have been proposed to overcome this difficulty, but these tests cannot be easily applied for testing multiple variance components, especially for testing a subset of them. We instead introduce a simple test statistic based on the variance least square estimator of variance components. With this comes a permutation procedure to approximate its finite sample distribution. The proposed test covers testing multiple variance components and any subset of them in LME models. Interestingly, our method does not depend on the distribution of the random effects and errors except for their mean and variance. We show, via simulations, that the proposed test has good operating characteristics with respect to Type I error and power. We conclude with an application of our process using real data from a study of the association of hyperglycemia and relative hyperinsulinemia.

[1]  C. Dean.  Testing for Overdispersion in Poisson and Binomial Regression Models , 1992 .

[2]  Amy H. Herring,et al.  Testing Random Effects in the Linear Mixed Model Using Approximate Bayes Factors , 2009, Biometrics.

[3]  Sanjoy K. Sinha,et al.  Bootstrap tests for variance components in generalized linear mixed models , 2009 .

[4]  E. Demidenko,et al.  Mixed Models: Theory and Applications (Wiley Series in Probability and Statistics) , 2004 .

[5]  R. Gueorguieva,et al.  A multivariate generalized linear mixed model for joint modelling of clustered outcomes in the exponential family , 2001 .

[6]  Takeshi Amemiya,et al.  A note on a heteroscedastic model , 1977 .

[7]  G. Robinson.  That BLUP is a Good Thing: The Estimation of Random Effects , 1991 .

[8]  D. Ruppert,et al.  Likelihood ratio tests in linear mixed models with one variance component , 2003 .

[9]  Xihong Lin.  Variance component testing in generalised linear models with random effects , 1997 .

[10]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[11]  Ana Ivelisse Avilés,et al.  Linear Mixed Models for Longitudinal Data , 2001, Technometrics.

[12]  D. Stram,et al.  Variance components testing in the longitudinal mixed effects model. , 1994, Biometrics.

[13]  Geert Molenberghs,et al.  The Use of Score Tests for Inference on Variance Components , 2003, Biometrics.

[14]  J. Singer,et al.  Likelihood ratio tests for variance components in linear mixed models , 2009 .

[15]  A. Shapiro.  Towards a unified theory of inequality constrained testing in multivariate analysis , 1988 .

[16]  D. Dunson,et al.  Random Effects Selection in Linear Mixed Models , 2003, Biometrics.

[17]  Paramsothy Silvapulle,et al.  A Score Test against One-Sided Alternatives , 1995 .

[18]  K. Liang,et al.  Asymptotic Properties of Maximum Likelihood Estimators and Likelihood Ratio Tests under Nonstandard Conditions , 1987 .

[19]  J. Miller,et al.  Asymptotic Properties of Maximum Likelihood Estimates in the Mixed Model of the Analysis of Variance , 1977 .

[20]  G. Zerbe,et al.  On multiple comparisons in the randomization analysis of growth and response curves. , 1986, Biometrics.

[21]  C. Crainiceanu,et al.  Restricted Likelihood Ratio Testing for Zero Variance Components in Linear Mixed Models , 2008 .

[22]  Joseph G Ibrahim,et al.  A Note on Permutation Tests for Variance Components in Multilevel Generalized Linear Mixed Models , 2007, Biometrics.

[23]  Satkartar K. Kinney,et al.  Fixed and Random Effects Selection in Linear and Logistic Models , 2007, Biometrics.

[24]  Justus Seely,et al.  Applying Wald's Variance Component Test , 1983 .

[25]  G. Molenberghs,et al.  Likelihood Ratio, Score, and Wald Tests in a Constrained Parameter Space , 2007 .

[26]  Gary O. Zerbe,et al.  Randomization Analysis of the Completely Randomized Design Extended to Growth and Response Curves , 1979 .

[27]  Karl J. Friston,et al.  Variance Components , 2003 .