Consequences of Misspecifying the Error Covariance Structure in Linear Mixed Models for Longitudinal Data

Abstract. Repeated measures and longitudinal data are frequently analyzed using a linear mixed model. According to this approach, rather than presuming a certain type of covariance structure analysts choose the model that best describes their data prior to carrying out inferences of interest. Because it is not possible to know the underlying covariance structure in advance, researchers often use fit criteria to select from possible covariance structures. SAS Institute's (2004) Proc Mixed program, allows users to model the correct covariance structure by comparing Akaike's Information Criterion (AIC), Hurvich and Tsai's Criterion (AICC), Schwarz's Bayesian Criterion (BIC), Bozdogan's Criterion (CAIC), and Hannan and Quinn's Criterion (HQIC). Monte Carlo methods are used to examine performance of these criteria. The program also investigated the effects of misspecification on properties of the inferences. The results of the simulation show that neither criterion always lead to correct selection of model and...

[1]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[2]  M. Kenward,et al.  Parametric modelling of growth curve data: An overview , 2001 .

[3]  Ramon C. Littell,et al.  Modelling covariance structure in the analysis of repeated measures data. , 2000 .

[4]  R. Jennrich,et al.  Unbalanced repeated-measures models with structured covariance matrices. , 1986, Biometrics.

[5]  R. Wolfinger.  Heterogeneous Variance-Covariance Structures for Repeated Measures , 1996 .

[6]  Guillermo Vallejo,et al.  Modified Brown–Forsythe Procedure for Testing Interaction Effects in Split-Plot Designs , 2006, Multivariate behavioral research.

[7]  Brady T. West,et al.  Linear Mixed Models: A Practical Guide Using Statistical Software , 2006 .

[8]  B. G. Quinn,et al.  The determination of the order of an autoregression , 1979 .

[9]  Gilbert W. Fellingham,et al.  Performance of the Kenward–Roger Method when the Covariance Structure is Selected Using AIC and BIC , 2005 .

[10]  J. Ware,et al.  Applied Longitudinal Analysis , 2004 .

[11]  Russell D. Wolfinger,et al.  The Analysis of Repeated Measurements with Mixed-Model Adjusted F Tests , 2004 .

[12]  Russell D. Wolfinger,et al.  A comparison of two approaches for selecting covariance structures in the analysis of repeated measurements , 1998 .

[13]  R. Arvey,et al.  Small sample profile analysis with many variables. , 1982 .

[14]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[15]  John Ferron,et al.  Effects of Misspecifying the First-Level Error Structure in Two-Level Models of Change , 2002, Multivariate behavioral research.

[16]  Russell D. Wolfinger,et al.  The analysis of repeated measurements: a comparison of mixed-model satterthwaite f tests and a nonpooled adjusted degrees of freedom multivariate test , 1999 .

[17]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[18]  M. Kenward,et al.  Small sample inference for fixed effects from restricted maximum likelihood. , 1997, Biometrics.

[19]  Pablo Livacic-Rojas,et al.  Comparison of Two Procedures for Analyzing Small Sets of Repeated Measures Data , 2005, Multivariate behavioral research.

[20]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[21]  Kenny Q. Ye.  Statistical Tests for Mixed Linear Models , 2000, Technometrics.

[22]  H. Akaike.  A new look at the statistical model identification , 1974 .

[23]  C. R. Henderson,et al.  Best linear unbiased estimation and prediction under a selection model. , 1975, Biometrics.

[24]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[25]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[26]  André I. Khuri,et al.  Statistical Texts for Mixed Linear Models: Khuri/Statistical , 1998 .

[27]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .