Analyzing individual growth with clustered longitudinal data: A comparison between model-based and design-based multilevel approaches

To prevent biased estimates of intraindividual growth and interindividual variability when working with clustered longitudinal data (e.g., repeated measures nested within students; students nested within schools), individual dependency should be considered. A Monte Carlo study was conducted to examine to what extent two model-based approaches (multilevel latent growth curve model – MLGCM, and maximum model – MM) and one design-based approach (design-based latent growth curve model – D-LGCM) could produce unbiased and efficient parameter estimates of intraindividual growth and interindividual variability given clustered longitudinal data. The solutions of a single-level latent growth curve model (SLGCM) were also provided to demonstrate the consequences of ignoring individual dependency. Design factors considered in the present simulation study were as follows: number of clusters (NC = 10, 30, 50, 100, 150, 200, and 500) and cluster size (CS = 5, 10, and 20). According to our results, when intraindividual growth is of interest, researchers are free to implement MLGCM, MM, or D-LGCM. With regard to interindividual variability, MLGCM and MM were capable of producing accurate parameter estimates and SEs. However, when D-LGCM and SLGCM were applied, parameter estimates of interindividual variability were not comprised exclusively of the variability in individual (e.g., students) growth but instead were the combined variability of individual and cluster (e.g., school) growth, which cannot be interpreted. The take-home message is that D-LGCM does not qualify as an alternative approach to analyzing clustered longitudinal data if interindividual variability is of interest.

[1]  Bengt Muthén,et al.  General Longitudinal Modeling of Individual Differences in Experimental Designs: A Latent Variable Framework for Analysis and Power Estimation , 1997 .

[2]  Terry E. Duncan,et al.  Latent Variable Modeling of Longitudinal and Multilevel Substance Use Data. , 1997, Multivariate behavioral research.

[3]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[4]  J. Singer,et al.  Applied Longitudinal Data Analysis , 2003 .

[5]  Bengt Muthén,et al.  Beyond multilevel regression modeling: Multilevel analysis in a general latent variable framework. , 2011 .

[6]  Mark H. C. Lai,et al.  Examining the Rule of Thumb of Not Using Multilevel Modeling: The “Design Effect Smaller Than Two” Rule , 2015 .

[7]  Lingling Ma,et al.  Modeling Stability of Growth between Mathematics and Science Achievement During Middle and High School , 2004, Evaluation review.

[8]  James E. Rogers,et al.  Education Longitudinal Study of 2002: Base-Year to First Follow-Up Data File Documentation. NCES 2006-344. , 2005 .

[9]  Oi-Man Kwok,et al.  Please Scroll down for Article Multivariate Behavioral Research the Impacts of Ignoring a Crossed Factor in Analyzing Cross-classified Data , 2022 .

[10]  V. Willson,et al.  Using Design-Based Latent Growth Curve Modeling With Cluster-Level Predictor to Address Dependency , 2014 .

[11]  Patricia A. Berglund,et al.  Applied Survey Data Analysis , 2010 .

[12]  Mirjam Moerbeek,et al.  The Consequence of Ignoring a Level of Nesting in Multilevel Analysis , 2004, Multivariate behavioral research.

[13]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[14]  A. Satorra,et al.  Complex Sample Data in Structural Equation Modeling , 1995 .

[15]  B. Muthén,et al.  How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power , 2002 .

[16]  A. Morin,et al.  Statistical power of latent growth curve models to detect quadratic growth , 2014, Behavior research methods.

[17]  M. Julian The Consequences of Ignoring Multilevel Data Structures in Nonhierarchical Covariance Modeling , 2001 .

[18]  Cora J. M. Maas,et al.  The Accuracy of Multilevel Structural Equation Modeling With Pseudobalanced Groups and Small Samples , 2001 .

[19]  Jesse L. M. Wilkins,et al.  Mathematics Coursework Regulates Growth in Mathematics Achievement , 2007 .

[20]  Bengt Muthén,et al.  Latent Variable Growth Modeling with Multilevel Data , 1997 .

[21]  Laura M. Stapleton Variance Estimation Using Replication Methods in Structural Equation Modeling With Complex Sample Data , 2008 .

[22]  K. Warner Schaie,et al.  Longitudinal studies of adult psychological development , 1983 .

[23]  Victor L. Willson,et al.  The Impact of Ignoring a Level of Nesting Structure in Multilevel Growth Mixture Models: A Monte Carlo Study , 2010 .

[24]  Samuel B. Green,et al.  The Impact of Misspecifying the Within-Subject Covariance Structure in Multiwave Longitudinal Multilevel Models: A Monte Carlo Study , 2007 .

[25]  John Hattie,et al.  Individual Differences in Reading Development , 2014 .

[26]  Lijuan Wang,et al.  Statistical power analysis for growth curve models using SAS , 2009, Behavior research methods.

[27]  Scott L. Thomas,et al.  An introduction to multilevel modeling techniques, 2nd ed. , 2009 .

[28]  A. Boomsma,et al.  Robustness Studies in Covariance Structure Modeling , 1998 .

[29]  Ulman Lindenberger,et al.  Evaluating the Power of Latent Growth Curve Models to Detect Individual Differences in Change , 2008 .

[30]  Oi-Man Kwok,et al.  Using SEM to Analyze Complex Survey Data: A Comparison between Design-Based Single-Level and Model-Based Multilevel Approaches , 2012 .

[31]  G. Nagy,et al.  Cumulative advantages and the emergence of social and ethnic inequality: Matthew effects in reading and mathematics development within elementary schools? , 2012, Child development.

[32]  M. Blanca,et al.  Psychological virtues during adolescence: A longitudinal study of gender differences , 2014 .

[33]  James A. Bovaird Multilevel Structural Equation Models for Contextual Factors , 2007 .

[34]  Patrick J Curran,et al.  Twelve Frequently Asked Questions About Growth Curve Modeling , 2010, Journal of cognition and development : official journal of the Cognitive Development Society.

[35]  Jaehoon Lee,et al.  Ignoring Clustering in Confirmatory Factor Analysis: Some Consequences for Model Fit and Standardized Parameter Estimates , 2014, Multivariate behavioral research.

[36]  A. Bandura Perceived Self-Efficacy in Cognitive Development and Functioning , 1993, Educational Psychologist.

[37]  S Natasha Beretvas,et al.  The Impact of Inappropriate Modeling of Cross-Classified Data Structures , 2006, Multivariate behavioral research.