Precision, Reliability, and Effect Size of Slope Variance in Latent Growth Curve Models: Implications for Statistical Power Analysis

Latent Growth Curve Models (LGCM) have become a standard technique to model change over time. Prediction and explanation of inter-individual differences in change are major goals in lifespan research. The major determinants of statistical power to detect individual differences in change are the magnitude of true inter-individual differences in linear change (LGCM slope variance), design precision, alpha level, and sample size. Here, we show that design precision can be expressed as the inverse of effective error. Effective error is determined by instrument reliability and the temporal arrangement of measurement occasions. However, it also depends on another central LGCM component, the variance of the latent intercept and its covariance with the latent slope. We derive a new reliability index for LGCM slope variance—effective curve reliability (ECR)—by scaling slope variance against effective error. ECR is interpretable as a standardized effect size index. We demonstrate how effective error, ECR, and statistical power for a likelihood ratio test of zero slope variance formally relate to each other and how they function as indices of statistical power. We also provide a computational approach to derive ECR for arbitrary intercept-slope covariance. With practical use cases, we argue for the complementary utility of the proposed indices of a study's sensitivity to detect slope variance when making a priori longitudinal design decisions or communicating study designs.

[1]  A. Satorra,et al.  Power of the likelihood ratio test in covariance structure analysis , 1985 .

[2]  John B. Willett,et al.  Some Results on Reliability for the Longitudinal Measurement of Change: Implications for the Design of Studies of Individual Growth , 1989 .

[3]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[4]  I. Stelzl Changing a Causal Hypothesis without Changing the Fit: some Rules for Generating Equivalent Path Models. , 1986, Multivariate behavioral research.

[5]  J. Willett,et al.  DEMONSTRATING THE RELIABILITY THE DIFFERENCE SCORE IN THE MEASUREMENT OF CHANGE , 1983 .

[6]  U. Lindenberger Human cognitive aging: Corriger la fortune? , 2014, Science.

[7]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[8]  Ken Kelley,et al.  Sample size planning for longitudinal models: accuracy in parameter estimation for polynomial change parameters. , 2011, Psychological methods.

[9]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[10]  D Kaplan,et al.  Asymptomatic Independence and Separability in Convariance Structure Models: Implications for Specification Error, Power, and Model Modification. , 1993, Multivariate behavioral research.

[11]  S. Hershberger,et al.  A Simple Rule for Generating Equivalent Models in Covariance Structure Modeling. , 1990, Multivariate behavioral research.

[12]  Philippe Rast,et al.  Longitudinal design considerations to optimize power to detect variances and covariances among rates of change: simulation results based on actual longitudinal studies. , 2014, Psychological methods.

[13]  Ulman Lindenberger,et al.  The effect of multiple indicators on the power to detect inter-individual differences in change. , 2010, The British journal of mathematical and statistical psychology.

[14]  K. Liang,et al.  Asymptotic Properties of Maximum Likelihood Estimators and Likelihood Ratio Tests under Nonstandard Conditions , 1987 .

[15]  H. Goldstein Multilevel mixed linear model analysis using iterative generalized least squares , 1986 .

[16]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[17]  M J Rovine,et al.  A Structural Modeling Approach to a Multilevel Random Coefficients Model , 2000, Multivariate behavioral research.

[18]  Emilio Ferrer,et al.  Longitudinal Modeling of Developmental Changes in Psychological Research , 2010 .

[19]  K. Jöreskog Statistical analysis of sets of congeneric tests , 1971 .

[20]  B Johansson,et al.  Origins of individual differences in episodic memory in the oldest-old: a population-based study of identical and same-sex fraternal twins aged 80 and older. , 1999, The journals of gerontology. Series B, Psychological sciences and social sciences.

[21]  H. Heath,et al.  Stability and Change in Human Characteristics. , 1965 .

[22]  Patrick J Curran,et al.  Have Multilevel Models Been Structural Equation Models All Along? , 2003, Multivariate behavioral research.

[23]  J J McArdle,et al.  Structural Factor Analysis Experiments with Incomplete Data. , 1994, Multivariate behavioral research.

[24]  Conor Dolan,et al.  On the likelihood ratio test in structural equation modeling when parameters are subject to boundary constraints. , 2006, Psychological methods.

[25]  P. Baltes,et al.  Life-span Developmental Psychology: Introduction To Research Methods , 1977 .

[26]  William Meredith,et al.  The role of factorial invariance in modeling growth and change. , 2001 .

[27]  Ken Kelley,et al.  Accuracy in Parameter Estimation for Targeted Effects in Structural Equation Modeling: Sample Size Planning for Narrow Confidence Intervals , 2022 .

[28]  John R. Nesselroade,et al.  History and rationale of longitudinal research , 1979 .

[29]  Timo von Oertzen,et al.  Power equivalence in structural equation modelling. , 2010, The British journal of mathematical and statistical psychology.

[30]  Emilio Ferrer,et al.  Alternative Structural Models for Multivariate Longitudinal Data Analysis , 2003 .

[31]  C. Borland,et al.  Effect Size , 2019, SAGE Research Methods Foundations.

[32]  Wei Wu,et al.  Search for efficient complete and planned missing data designs for analysis of change , 2016, Behavior research methods.

[33]  Thorsten Gerber,et al.  Applied Longitudinal Data Analysis Modeling Change And Event Occurrence , 2016 .

[34]  David Rogosa,et al.  A growth curve approach to the measurement of change. , 1982 .

[35]  Timo von Oertzen,et al.  Power equivalence in structural equation modelling. , 2010 .

[36]  R. MacCallum,et al.  Testing differences between nested covariance structure models: Power analysis and null hypotheses. , 2006, Psychological methods.

[37]  U. Staudinger,et al.  Life Span Theory in Developmental Psychology , 2007 .

[38]  Ulman Lindenberger,et al.  LIFESPAN: A tool for the computer-aided design of longitudinal studies , 2015, Front. Psychol..

[39]  Timo von Oertzen,et al.  Optimal study design with identical power: an application of power equivalence to latent growth curve models. , 2013, Psychology and aging.

[40]  Peter Green,et al.  SIMR: an R package for power analysis of generalized linear mixed models by simulation , 2016 .

[41]  William Meredith,et al.  Latent curve analysis , 1990 .

[42]  Yueh-Yun Chi,et al.  Confidence regions for repeated measures ANOVA power curves based on estimated covariance , 2013, BMC Medical Research Methodology.

[43]  Stanislav Kolenikov,et al.  Testing Negative Error Variances , 2012 .

[44]  Linda Wänström Sample Sizes for Two-Group Second-Order Latent Growth Curve Models , 2009 .

[45]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[46]  B. Muthén,et al.  How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power , 2002 .

[47]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[48]  Jason C. Allaire,et al.  Change in cognitive capabilities in the oldest old: the effects of proximity to death in genetically related individuals over a 6-year period. , 2004, Psychology and aging.

[49]  D. Wegener,et al.  The problem of equivalent models in applications of covariance structure analysis. , 1993, Psychological bulletin.

[50]  Zijun Ke,et al.  Detecting Individual Differences in Change: Methods and Comparisons , 2015 .

[51]  John Fox,et al.  OpenMx: An Open Source Extended Structural Equation Modeling Framework , 2011, Psychometrika.

[52]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[53]  J. Mcardle,et al.  Longitudinal Data Analysis Using Structural Equation Models , 2014 .

[54]  Taehun Lee,et al.  The Issue of Isopower in Power Analysis for Tests of Structural Equation Models , 2010 .

[55]  Ulman Lindenberger,et al.  Evaluating the Power of Latent Growth Curve Models to Detect Individual Differences in Change , 2008 .