Longitudinal design considerations to optimize power to detect variances and covariances among rates of change: simulation results based on actual longitudinal studies.

We investigated the power to detect variances and covariances in rates of change in the context of existing longitudinal studies using linear bivariate growth curve models. Power was estimated by means of Monte Carlo simulations. Our findings show that typical longitudinal study designs have substantial power to detect both variances and covariances among rates of change in a variety of cognitive, physical functioning, and mental health outcomes. We performed simulations to investigate the interplay among number and spacing of occasions, total duration of the study, effect size, and error variance on power and required sample size. The relation between growth rate reliability (GRR) and effect size to the sample size required to detect power greater than or equal to .80 was nonlinear, with rapidly decreasing sample sizes needed as GRR increases. The results presented here stand in contrast to previous simulation results and recommendations (Hertzog, Lindenberger, Ghisletta, & von Oertzen, 2006; Hertzog, von Oertzen, Ghisletta, & Lindenberger, 2008; von Oertzen, Ghisletta, & Lindenberger, 2010), which are limited due to confounds between study length and number of waves, error variance with growth curve reliability, and parameter values that are largely out of bounds of actual study values. Power to detect change is generally low in the early phases (i.e., first years) of longitudinal studies but can substantially increase if the design is optimized. We recommend additional assessments, including embedded intensive measurement designs, to improve power in the early phases of long-term longitudinal studies.

[1]  R. MacCallum,et al.  Studying Multivariate Change Using Multilevel Models and Latent Curve Models. , 1997, Multivariate behavioral research.

[2]  Goran Kuljanin,et al.  A cautionary note on modeling growth trends in longitudinal data. , 2011, Psychological methods.

[3]  B. Leadbeater,et al.  Risk and Protective Factors for Adolescent Substance Use and Mental Health Symptoms , 2009 .

[4]  D. Hultsch,et al.  Memory Change in the Aged , 1998 .

[5]  S. Maxwell Longitudinal designs in randomized group comparisons : When will intermediate observations increase statistical power ? , 1998 .

[6]  P. Bliese Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. , 2000 .

[7]  B Johansson,et al.  Origins of individual differences in episodic memory in the oldest-old: a population-based study of identical and same-sex fraternal twins aged 80 and older. , 1999, The journals of gerontology. Series B, Psychological sciences and social sciences.

[8]  John B. Willett,et al.  Some Results on Reliability for the Longitudinal Measurement of Change: Implications for the Design of Studies of Individual Growth , 1989 .

[9]  P. Rabbitt,et al.  Contribution of cognitive abilities to performance and improvement on a substitution coding task. , 1999, Psychology and aging.

[10]  A. Beekman,et al.  COHORT PROFILE Cohort Profile : The Longitudinal Aging Study Amsterdam , 2011 .

[11]  An overview of health. , 1982, The New Zealand medical journal.

[12]  Roger A. Dixon,et al.  The Victoria Longitudinal Study: From Characterizing Cognitive Aging to Illustrating Changes in Memory Compensation , 2004 .

[13]  John Fox,et al.  OpenMx: An Open Source Extended Structural Equation Modeling Framework , 2011, Psychometrika.

[14]  Tom A. B. Snijders,et al.  Variance Component Testing in Multilevel Models , 2001 .

[15]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[16]  Brian D. Ripley,et al.  Modern applied statistics with S, 4th Edition , 2002, Statistics and computing.

[17]  F. Huppert,et al.  CAMDEX: A Standardised Instrument for the Diagnosis of Mental Disorder in the Elderly with Special Reference to the Early Detection of Dementia , 1986, British Journal of Psychiatry.

[18]  E. BarnesGordon,et al.  Risk and Protective Factors for Adolescent Substance Use and Mental Health Symptoms , 2009 .

[19]  Mitchell H. Gail,et al.  A Reminder of the Fallibility of the Wald Statistic , 1996 .

[20]  A. Satorra,et al.  Power of the likelihood ratio test in covariance structure analysis , 1985 .

[21]  B. Tonge,et al.  The Developmental Behavior Checklist: The development and validation of an instrument to assess behavioral and emotional disturbance in children and adolescents with mental retardation , 1995, Journal of autism and developmental disorders.

[22]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[23]  Bengt Muthén,et al.  General Longitudinal Modeling of Individual Differences in Experimental Designs: A Latent Variable Framework for Analysis and Power Estimation , 1997 .

[24]  D. Hedeker,et al.  Sample Size Estimation for Longitudinal Designs with Attrition: Comparing Time-Related Contrasts Between Two Groups , 1999 .

[25]  Todd D. Little,et al.  Handbook of developmental research methods , 2012 .

[26]  J J McArdle,et al.  Latent growth curves within developmental structural equation models. , 1987, Child development.

[27]  J. Stockman Psychopathology in Young People With Intellectual Disability , 2008 .

[28]  Paul B. Baltes,et al.  The Berlin Aging Study , 1994, Ageing and Society.

[29]  J. Banks,et al.  Financial circumstances, health and well-being of the older population in England. The 2008 English Longitudinal Study of Ageing , 2010 .

[30]  J. Mcardle Dynamic but Structural Equation Modeling of Repeated Measures Data , 1988 .

[31]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[32]  E. Zelinski,et al.  Sixteen-year longitudinal and time lag changes in memory and cognition in older adults. , 1997, Psychology and aging.

[33]  R. Plomin,et al.  Substantial genetic influence on mild mental impairment in early childhood. , 2004, American journal of mental retardation : AJMR.

[34]  M. Sliwinski,et al.  Design and Analysis of Longitudinal Studies on Aging , 2006 .

[35]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[36]  R. Dixon,et al.  Use it or lose it: engaged lifestyle as a buffer of cognitive decline in aging? , 1999, Psychology and aging.

[37]  Kenneth A. Bollen,et al.  Monte Carlo Experiments: Design and Implementation , 2001 .

[38]  Daniel E. Bontempo,et al.  Psychopathology in young people with intellectual disability. , 2006, JAMA.

[39]  R. Suzman,et al.  An Overview of the Health and Retirement Study , 1995 .

[40]  Ulman Lindenberger,et al.  Evaluating the Power of Latent Growth Curve Models to Detect Individual Differences in Change , 2008 .

[41]  L. Radloff The CES-D Scale , 1977 .

[42]  Daniel E. Bontempo,et al.  Correlated and coupled within-person change in emotional and behavioral disturbance in individuals with intellectual disability. , 2009, American journal on intellectual and developmental disabilities.

[43]  Nicholas T. Longford On Estimating Standard Errors in Multilevel Analysis , 2000 .

[44]  R. Stoel,et al.  Time Dependence of Growth Parameters in Latent Growth Curve Models with Time Invariant Covariates , 2003 .

[45]  D. Wechsler Manual for the Wechsler Adult Intelligence Scale. , 1955 .

[46]  Ken Kelley,et al.  Sample size planning for longitudinal models: accuracy in parameter estimation for polynomial change parameters. , 2011, Psychological methods.

[47]  Ulman Lindenberger,et al.  Simulating Statistical Power in Latent Growth Curve Modeling: A Strategy for Evaluating Age-Based Changes in Cognitive Resources , 2011, Resource-Adaptive Cognitive Processes.

[48]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[49]  U. Lindenberger,et al.  On the power of multivariate latent growth curve models to detect correlated change. , 2006, Psychological methods.

[50]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[51]  A. Brereton,et al.  Manual for the Developmental Behaviour Checklist: Primary Carer Version (DBC-P) and Teacher Version (DBC-T) (2nd ed.) , 2002 .

[52]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[53]  Jason C. Allaire,et al.  Change in cognitive capabilities in the oldest old: the effects of proximity to death in genetically related individuals over a 6-year period. , 2004, Psychology and aging.

[54]  M. Albert,et al.  Interrelationships of peak expiratory flow rate with physical and cognitive function in the elderly: MacArthur Foundation studies of aging. , 1995, The journals of gerontology. Series A, Biological sciences and medical sciences.

[55]  Philippe Rast,et al.  Intensive Measurement Designs for Research on Aging. , 2012, GeroPsych.

[56]  J. Banks,et al.  Living in the 21st century: older people in England: The 2006 English Longitudinal Study of Ageing , 2008 .

[57]  Joseph R. Rausch,et al.  Sample size planning for statistical power and accuracy in parameter estimation. , 2008, Annual review of psychology.

[58]  Charles E Cunningham,et al.  The Brief Child and Family Phone Interview (BCFPI): 1. Rationale, development, and description of a computerized children's mental health intake and outcome assessment tool. , 2009, Journal of child psychology and psychiatry, and allied disciplines.

[59]  Evaluating Individual Differences in Psychological Processes , 2011 .

[60]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[61]  S. Covey,et al.  Substantial Genetic Influence on Cognitive Abilities in Twins 80 or More Years Old , 1997 .

[62]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[63]  K. Schaie,et al.  Longitudinal studies in aging research. , 2001 .

[64]  K. Jeter A Reminder , 1972, Journal of wound, ostomy, and continence nursing : official publication of The Wound, Ostomy and Continence Nurses Society.

[65]  R Cederlöf,et al.  The Swedish Twin Registry. , 1978, Progress in clinical and biological research.

[66]  U. Lindenberger,et al.  Cognitive and sensory declines in old age: gauging the evidence for a common cause. , 2009, Psychology and aging.

[67]  R. MacCallum,et al.  Power analysis and determination of sample size for covariance structure modeling. , 1996 .

[68]  Monica Zilbovicius,et al.  Cognitive Functioning in , 1995 .