Effect of Parameterization on Statistical Power and Effect Size Estimation in Latent Growth Modeling

ABSTRACT The difference between groups in their random slopes is frequently examined in latent growth modeling to evaluate treatment efficacy. However, when end centering is used for model parameterization with a randomized design, the difference in the random intercepts is the model-estimated mean difference between the groups at the end of the study, which has the same expected value as the product of the coefficient for the slope difference and study duration. A Monte Carlo study found that (a) the statistical power to detect the treatment effect was greater when determined from the intercept instead of the slope difference, and (b) the standard error of the model-estimated mean difference was smaller when obtained from the intercept difference. Investigators may reduce Type II errors by comparing groups in random intercepts instead of random slopes to test treatment effects, and should therefore conduct power assessments using end centering to detect each difference.

[1]  A. Bryk,et al.  Early vocabulary growth: Relation to language input and gender. , 1991 .

[2]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[3]  J. Tobin,et al.  Depressive Symptoms and Gestational Length Among Pregnant Adolescents: Cluster Randomized Control Trial of CenteringPregnancy® Plus Group Prenatal Care , 2017, Journal of consulting and clinical psychology.

[4]  Ken Kelley,et al.  On effect size. , 2012, Psychological methods.

[5]  Jessaca Spybrook,et al.  Optimal Design for Longitudinal and Multilevel Research: Documentation for the "Optimal Design" Software , 2006 .

[6]  G. Guo,et al.  Gender Differences in Mathematical Trajectories , 2001 .

[7]  B. Muthén,et al.  The development of heavy drinking and alcohol-related problems from ages 18 to 37 in a U.S. national sample. , 2000, Journal of studies on alcohol.

[8]  D. Mackinnon,et al.  Statistical properties of four effect-size measures for mediation models , 2017, Behavior Research Methods.

[9]  Mitchell H. Gail,et al.  A Delta Method for Implicitly Defined Random Variables , 1989 .

[10]  Mike W. L. Cheung,et al.  Comparison of methods for constructing confidence intervals of standardized indirect effects , 2009, Behavior research methods.

[11]  Kristopher J Preacher,et al.  Effect size measures for mediation models: quantitative strategies for communicating indirect effects. , 2011, Psychological methods.

[12]  Jolynn Pek,et al.  Reporting Effect Sizes in Original Psychological Research: A Discussion and Tutorial , 2017, Psychological methods.

[13]  A. Feingold Time-Varying Effect Sizes for Quadratic Growth Models in Multilevel and Latent Growth Modeling , 2019, Structural equation modeling : a multidisciplinary journal.

[14]  Mirjam Moerbeek,et al.  Multilevel Analysis : Techniques and Applications, Third Edition , 2017 .

[15]  Karen A. F. Copeland Design and Analysis of Experiments, Volume 1: Introduction to Experimental Design , 1995 .

[16]  G. S. Pettit,et al.  Dispositional, Demographic, and Social Predictors of Trajectories of Intimate Partner Aggression in Early Adulthood , 2017, Journal of consulting and clinical psychology.

[17]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[18]  E. Odgaard,et al.  Confidence intervals for effect sizes: compliance and clinical significance in the Journal of Consulting and clinical Psychology. , 2010, Journal of consulting and clinical psychology.

[19]  D. Bybee,et al.  Examining the Impact of Differential Cultural Adaptation With Latina/o Immigrants Exposed to Adapted Parent Training Interventions , 2017, Journal of consulting and clinical psychology.

[20]  Katherine E. Masyn,et al.  Latent Class Analysis and Finite Mixture Modeling , 2013 .

[21]  S D Imber,et al.  Some conceptual and statistical issues in analysis of longitudinal psychiatric data. Application to the NIMH treatment of Depression Collaborative Research Program dataset. , 1993, Archives of general psychiatry.

[22]  A. Hayes Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[23]  G. A. Marcoulides,et al.  Multilevel Analysis Techniques and Applications , 2002 .

[24]  Jam Khojasteh,et al.  Analyzing Longitudinal Data Using Natural Cubic Smoothing Splines , 2018 .

[25]  Matthias G. Arend,et al.  Statistical power in two-level models: A tutorial based on Monte Carlo simulation. , 2019, Psychological methods.

[26]  W. Shadish,et al.  A standardized mean difference effect size for single case designs , 2012, Research synthesis methods.

[27]  R. Grissom,et al.  Effect Sizes for Research : Univariate and Multivariate Applications, Second Edition , 2005 .

[28]  T. Baguley Standardized or simple effect size: what should be reported? , 2009, British journal of psychology.

[29]  A. Feingold,et al.  New approaches for examining associations with latent categorical variables: applications to substance abuse and aggression. , 2014, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[30]  A. Feingold Confidence interval estimation for standardized effect sizes in multilevel and latent growth modeling. , 2015, Journal of consulting and clinical psychology.

[31]  Katherine H. Tsai,et al.  Child STEPs in California: A Cluster Randomized Effectiveness Trial Comparing Modular Treatment With Community Implemented Treatment for Youth With Anxiety, Depression, Conduct Problems, or Traumatic Stress , 2017, Journal of consulting and clinical psychology.

[32]  Goran Kuljanin,et al.  A cautionary note on modeling growth trends in longitudinal data. , 2011, Psychological methods.

[33]  Yves Rosseel,et al.  lavaan: An R Package for Structural Equation Modeling , 2012 .

[34]  Jesse A. Berlin,et al.  Effect sizes for dichotomous data. , 2009 .

[35]  S. Raudenbush,et al.  Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. , 2001, Psychological methods.

[36]  E. L. Lehmann,et al.  Basic Concepts of Probability and Statistics , 1964 .

[37]  E. Stice,et al.  Clinician-Led, Peer-Led, and Internet-Delivered Dissonance-Based Eating Disorder Prevention Programs: Acute Effectiveness of These Delivery Modalities , 2017, Journal of consulting and clinical psychology.

[38]  B. Muthén,et al.  How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power , 2002 .

[39]  A. Satorra,et al.  Power of the likelihood ratio test in covariance structure analysis , 1985 .

[40]  Donald Hedeker,et al.  Longitudinal Data Analysis , 2006 .

[41]  M. H. Lai Bootstrap Confidence Intervals for Multilevel Standardized Effect Size , 2020, Multivariate behavioral research.

[42]  J. Krystal,et al.  Move over ANOVA: progress in analyzing repeated-measures data and its reflection in papers published in the Archives of General Psychiatry. , 2004, Archives of general psychiatry.

[43]  A. Agresti Categorical data analysis , 1993 .

[44]  A. Feingold New Approaches for Estimation of Effect Sizes and their Confidence Intervals for Treatment Effects from Randomized Controlled Trials. , 2019, The quantitative methods for psychology.

[45]  D. Mackinnon,et al.  Mediation analysis with binary outcomes: Direct and indirect effects of pro-alcohol influences on alcohol use disorders. , 2019, Addictive behaviors.

[46]  A. Feingold Effect sizes for growth-modeling analysis for controlled clinical trials in the same metric as for classical analysis. , 2009, Psychological methods.

[47]  A. Feingold A Regression Framework for Effect Size Assessments in Longitudinal Modeling of Group Differences , 2013, Review of general psychology : journal of Division 1, of the American Psychological Association.

[48]  Bengt Muthén,et al.  General Longitudinal Modeling of Individual Differences in Experimental Designs: A Latent Variable Framework for Analysis and Power Estimation , 1997 .

[49]  Harvey Goldstein,et al.  Multilevel Statistical Models: Goldstein/Multilevel Statistical Models , 2010 .