The GRoLTS-Checklist: Guidelines for Reporting on Latent Trajectory Studies

Estimating models within the mixture model framework, like latent growth mixture modeling (LGMM) or latent class growth analysis (LCGA), involves making various decisions throughout the estimation process. This has led to a wide variety in how results of latent trajectory analysis are reported. To overcome this issue, using a 4-round Delphi study, we developed Guidelines for Reporting on Latent Trajectory Studies (GRoLTS). The purpose of GRoLTS is to present criteria that should be included when reporting the results of latent trajectory analysis across research fields. We have gone through a systematic process to identify key components that, according to a panel of experts, are necessary when reporting results for trajectory studies. We applied GRoLTS to 38 papers where LGMM or LCGA was used to study trajectories of posttraumatic stress after a traumatic event.

[1]  Frauke Kreuter,et al.  Analyzing Criminal Trajectory Profiles: Bridging Multilevel and Group-based Approaches Using Growth Mixture Modeling , 2008 .

[2]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[3]  Jaap J. A. Denissen,et al.  Reducing bias due to systematic attrition in longitudinal studies: The benefits of multiple imputation , 2014 .

[4]  J. Vermunt.  K-means may perform as well as mixture model clustering but may also be much worse: comment on Steinley and Brusco (2011). , 2011, Psychological methods.

[5]  C. Hertzog,et al.  Assessing psychological change in adulthood: an overview of methodological issues. , 2003, Psychology and aging.

[6]  S G West,et al.  Putting the individual back into individual growth curves. , 2000, Psychological methods.

[7]  Bengt Muthén,et al.  Auxiliary Variables in Mixture Modeling: Three-Step Approaches Using Mplus , 2014 .

[8]  Jeroen K. Vermunt,et al.  Robustness of Stepwise Latent Class Modeling With Continuous Distal Outcomes , 2016 .

[9]  P. Deb.  Finite Mixture Models , 2008 .

[10]  Jeroen K. Vermunt,et al.  Latent Class Modeling with Covariates: Two Improved Three-Step Approaches , 2010, Political Analysis.

[11]  Daniel J Bauer,et al.  Distributional assumptions of growth mixture models: implications for overextraction of latent trajectory classes. , 2003, Psychological methods.

[12]  John Fox,et al.  OpenMx: An Open Source Extended Structural Equation Modeling Framework , 2011, Psychometrika.

[13]  W. DeSarbo,et al.  An Empirical Pooling Approach for Estimating Marketing Mix Elasticities with PIMS Data , 1993 .

[14]  H. Delaney,et al.  Ignoring individual differences in times of assessment in growth curve modeling , 2016 .

[15]  Dori B. Reissman,et al.  Trajectories of PTSD risk and resilience in World Trade Center responders: an 8-year prospective cohort study , 2013, Psychological Medicine.

[16]  D. Rindskopf.  Mixture or homogeneous? Comment on Bauer and Curran (2003). , 2003, Psychological methods.

[17]  Arin M. Connell,et al.  Response to commentaries on target paper, ‘Growth Mixture Modeling in Developmental Psychology’ , 2006 .

[18]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[19]  Marcel Croon,et al.  Estimating Latent Structure Models with Categorical Variables: One-Step Versus Three-Step Estimators , 2004, Political Analysis.

[20]  J. Wicherts,et al.  Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results , 2011, PloS one.

[21]  C. Anderson‐Cook,et al.  Group-Based Modeling of Development , 2006 .

[22]  Jos Twisk,et al.  Classifying developmental trajectories over time should be done with great caution: a comparison between methods. , 2012, Journal of clinical epidemiology.

[23]  Nilam Ram,et al.  Nonlinear Growth Models in Mplus and SAS , 2009, Structural equation modeling : a multidisciplinary journal.

[24]  Thorsten Gerber,et al.  Applied Longitudinal Data Analysis Modeling Change And Event Occurrence , 2016 .

[25]  Neal O. Jeffries.  A note on 'Testing the number of components in a normal mixture' , 2003 .

[26]  Katherine E. Masyn,et al.  New approaches to studying problem behaviors: a comparison of methods for modeling longitudinal, categorical adolescent drinking data. , 2009, Developmental psychology.

[27]  Arin M. Connell,et al.  Growth Mixture Modelling in Developmental Psychology: Overview and Demonstration of Heterogeneity in Developmental Trajectories of Adolescent Antisocial Behaviour , 2006 .

[28]  Sven L Klijn,et al.  Introducing the fit-criteria assessment plot – A visualisation tool to assist class enumeration in group-based trajectory modelling , 2017, Statistical methods in medical research.

[29]  A. Piquero.  Taking Stock of Developmental Trajectories of Criminal Activity over the Life Course , 2008 .

[30]  M. Goldman,et al.  Variation in the drinking trajectories of freshmen college students. , 2005, Journal of consulting and clinical psychology.

[31]  B. Muthén,et al.  Auxiliary Variables in Mixture Modeling: Three-Step Approaches Using Mplus , 2014 .

[32]  Tony Jung,et al.  An introduction to latent class growth analysis and growth mixture modeling. , 2008 .

[33]  Sarah Depaoli,et al.  Mixture class recovery in GMM under varying degrees of class separation: frequentist versus Bayesian estimation. , 2013, Psychological methods.

[34]  M. Llabre,et al.  Children’s Postdisaster Trajectories of PTS Symptoms: Predicting Chronic Distress , 2013, Child & youth care forum.

[35]  Jeroen K. Vermunt,et al.  Multilevel Growth Mixture Models for Classifying Groups , 2010 .

[36]  Daniel S. Nagin,et al.  Analyzing developmental trajectories: A semiparametric, group-based approach , 1999 .

[37]  D. Moher,et al.  Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review , 2006, The Medical journal of Australia.

[38]  K. Roeder,et al.  A SAS Procedure Based on Mixture Models for Estimating Developmental Trajectories , 2001 .

[39]  Karen-Inge Karstoft,et al.  Latent trajectories of trauma symptoms and resilience: the 3-year longitudinal prospective USPER study of Danish veterans deployed in Afghanistan. , 2014, The Journal of clinical psychiatry.

[40]  Kamel Jedidi,et al.  A maximum likelihood method for latent class regression involving a censored dependent variable , 1993 .

[41]  Nilam Ram,et al.  Methods and Measures: Growth mixture modeling: A method for identifying differences in longitudinal change among unobserved groups , 2009, International journal of behavioral development.

[42]  Jeroen K. Vermunt,et al.  Estimating the Association between Latent Class Membership and External Variables Using Bias-adjusted Three-step Approaches , 2013 .

[43]  D S Nagin,et al.  Analyzing developmental trajectories of distinct but related behaviors: a group-based method. , 2001, Psychological methods.

[44]  Alyssa M. Boasso,et al.  Posttraumatic stress in deployed Marines: prospective trajectories of early adaptation. , 2015, Journal of abnormal psychology.

[45]  James Algina,et al.  The Consequences of Ignoring Variability in Measurement Occasions Within Data Collection Waves in Latent Growth Models , 2014, Multivariate behavioral research.

[46]  Jay Magidson,et al.  Technical Guide for Latent GOLD 5.1: Basic, Advanced, and Syntax 1 , 2016 .

[47]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[48]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[49]  B. Muthén,et al.  Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation Study , 2007 .

[50]  Daniel J Bauer,et al.  The integration of continuous and discrete latent variable models: potential problems and promising opportunities. , 2004, Psychological methods.

[51]  B. Muthén,et al.  Finite Mixture Modeling with Mixture Outcomes Using the EM Algorithm , 1999, Biometrics.

[52]  Jeroen K. Vermunt,et al.  Longitudinal Research Using Mixture Models , 2010 .

[53]  Ralf Dresner,et al.  Health Measurement Scales A Practical Guide To Their Development And Use , 2016 .

[54]  Karen Bandeen-Roche,et al.  Residual Diagnostics for Growth Mixture Models , 2005 .

[55]  K. Land,et al.  AGE, CRIMINAL CAREERS, AND POPULATION HETEROGENEITY: SPECIFICATION AND ESTIMATION OF A NONPARAMETRIC, MIXED POISSON MODEL* , 1993 .

[56]  Terry E. Duncan,et al.  An Introduction to Latent Variable Growth Curve Modeling: Concepts, Issues, and Application, Second Edition , 1999 .

[57]  D. Rubin,et al.  Testing the number of components in a normal mixture , 2001 .

[58]  S. Depaoli,et al.  Two Studies of Specification Error in Models for Categorical Latent Variables , 2011 .

[59]  Brian A. Nosek,et al.  Promoting Transparency in Social Science Research , 2014, Science.

[60]  P. Schmidt,et al.  Editorial: Measurement Invariance , 2015, Front. Psychol..

[61]  J. Hoeksma,et al.  On growth curves and mixture models , 2006 .

[62]  J. Schafer,et al.  Missing data: our view of the state of the art. , 2002, Psychological methods.

[63]  Kenneth A Bollen,et al.  The role of coding time in estimating and interpreting growth curve models. , 2004, Psychological methods.

[64]  Chun Wang,et al.  Fitting a linear-linear piecewise growth mixture model with unknown knots: A comparison of two common approaches to inference. , 2015, Psychological methods.

[65]  Bengt Muthén,et al.  The potential of growth mixture modelling , 2006 .

[66]  J. Wicherts.  Science revolves around the data , 2013 .

[67]  Brian A. Nosek,et al.  Promoting an open research culture : Author guidelines for journals could help to promote transparency , openness , and reproducibility , 2015 .

[68]  J. Laub,et al.  Methodological Sensitivities to Latent Class Analysis of Long-Term Criminal Trajectories , 2004 .

[69]  R. van de Schoot,et al.  The experience of traumatic events disrupts the measurement invariance of a posttraumatic stress scale , 2014, Front. Psychol..

[70]  G. Bonanno,et al.  Prospective trajectories of posttraumatic stress in college women following a campus mass shooting. , 2014, Journal of traumatic stress.

[71]  B. Muthén,et al.  Integrating person-centered and variable-centered analyses: growth mixture modeling with latent trajectory classes. , 2000, Alcoholism, clinical and experimental research.

[72]  J. Singer,et al.  Applied Longitudinal Data Analysis , 2003 .

[73]  W. Holmes Finch,et al.  Conducting Confirmatory Latent Class Analysis Using Mplus , 2011 .

[74]  M. Kivimäki,et al.  Job Contract at Birth of the First Child as a Predictor of Women’s Labor Market Attachment: Trajectory Analyses over 11 Years , 2015 .

[75]  Nicole A. Lazar,et al.  Statistical Analysis With Missing Data , 2003, Technometrics.

[76]  Daniel J Bauer,et al.  Local solutions in the estimation of growth mixture models. , 2006, Psychological methods.

[77]  G. Celeux,et al.  An entropy criterion for assessing the number of clusters in a mixture model , 1996 .

[78]  A. Shalev,et al.  Early PTSD Symptom Trajectories: Persistence, Recovery, and Response to Treatment: Results from the Jerusalem Trauma Outreach and Prevention Study (J-TOPS) , 2013, PloS one.

[79]  Brian A. Nosek,et al.  Recommendations for Increasing Replicability in Psychology † , 2013 .

[80]  Stefany Coxe,et al.  Statistical Power to Detect the Correct Number of Classes in Latent Profile Analysis , 2013, Structural equation modeling : a multidisciplinary journal.

[81]  B. Muthén.  Latent Variable Mixture Modeling , 2001 .

[82]  Daniel J. Bauer,et al.  Overextraction of latent trajectory classes: Much ado about nothing? Reply to Rindskopf (2003), Muthén (2003), and Cudeck and Henly (2003) , 2003 .

[83]  Benoit Liquet,et al.  Estimation of extended mixed models using latent classes and latent processes: the R package lcmm , 2015, 1503.00890.

[84]  Daniel J. Bauer.  Observations on the Use of Growth Mixture Models in Psychological Research , 2007 .

[85]  R. van de Schoot,et al.  How to handle missing data: A comparison of different approaches , 2015 .

[86]  Bengt Muthén,et al.  Statistical and substantive checking in growth mixture modeling: comment on Bauer and Curran (2003). , 2003, Psychological methods.

[87]  Weiqi Luo,et al.  Analysing ecological data , 2009 .

[88]  D. Rubin,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[89]  E. Erosheva,et al.  Breaking Bad: Two Decades of Life-Course Data Analysis in Criminology, Developmental Psychology, and Beyond , 2014 .

[90]  H. Akaike.  INFORMATION THEORY AS AN EXTENSION OF THE MAXIMUM LIKELIHOOD , 1973 .

[91]  Peter B. Jones,et al.  Developmental typology of trajectories to nighttime bladder control: epidemiologic application of longitudinal latent class analysis. , 2003, American journal of epidemiology.