Sum Scores in Twin Growth Curve Models: Practicality Versus Bias

To study behavioral or psychiatric phenotypes, multiple indices of the behavior or disorder are often collected that are thought to best reflect the phenotype. Combining these items into a single score (e.g. a sum score) is a simple and practical approach for modeling such data, but this simplicity can come at a cost in longitudinal studies, where the relevance of individual items often changes as a function of age. Such changes violate the assumptions of longitudinal measurement invariance (MI), and this violation has the potential to obfuscate the interpretation of the results of latent growth models fit to sum scores. The objectives of this study are (1) to investigate the extent to which violations of longitudinal MI lead to bias in parameter estimates of the average growth curve trajectory, and (2) whether absence of MI affects estimates of the heritability of these growth curve parameters. To this end, we analytically derive the bias in the estimated means and variances of the latent growth factors fit to sum scores when the assumption of longitudinal MI is violated. This bias is further quantified via Monte Carlo simulation, and is illustrated in an empirical analysis of aggression in children aged 3–12 years. These analyses show that measurement non-invariance across age can indeed bias growth curve mean and variance estimates, and our quantification of this bias permits researchers to weigh the costs of using a simple sum score in longitudinal studies. Simulation results indicate that the genetic variance decomposition of growth factors is, however, not biased due to measurement non-invariance across age, provided the phenotype is measurement invariant across birth-order and zygosity in twins.

[1]  W. Overton Comprar NICHD Early Child Care Research Network, Trajectories of Physical Aggression from Toddlerhood to Middle Childhood: Predictors, Correlates, and Outcomes | Willis F. Overton | 9781405132824 | Wiley , 2008 .

[2]  P. Sham,et al.  Longitudinal heritability of childhood aggression , 2016, American journal of medical genetics. Part B, Neuropsychiatric genetics : the official publication of the International Society of Psychiatric Genetics.

[3]  Conor V Dolan,et al.  Testing Systematic Genotype by Environment Interactions Using Item Level Data , 2014, Behavior Genetics.

[4]  Yves Rosseel,et al.  lavaan: An R Package for Structural Equation Modeling , 2012 .

[5]  P. Lichtenstein,et al.  A longitudinal twin study of the direction of effects between psychopathic personality and antisocial behaviour. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[6]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[7]  Lixia Cui,et al.  Dual Trajectories of Reactive and Proactive Aggression from Mid-childhood to Early Adolescence: Relations to Sensation Seeking, Risk Taking, and Moral Reasoning , 2016, Journal of abnormal child psychology.

[8]  R. Tremblay Why socialization fails: The case of chronic physical aggression. , 2003 .

[9]  J. Mcardle Dynamic but Structural Equation Modeling of Repeated Measures Data , 1988 .

[10]  M. C. Edwards,et al.  Measurement and the Study of Change , 2009 .

[11]  M. Neale,et al.  Implications of absence of measurement invariance for detecting sex limitation and genotype by environment interaction. , 2004, Twin research : the official journal of the International Society for Twin Studies.

[12]  W. Dickens,et al.  Applying Biometric Growth Curve Models to Developmental Synchronies in Cognitive Development: The Louisville Twin Study , 2015, Behavior Genetics.

[13]  A. Agresti Categorical data analysis , 1993 .

[14]  D I Boomsma,et al.  The genetic analysis of repeated measures. I. Simplex models , 1987, Behavior genetics.

[15]  G. Vogler,et al.  Methodology for genetic studies of twins and families , 1993 .

[16]  Dorret I. Boomsma,et al.  Variance Decomposition Using an IRT Measurement Model , 2007, Behavior genetics.

[17]  P. Lichtenstein,et al.  Sex differences in the etiology of aggressive and nonaggressive antisocial behavior: results from two twin studies. , 1999, Child development.

[18]  Linda M. Collins,et al.  New methods for the analysis of change , 2001 .

[19]  A. Agresti Wiley Series in Probability and Statistics , 2002 .

[20]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[21]  M. Rutter,et al.  Developmental psychopathology: Concepts and challenges , 2000, Development and Psychopathology.

[22]  K. Kendler,et al.  Longitudinal stability and change in consumption among female twins: Contributions of genetics , 1996, Development and Psychopathology.

[23]  Michael Frankfurter,et al.  Applied Longitudinal Data Analysis Modeling Change And Event Occurrence , 2016 .

[24]  R. Wirth The effects of measurement non -invariance on parameter estimation in latent growth models , 2008 .

[25]  M. Neale,et al.  Longitudinal Genetic Analysis of Problem Behaviors in Biologically Related and Unrelated Adoptees , 1998, Behavior genetics.

[26]  Gregory R. Hancock,et al.  An Illustration of Second-Order Latent Growth Models , 2001 .

[27]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[28]  Walter L. Leite A Comparison of Latent Growth Models for Constructs Measured by Multiple Items , 2007 .

[29]  William Meredith,et al.  The role of factorial invariance in modeling growth and change. , 2001 .

[30]  J J McArdle,et al.  Structured latent growth curves for twin data. , 2000, Twin research : the official journal of the International Society for Twin Studies.

[31]  R. P. McDonald,et al.  Structural Equations with Latent Variables , 1989 .

[32]  D. I. Boomsma,et al.  Individual Differences in Aggression: Genetic Analyses by Age, Gender, and Informant in 3-, 7-, and 10-Year-Old Dutch Twins , 2003, Behavior genetics.

[33]  Patricio Cumsille,et al.  Second-order latent growth models. , 2001 .

[34]  S. Reise,et al.  Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. , 1997 .

[35]  J. Mcardle,et al.  Latent variable growth within behavior genetic models , 1986, Behavior genetics.

[36]  E. Ferrer,et al.  Factorial Invariance and The Specification of Second-Order Latent Growth Models. , 2008, Methodology : European journal of research methods for the behavioral & social sciences.

[37]  Inga Schwabe,et al.  Assessing Genotype by Environment Interaction in Case of Heterogeneous Measurement Error , 2014, Behavior genetics.

[38]  D. I. Boomsma,et al.  Co-occurrence of Aggressive Behavior and Rule-Breaking Behavior at Age 12: Multi-Rater Analyses , 2003, Behavior genetics.

[39]  P. Scheet,et al.  The Young Netherlands Twin Register (YNTR): Longitudinal Twin and Family Studies in Over 70,000 Children , 2012, Twin Research and Human Genetics.

[40]  M. Neale,et al.  Problems with using sum scores for estimating variance components: contamination and measurement noninvariance. , 2005, Twin research and human genetics : the official journal of the International Society for Twin Studies.

[41]  Daniel B. McArtor,et al.  Genetic and Environmental Contributions to the Development of Childhood Aggression , 2018, Developmental psychology.

[42]  J. Mcardle,et al.  Structural Equation Models for Evaluating Dynamic Concepts Within Longitudinal Twin Analyses , 2003, Behavior genetics.

[43]  E. Ferrer,et al.  Factorial Invariance within Longitudinal Structural Equation Models: Measuring the Same Construct across Time. , 2010, Child development perspectives.

[44]  K. Grimm,et al.  Measurement Models, Estimation, and the Study of Change , 2013 .

[45]  W. Meredith Measurement invariance, factor analysis and factorial invariance , 1993 .

[46]  Dorret I. Boomsma,et al.  Aggression in children: unravelling the interplay of genes and environment through (epi)genetics and metabolomics , 2015 .

[47]  D. Boomsma,et al.  Sex Differences in Sum Scores May Be Hard to Interpret , 2009, Assessment.

[48]  S. A. Burt,et al.  Are there meaningful etiological differences within antisocial behavior? Results of a meta-analysis. , 2009, Clinical psychology review.

[49]  R. Goodman The Strengths and Difficulties Questionnaire: a research note. , 1997, Journal of child psychology and psychiatry, and allied disciplines.

[50]  D. Boomsma,et al.  Causes of Stability of Aggression from Early Childhood to Adolescence: A Longitudinal Genetic Analysis in Dutch Twins , 2003, Behavior genetics.

[51]  J. Singer,et al.  Applied Longitudinal Data Analysis , 2003 .

[52]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[53]  A. Raine,et al.  The genetic and environmental overlap between aggressive and non-aggressive antisocial behavior in children and adolescents using the self-report delinquency interview (SR-DI). , 2013, Journal of criminal justice.

[54]  G. Willemsen,et al.  Genetic and environmental stability in attention problems across the lifespan: evidence from the Netherlands twin register. , 2013, Journal of the American Academy of Child and Adolescent Psychiatry.

[55]  W. Arsenio,et al.  Trajectories of physical aggression from toddlerhood to middle childhood: predictors, correlates, and outcomes. , 2004, Monographs of the Society for Research in Child Development.

[56]  G. Willemsen,et al.  A powerful phenotype for gene‐finding studies derived from trajectory analyses of symptoms of anxiety and depression between age seven and 18 , 2016, American journal of medical genetics. Part B, Neuropsychiatric genetics : the official publication of the International Society of Psychiatric Genetics.