Distinguishing state variability from trait change in longitudinal data: The role of measurement (non)invariance in latent state-trait analyses

Researchers analyzing longitudinal data often want to find out whether the process they study is characterized by (1) short-term state variability, (2) long-term trait change, or (3) a combination of state variability and trait change. Classical latent state-trait (LST) models are designed to measure reversible state variability around a fixed set-point or trait, whereas latent growth curve (LGC) models focus on long-lasting and often irreversible trait changes. In the present article, we contrast LST and LGC models from the perspective of measurement invariance testing. We show that establishing a pure state-variability process requires (1) the inclusion of a mean structure and (2) establishing strong factorial invariance in LST analyses. Analytical derivations and simulations demonstrate that LST models with noninvariant parameters can mask the fact that a trait-change or hybrid process has generated the data. Furthermore, the inappropriate application of LST models to trait change or hybrid data can lead to bias in the estimates of consistency and occasion specificity, which are typically of key interest in LST analyses. Four tips for the proper application of LST models are provided.

[1]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[2]  Terry E. Duncan,et al.  An Introduction to Latent Variable Growth Curve Modeling: Concepts, Issues, and Application, Second Edition , 1999 .

[3]  Rolf Steyer,et al.  Classical (Psychometric) Test Theory , 2001 .

[4]  Gordon W. Cheung,et al.  Testing Factorial Invariance across Groups: A Reconceptualization and Proposed New Method , 1999 .

[5]  J. Mcardle,et al.  Latent difference score structural models for linear dynamic analyses with incomplete longitudinal data. , 2001 .

[6]  M. Eid,et al.  Do you feel better or worse? The validity of perceived deviations of mood states from mood traits , 1999 .

[7]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[8]  J. Mcardle.  Latent variable modeling of differences and changes with longitudinal data. , 2009, Annual review of psychology.

[9]  T. Raykov.  On estimating true change interrelationships with other variables , 1993 .

[10]  Michael Eid,et al.  Global Judgments of Subjective Well-Being: Situational Variability and Long-Term Stability , 2004 .

[11]  Anthony D. Ong,et al.  Oxford handbook of methods in positive psychology. , 2007 .

[12]  K. Bollen,et al.  An Empirical Evaluation of the Use of Fixed Cutoff Points in RMSEA Test Statistic in Structural Equation Models , 2008, Sociological methods & research.

[13]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[14]  R. Steyer,et al.  Modeling Latent Trait-Change , 2004 .

[15]  J. Mcardle.  Dynamic but Structural Equation Modeling of Repeated Measures Data , 1988 .

[16]  Michael Eid,et al.  Longitudinal Con rmatory Factor Analysis for Polytomous Item Responses: Model De nition and Model Selection on the Basis of Stochastic Measurement Theory , 1998 .

[17]  Ulman Lindenberger,et al.  The effect of multiple indicators on the power to detect inter-individual differences in change. , 2010, The British journal of mathematical and statistical psychology.

[18]  R. Steyer,et al.  A latent state-trait anxiety model and its application to determine consistency and specificity coefficients , 1989 .

[19]  M. Eid,et al.  Modeling true intraindividual change: True change as a latent variable. , 1997 .

[20]  Peter Schmidt,et al.  Is there a “Socratic Effect” in Nonexperimental Panel Studies? , 1987 .

[21]  S. Reise,et al.  Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. , 1997 .

[22]  Theodore A. Walls,et al.  An Introduction to Latent Variable Growth Curve Modeling: Concepts, Issues, and Applications (2nd ed.) , 2007 .

[23]  David A. Cole,et al.  Latent trait-state models. , 2012 .

[24]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[25]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[26]  D. Ferring,et al.  Trait and State Components of Perceived Parental Differential Treatment in Middle Adulthood: A Longitudinal Study , 2010 .

[27]  John R. Nesselroade,et al.  Beyond autoregressive models: some implications of the trait-state distinction for the structural modeling of developmental change. , 1987, Child development.

[28]  Linda M. Collins,et al.  New methods for the analysis of change , 2001 .

[29]  Ginger Lockhart,et al.  First- Versus Second-Order Latent Growth Curve Models: Some Insights From Latent State-Trait Theory , 2013, Structural equation modeling : a multidisciplinary journal.

[30]  Michele L. Ybarra,et al.  X-rated material and perpetration of sexually aggressive behavior among children and adolescents: is there a link? , 2011, Aggressive behavior.

[31]  A. Neubauer,et al.  Situational effects in trait assessment: The FPI, NEOFFI, and EPI questionnaires , 1995 .

[32]  W. Meredith,et al.  Factorial Invariance: Historical Perspectives and New Problems , 2007 .

[33]  M. V. Dulmen,et al.  Latent state trait modeling of children's cortisol at two points of the diurnal cycle , 2012, Psychoneuroendocrinology.

[34]  S. Frangou,et al.  Neuroticism and psychological distress: To what extent is their association due to person-environment correlation? , 2011, European Psychiatry.

[35]  M. Mehl,et al.  Handbook of research methods for studying daily life , 2012 .

[36]  R. Steyer,et al.  A latent state-trait model (not only) for social desirability. , 1993 .

[37]  J. H. Steiger,et al.  Extending the Trait–State–Occasion Model: How Important Is Within-Wave Measurement Equivalence? , 2007 .

[38]  Denny Borsboom,et al.  The attack of the psychometricians , 2006, Psychometrika.

[39]  L. Dumenci,et al.  An Investigation of Maternal and Adolescent Depressed Mood Using a Latent Trait-State Model , 1998 .

[40]  A. McNeil,et al.  Latent Curve Models: A Structural Equation Approach , 2007 .

[41]  Hans Baumgartner,et al.  An Extended Paradigm for Measurement Analysis of Marketing Constructs Applicable to Panel Data , 2006 .

[42]  Jacob Bishop,et al.  Modeling latent growth with multiple indicators: a comparison of three approaches. , 2015, Psychological methods.

[43]  Bengt Muthén,et al.  Testing for the Equivalence of Factor Covariance and Mean Structures : The Issue of Partial Measurement In variance , 1989 .

[44]  Michael Eid,et al.  Stability and variability in the relationship between subjective well-being and income , 2011 .

[45]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[46]  Robert Cudeck,et al.  Factor analysis at 100 : historical developments and future directions , 2007 .

[47]  John R. Nesselroade,et al.  Interindividual differences in intraindividual change. , 1991 .

[48]  Rolf Steyer,et al.  Latent state-trait models. , 2012 .

[49]  D. A. Kenny,et al.  Trait–state models for longitudinal data. , 2001 .

[50]  R. Steyer,et al.  States and traits in psychological assessment. , 1992 .

[51]  E. Ferrer,et al.  Factorial Invariance and The Specification of Second-Order Latent Growth Models. , 2008, Methodology : European journal of research methods for the behavioral & social sciences.

[52]  William Meredith,et al.  Latent curve analysis , 1990 .

[53]  E. Naumann,et al.  Latent state–trait structure of cerebral blood flow in a resting state , 2009, Biological Psychology.

[54]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[55]  Michael Windle,et al.  The science of prevention: methodological advances from alcohol and substance abuse research. , 1997 .

[56]  Rick H. Hoyle,et al.  Handbook of structural equation modeling , 2012 .

[57]  Michael F. Lorber,et al.  Stability, change, and informant variance in newlyweds' physical aggression: individual and dyadic processes. , 2012, Aggressive behavior.

[58]  K. Schermelleh-Engel,et al.  Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. , 2003 .

[59]  H. Marsh,et al.  In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings , 2004 .

[60]  Raymond B. Cattell,et al.  Handbook of multivariate experimental psychology , 1968 .

[61]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[62]  Michael Eid,et al.  Latent state–trait theory and research in personality and individual differences , 1999 .

[63]  J. Tisak,et al.  Permanency and ephemerality of psychological measures with application to organizational commitment. , 2000, Psychological methods.

[64]  Ginger Lockhart,et al.  A comparison of four approaches to account for method effects in latent state-trait analyses. , 2012, Psychological methods.

[65]  G. Caprara,et al.  A Unified Latent Curve, Latent State-Trait Analysis of the Developmental Trajectories and Correlates of Positive Orientation , 2012, Multivariate behavioral research.

[66]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[67]  David Chan,et al.  The Conceptualization and Analysis of Change Over Time: An Integrative Approach Incorporating Longitudinal Mean and Covariance Structures Analysis (LMACS) and Multiple Indicator Latent Growth Modeling (MLGM) , 1998 .

[68]  K. Schermelleh-Engel,et al.  Decomposing person and occasion-specific effects: an extension of latent state-trait (LSI) theory to hierarchical LST models. , 2004, Psychological methods.

[69]  M. Eid,et al.  Measuring Variability and Change With an Item Response Model for Polytomous Variables , 1998 .