Longitudinal measurement models in evaluation research: Examining stability and change

Abstract This article provides an introduction to the use of Confirmatory Factor Analysis to test measurement invariance and stability in longitudinal research. The approach is illustrated through examples representing: (a) one construct, two measurement waves; (b) one construct, three waves; (c) two constructs, two waves; and (d) comparison of treatment and control groups in pre-post designs. Basic issues in establishing measurement invariance over time, across treatment groups, and within measurement waves are discussed. Estimates of the stability coefficients that are corrected for measurement error and method variance associated with each specific measured variable are provided. Establishing measurement invariance is a critical requirement for making inferences about treatment effects and changes in constructs over time.

[1]  Peter M. Bentler,et al.  Structural equation analyses of clinical subpopulation differences and comparative treatment outcomes: characterizing the daily lives of drug addicts. , 1994, Journal of consulting and clinical psychology.

[2]  B. Byrne.  A Primer of Lisrel: Basic Applications and Programming for Confirmatory Factor Analytic Models , 1989 .

[3]  J. Mcardle.  Dynamic but Structural Equation Modeling of Repeated Measures Data , 1988 .

[4]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[5]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[6]  R. Hoyle.  Structural equation modeling: concepts, issues, and applications , 1997 .

[7]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[8]  Karl G. Jöreskog,et al.  Statistical estimation of structural models in longitudinal-developmental investigations , 1979 .

[9]  J. Nesselroade.  Adult personality development: Issues in assessing constancy and change. , 1990 .

[10]  R. Hoyle,et al.  Evaluating measurement models in clinical research: covariance structure analysis of latent variable models of self-conception. , 1991, Journal of consulting and clinical psychology.

[11]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[12]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[13]  Raymond B. Cattell,et al.  Handbook of multivariate experimental psychology , 1968 .

[14]  G. Box,et al.  A general distribution theory for a class of likelihood criteria. , 1949, Biometrika.

[15]  S. West,et al.  Invalidity of True Experiments , 1990 .

[16]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[17]  G. Knight,et al.  Socialization and family correlates of mental health outcomes among Hispanic and Anglo American children: consideration of cross-ethnic scalar equivalence. , 1994, Child development.

[18]  P. Bentler,et al.  Model Modification in Covariance Structure Modeling: A Comparison among Likelihood Ratio, Lagrange Multiplier, and Wald Tests. , 1990, Multivariate behavioral research.

[19]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[20]  The relationship between conceptual tempo and depression in children. , 1982 .

[21]  A. Rabin.  Studying persons and lives , 1990 .

[22]  D. J. Jackson,et al.  Factor Analysis and Measurement in Sociological Research. , 1983 .

[23]  J. Horn,et al.  A practical and theoretical guide to measurement invariance in aging research. , 1992, Experimental aging research.

[24]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[25]  Linda M. Collins,et al.  Best Methods for the Analysis of Change: Recent Advances, Unanswered Questions, Future Directions , 1991 .

[26]  S. Mulaik.  Confirmatory factor analysis. , 1988 .

[27]  Peter M. Bentler,et al.  Practical Issues in Structural Modeling , 1987 .

[28]  S. West,et al.  Coping, stress, and the psychological symptoms of children of divorce: a cross-sectional and longitudinal study. , 1994, Child development.

[29]  P. Bentler.  Comparative Fit Indices in Structural Models , 1990 .

[30]  S. West,et al.  Personality Measurement: Reliability and Validity Issues , 1997 .

[31]  Jay Magidson,et al.  Advances in factor analysis and structural equation models , 1979 .

[32]  Michael C. Corballis,et al.  Longitudinal factor analysis , 1970 .

[33]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[34]  John R. Nesselroade,et al.  Longitudinal Research in the Study of Behavior and Development , 1979 .

[35]  Stephen G. West,et al.  Structural equation models with non-normal variables: Problems and remedies , 1995 .

[36]  S. West,et al.  The investigation of personality structure: Statistical models , 1997 .

[37]  George R. Franke,et al.  Structural Equation Modeling with EQS and EQS/Windows , 1995 .

[38]  Tim S. Ayers,et al.  A dispositional and situational assessment of children's coping: testing alternative models of coping. , 1996, Journal of personality.

[39]  P. Whittle,et al.  Latent Variables in Socio‐Economic Models , 1978 .

[40]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[41]  R. Lissitz,et al.  Limitations of Coefficient Alpha as an Index of Test Unidimensionality1 , 1977 .

[42]  John A. Johnson,et al.  Handbook of personality psychology. , 1997 .

[43]  Keith F Widaman,et al.  Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. , 1993, Psychological bulletin.

[44]  D. Sörbom.  A GENERAL METHOD FOR STUDYING DIFFERENCES IN FACTOR MEANS AND FACTOR STRUCTURE BETWEEN GROUPS , 1974 .

[45]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[46]  William Meredith,et al.  Notes on factorial invariance , 1964 .

[47]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[48]  Karl G. Jöreskog,et al.  Analyzing psychological data by structural analysis of covariance matrices , 1974 .