Measurement invariance in longitudinal clinical research assuming change from development and intervention.

Valid and reliable measures of psychological and behavioral constructs are critical to clinical research, particularly longitudinal treatment research, in which multiple groups are compared over time for possible changes within and between constructs as a result of intervention or development. Structural equation modeling (SEM) analysis is a class of statistical procedures that can be used to test multiple hypotheses about these relationships simultaneously while controlling for measurement error. The procedures have been applied primarily to testing between-construct relationships in nonexperimental studies, with relatively little emphasis on establishing whether measures are sufficiently invariant across groups and across time to permit these tests. This article uses an empirical example of a longitudinal experimental prevention study with two groups to illustrate the use of SEM, first, to systematicall y test measurement invariance across groups at each wave of measurement, and second, after establishing measurement invariance, to test structural invariance longitudinally.

[1]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[2]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[3]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[4]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[5]  David Rindskopf,et al.  Structural Equation Models , 1984 .

[6]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[7]  M. Browne.  Asymptotically distribution-free methods for the analysis of covariance structures. , 1984, The British journal of mathematical and statistical psychology.

[8]  R. Morris,et al.  Structural equation modeling in clinical assessment research with children. , 1991, Journal of consulting and clinical psychology.

[9]  D. A. Kenny,et al.  Analysis of the multitrait^multimethod matrix by confirmatory factor analysis , 1992 .

[10]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[11]  P. Bentler,et al.  Structure of drug use behaviors and consequences among young adults: multitrait-multimethod assessment of frequency, quantity, work site, and problem substance use. , 1988, The Journal of applied psychology.

[12]  P M Bentler,et al.  Choice of structural model via parsimony: a rationale based on precision. , 1989, Psychological bulletin.

[13]  A. Satorra,et al.  Scaled test statistics and robust standard errors for non-normal data in covariance structure analysis: a Monte Carlo study. , 1991, The British journal of mathematical and statistical psychology.

[14]  Robert C. MacCallum,et al.  SPECIFICATION SEARCHES IN COVARIANCE STRUCTURE MODELING , 1986 .

[15]  A. Bandura.  Social learning theory , 1977 .

[16]  R. Hoyle,et al.  Evaluating measurement models in clinical research: covariance structure analysis of latent variable models of self-conception. , 1991, Journal of consulting and clinical psychology.

[17]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[18]  P M Bentler,et al.  Drug use and personality in adolescence and young adulthood: structural models with nonnormal variables. , 1987, Child development.

[19]  A W Stacy,et al.  Validity of self-reports of alcohol and other drug use: a multitrait-multimethod assessment. , 1985, Journal of personality and social psychology.

[20]  Peter M. Bentler,et al.  Practical Issues in Structural Modeling , 1987 .

[21]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[22]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[23]  B. Muthén.  A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators , 1984 .

[24]  K. Bollen,et al.  Perceived Cohesion: A Conceptual and Empirical Examination , 1990 .

[25]  P. Bentler,et al.  Model Modification in Covariance Structure Modeling: A Comparison among Likelihood Ratio, Lagrange Multiplier, and Wald Tests. , 1990, Multivariate behavioral research.

[26]  Lisa L. Harlow,et al.  Behavior of some elliptical theory estimators with nonnormal data in a covariance structures framework: A Monte Carlo study. , 1986 .

[27]  W. Hays.  Statistics for the social sciences , 1973 .

[28]  D. Mackinnon,et al.  Mediating mechanisms in a school-based drug prevention program: first-year effects of the Midwestern Prevention Project. , 1991, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[29]  S. Mulaik,et al.  EVALUATION OF GOODNESS-OF-FIT INDICES FOR STRUCTURAL EQUATION MODELS , 1989 .

[30]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[31]  J. S. Tanaka.  "How Big Is Big Enough?": Sample Size and Goodness of Fit in Structural Equation Models with Latent Variables. , 1987 .

[32]  R. MacCallum,et al.  Model modifications in covariance structure analysis: the problem of capitalization on chance. , 1992, Psychological bulletin.

[33]  D. Mackinnon,et al.  A multicommunity trial for primary prevention of adolescent drug abuse. Effects on drug use prevalence. , 1989, JAMA.

[34]  Jacob Cohen,et al.  Problems in the Measurement of Latent Variables in Structural Equations Causal Models , 1990 .