Overcoming Problems in Confirmatory Factor Analyses of MTMM Data: The Correlated Uniqueness Model and Factorial Invariance.

The general model typically used in the confirmatory factor analysis (CFA) approach to multitrait-multimethod (MTMM) data is plagued with methodological problems and frequently results in improper or unstable solutions. Here we reanalyze data from a previously published study, demonstrating that this model may lead to inappropriate interpretations even when it does converge to a proper solution, and describe safeguards against this occurrence. The results support the correlated uniqueness model, diagnostic tests of the validity of CFA-MTMM solutions, the inclusion of external validity criteria in the MTMM design as described by Marsh (1988; 1989; Marsh & Bailey, 19911, and the application of factorial invariance to test the stability of CFA-MTMM solutions. More generally, we demonstrate the flexibility of the CFA-MTMM approach for testing a variety of construct validity issues.

[1]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[2]  R. P. McDonald,et al.  Choosing a multivariate model: Noncentrality and goodness of fit. , 1990 .

[3]  H. Marsh.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[4]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[5]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[6]  B. Byrne.  A Primer of Lisrel: Basic Applications and Programming for Confirmatory Factor Analytic Models , 1989 .

[7]  P. Bentler.  Comparative Fit Indices in Structural Models , 1990 .

[8]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[9]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[10]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[11]  B. Byrne,et al.  Multigroup Comparisons and the Assumption of Equivalent Construct Validity Across Groups: Methodological and Substantive Issues. , 1989, Multivariate behavioral research.

[12]  D. A. Kenny,et al.  Analysis of the multitrait^multimethod matrix by confirmatory factor analysis , 1992 .

[13]  H. Marsh,et al.  Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. , 1985 .

[14]  H. Marsh,et al.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative Models , 1991 .