A New , More Powerful Approach to Multitrait-Multimethod Analyses : An Application of Second-order Confirmatory Factor Analysis

The advantages of applying confirmatory factor analysis (CFA) to multitrait-multimethod (MTMM) data are widely recognized. However, because CFA as traditionally applied to MTMM data incorporates single indicators of each scale (i.e., each trait/method combination), important weaknesses are the failure to: (1) correct appropriately for measurement error in scale scores; (2) separate error due to low internal consistency from uniqueness due to weak trait and/or method effects; (3) test whether items or subscales accurately reflect the intended factor structure; and (4) test for correlated uniquenesses. However, when the analy;is begins with multiple indicators of each scale (i.e., items or subscales), second-order factor analysis can be used to address each of these problems. In this approach first-order factors defined by multiple items or subscales are posited for each scale, and the method and trait factors are posited as second-order factors. This paper illustrates models that incorporate multiple indicators of each scale. The advantaot ) of their application are discussed. A three-page list o.. references and the description of the models, mentioned in the text, supplement the paper. (Author/JAZ) *********************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. *******;c*************************************************************** A New, More Powerful Approach to Multitrait-Multimethod Analyses: An Application of Second-order Confirmatory Factor Analysis

[1]  W. McGaghie,et al.  Construct Validity of Medical Clinical Competence Measures: A Multitrait-Multimethod Matrix Study Using Confirmatory Factor Analysis , 1986 .

[2]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[3]  H. Marsh.  The Structure of Masculinity/Femininity: An Application of Confirmatory Factor Analysis to Higher-Order Factor Structures and Factorial Invariance. , 1985, Multivariate behavioral research.

[4]  K. Jöreskog.  Structural analysis of covariance and correlation matrices , 1978 .

[5]  Robert L. Linn,et al.  A Multitrait-Multimethod Model for Studying Growth , 1972 .

[6]  COMPARISON OF TWO PROCEDURES FOR ANALYZING MULTITRAIT MULTIMETHOD MATRICES , 1979 .

[7]  H. Marsh.  Students ' Evaluations of University Teaching : Dimensionality , Reliability , Validity , Potential Biases , and Utility , 2005 .

[8]  Robert L. Linn,et al.  Path analysis: Psychological examples. , 1970 .

[9]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[10]  Leroy Wolins,et al.  A Procedure for Estimation of Trait, Method, and Error Variance Attributable to a Measure1 2 , 1970 .

[11]  K. Land,et al.  Sensitivity Analysis of Arbitrarily Identified Simultaneous-Equation Models , 1978 .

[12]  G. Freytag.  [CORRELATION AND CAUSALITY]. , 1964, Psychiatrie, Neurologie, und medizinische Psychologie.

[13]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[14]  B. Muthén,et al.  A comparison of some methodologies for the factor analysis of non‐normal Likert variables , 1985 .

[15]  B. Muthén.  A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators , 1984 .

[16]  H. Marsh,et al.  The Factorial Invariance of Student Evaluations of College Teaching , 1984 .

[17]  Richard S. Newman,et al.  Children's achievement and self-evaluations in mathematics: A longitudinal study. , 1984 .

[18]  Herbert W. Marsh,et al.  The Hierarchical Structure of Self-Concept and the Application of Hierarchical Confirmatory Factor Analysis , 1987 .

[19]  Karl G. Jöreskog,et al.  Analyzing psychological data by structural analysis of covariance matrices , 1974 .

[20]  Herbert W. Marsh,et al.  Confirmatory Factor Analysis of Multitrait Multimethod Matrices. , 1983 .

[21]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[22]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[23]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[24]  D. Alwin.  Approaches to the Interpretation of Relationships in the Multitrait-Multimethod Matrix , 1973 .

[25]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[26]  William R. Darden,et al.  Causal Models in Marketing , 1980 .

[27]  Herbert W. Marsh,et al.  Multitrait-Multimethod Analysis: Distinguishing between Items and Traits , 1983 .