Multitrait-multimethod Analysis

Publisher Summary The multitrait-multimethod (MTMM) analysis procedure is a powerful measurement design in construct validation research. It offers an uncompromising perspective on the meaning of theoretical variables that require indirect measurement. The MTMM is a fully crossed measurement model whereby multiple procedures are used to measure multiple theoretical constructs in a large number of persons. The objectives of MTMM analysis are to determine whether the measurements of each trait derived by multiple methods are concordant, to show that measurements of different traits obtained using the same method are discordant, and to estimate the influence of different methods on the measurement of traits. Traits are universal, and their existence should not depend on the choice of a method to measure them. Therefore, convergent validity requires empirical evidence that different methods can be used to measure a trait. Furthermore, all MTMM analysis procedures provide evidence pertaining to three types of construct validity: convergent validity, discriminant validity, and method effect. However, there are no universally accepted formal tests for construct validity. The analytic definitions of different validity types vary across different MTMM analytic procedures. Therefore, construct validity evidence should be interpreted under the framework of a particular MTMM procedure used in the analysis.

[1]  W. McGaghie,et al.  Construct Validity of Medical Clinical Competence Measures: A Multitrait-Multimethod Matrix Study Using Confirmatory Factor Analysis , 1986 .

[2]  Leroy Wolins,et al.  Multiple Indicators: An Introduction , 1979 .

[3]  S. Fiske,et al.  Personality Research, Methods, and Theory : A Festschrift Honoring Donald W. Fiske , 1995 .

[4]  T. Ostrom.  The relationship between the affective, behavioral, and cognitive components of attitude. , 1969 .

[5]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[6]  Lee J. Cronbach,et al.  Giving method variance its due. , 1995 .

[7]  Leroy Wolins,et al.  Research mistakes in the social and behavioral sciences , 1982 .

[8]  Douglas N. Jackson,et al.  Multimethod factor analysis in the evaluation of convergent and discriminant validity. , 1969 .

[9]  Julian C. Stanley,et al.  Analysis of unreplicated three-way classifications, with applications to rater bias and trait independence , 1961 .

[10]  M. Sullivan,et al.  Reliability and validity of a Swedish version of the St George's Respiratory Questionnaire. , 1998, The European respiratory journal.

[11]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[12]  W. Wothke.  Multivariate Linear Models of the Multitrait-Multimethod Matrix. , 1987 .

[13]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[14]  H. Marsh,et al.  Physical Self Description Questionnaire: stability and discriminant validity. , 1996, Research quarterly for exercise and sport.

[15]  Michael J. Kavanagh,et al.  Issues in managerial performance: Multitrait-multimethod analyses of ratings. , 1971 .

[16]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[17]  Lyle F. Bachman,et al.  THE CONSTRUCT VALIDATION OF THE FSI ORAL INTERVIEW1 , 1981 .

[18]  K. Jöreskog.  Statistical analysis of sets of congeneric tests , 1971 .

[19]  M. Browne,et al.  The direct product model for the mtmm matrix parameterized as a second order factor analysis model , 1990 .

[20]  R. Cudeck.  Msultiplicative Models and MTMM Matrices , 1988 .

[21]  K. Schweizer.  An Equal-Level Approach to the Investigation of Multitrait-Multimethod Matrices , 1991 .

[22]  J. Conway,et al.  Analysis and Design of Multitrait-Multirater Performance Appraisal Studies , 1996 .

[23]  L. Dumenci.  Construct Validity of the Self-Directed Search Using Hierarchically Nested Structural Models. , 1995 .

[24]  B. Byrne,et al.  Modeling MTMM Data from Additive and Multiplicative Covariance Structures: An Audit of Construct Validity Concordance. , 1993, Multivariate behavioral research.

[25]  Chester A. Schriesheim,et al.  The Effect of Grouping or Randomizing Items on Leniency Response Bias , 1981 .

[26]  Andrew L. Comrey,et al.  Comparison of Multitrait-Multimethod, Factor, and Smallest Space Analysis on Personality Scale Data , 1983 .

[27]  F B Baker,et al.  Analyzing The Multitrait-Multimethod Matrix. , 1978, Multivariate behavioral research.

[28]  L. Dumenci,et al.  A Latent Trait-State Model of Adolescent Depression Using the Center for Epidemiologic Studies-Depression Scale. , 1996, Multivariate behavioral research.

[29]  Robert L. Linn,et al.  Path analysis: Psychological examples. , 1970 .

[30]  R. Bagozzi,et al.  Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. , 1990 .

[31]  L. Dumenci,et al.  A multitrait‐multioccasion generalization of the latent trait‐state model: Description and application , 1998 .

[32]  Yoshio Takane,et al.  The analysis of multitrait-multimethod matrices via constrained components analysis , 1996 .

[33]  W. R. Dillon,et al.  An Integrative Look at the Use of Additive and Multiplicative Covariance Structure Models in the Analysis of MTMM Data , 1992 .

[34]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[35]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .