A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data.

The correlated trait-correlated method (CT-CM) and correlated uniqueness (CU) confirmatory factor analysis models for multitrait-multimethod data are critiqued. Although the CU model often returns convergent and admissible factor solutions when the CT-CM model does not, the CU model is shown to have theoretical and substantive shortcomings. On the basis of this critique, the authors recommend that the CT-CM model be regarded as the generally preferred model and that the CU model be invoked only when the CT-CM model fails.

[1]  Jeffrey D. Facteau,et al.  Are performance appraisal ratings from different rating sources comparable , 2001 .

[2]  D. Chan Method Effects of Positive Affectivity, Negative Affectivity, and Impression Management in Self-Reports of Work Attitudes , 2001 .

[3]  Charles E. Lance,et al.  Assessment Center Exercise Factors Represent Cross-Situational Specificity, Not Method Bias , 2000 .

[4]  Michael Eid,et al.  A multitrait-multimethod model with minimal assumptions , 2000 .

[5]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[6]  B. Byrne Structural Equation Modeling with LISREL, PRELIS, and SIMPLIS: Basic Concepts, Applications, and Programming , 1998 .

[7]  James W. Smither Performance appraisal : state of the art in practice , 1998 .

[8]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[9]  Allen I. Huffcutt,et al.  Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. , 1997 .

[10]  Walter C. Borman,et al.  360° ratings: An analysis of assumptions and a research agenda for evaluating their validity , 1997 .

[11]  R. Hoyle Structural equation modeling: concepts, issues, and applications , 1997 .

[12]  Earl R. Nason,et al.  Likability and Similarity as Potential Sources of Predictor-Related Criterion Bias in Validation Research , 1996 .

[13]  G. A. Marcoulides,et al.  Advanced structural equation modeling : issues and techniques , 1996 .

[14]  Yoshio Takane,et al.  The analysis of multitrait-multimethod matrices via constrained components analysis , 1996 .

[15]  J. Conway,et al.  Analysis and Design of Multitrait-Multirater Performance Appraisal Studies , 1996 .

[16]  C. S. Reichardt,et al.  The Criteria for Convergent and Discriminant Validity in a Multitrait-Multimethod Matrix. , 1995, Multivariate behavioral research.

[17]  Lee J. Cronbach,et al.  Giving method variance its due. , 1995 .

[18]  Herbert W. Marsh,et al.  Latent variable models of multitrait-multimethod data. , 1995 .

[19]  S. Fiske,et al.  Personality Research, Methods, and Theory : A Festschrift Honoring Donald W. Fiske , 1995 .

[20]  Werner Wothke,et al.  Covariance components analysis of the multitrait-multimethod matrix. , 1995 .

[21]  Joseph A. Cote What Causes Estimation Problems When Analyzing Mtmm Data , 1995 .

[22]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[23]  Steven D. Maurer,et al.  The validity of employment interviews: A comprehensive review and meta-analysis. , 1994 .

[24]  L. J. Williams,et al.  An Alternative Approach to Method Effects by Using Latent-Variable Models: Applications in Organizational Behavior Research , 1994 .

[25]  Joseph A. Cote,et al.  Additive and Multiplicative Method Effects in Applied Psychological Research: An Empirical Assessment of Three Models , 1994 .

[26]  H. Marsh,et al.  Identification with deficient rank loading matrices in confirmatory factor analysis: Multitrait-multimethod models , 1994 .

[27]  Charles E. Lance,et al.  Relationships between overall and life facet satisfaction: A multitrait-multimethod (MTMM) study , 1993 .

[28]  Walter W. Tornow,et al.  Perceptions or reality: Is multi-perspective measurement a means or an end? , 1993 .

[29]  Robert J. Vance,et al.  Construct Validity of Three Types of Organizational Citizenship behavior: An Illustration of the Direct Product Model with Refinements , 1993 .

[30]  B. Byrne,et al.  Modeling MTMM Data from Additive and Multiplicative Covariance Structures: An Audit of Construct Validity Concordance. , 1993, Multivariate behavioral research.

[31]  R. Sternberg Psychological Bulletin's top 10 "hit parade." , 1992 .

[32]  H W Marsh,et al.  Overcoming Problems in Confirmatory Factor Analyses of MTMM Data: The Correlated Uniqueness Model and Factorial Invariance. , 1992, Multivariate behavioral research.

[33]  Charles E. Lance,et al.  Specification of the criterion construct space: An application of hierarchical confirmatory factor analysis. , 1992 .

[34]  D. A. Kenny,et al.  Analysis of the multitrait^multimethod matrix by confirmatory factor analysis , 1992 .

[35]  D. Jackson,et al.  Analysis of Multitrait-Multirater Performance Appraisal Data: Composite Direct Product Method versus Confirmatory Factor Analysis. , 1992, Multivariate behavioral research.

[36]  M. Mumford,et al.  Developmental determinants of individual action: Theory and practice in applying background measures. , 1992 .

[37]  K. Widaman,et al.  Multitrait-multimethod models in aging research. , 1992, Experimental aging research.

[38]  N. Collins,et al.  Controlling Correlational Bias via Confirmatory Factor Analysis of MTMM Data. , 1991, Multivariate behavioral research.

[39]  H. Marsh,et al.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative Models , 1991 .

[40]  H. Marsh Confirmatory Factor Analysis of Multitrait‐Multimethod Data: The Construct Validation of Multidimensional Self‐Concept Responses , 1990 .

[41]  Jerome A. Katz,et al.  RELIABILITY AND VALIDITY OF IN‐BASKET PERFORMANCE MEASURES , 1990 .

[42]  Paul E. Spector,et al.  Estimation Problems in the Block-Diagonal Model of the Multitrait-Multimethod Matrix , 1990 .

[43]  R. Bagozzi,et al.  Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. , 1990 .

[44]  Roger E. Millsap,et al.  A cautionary note on the detection of method variance in multitrait-multimethod data , 1990 .

[45]  H. Marsh Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[46]  A. Agresti,et al.  Multiway Data Analysis , 1989 .

[47]  Joseph A. Cote,et al.  Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? , 1989 .

[48]  D. A. Kenny,et al.  On the measurement of stability in over-time data. , 1989, Journal of personality.

[49]  Robert Cudeck,et al.  Analysis of correlation matrices using covariance structure models. , 1989 .

[50]  P. Sackett,et al.  A further examination of the constructs underlying assessment center ratings , 1988 .

[51]  D. Lehmann An Alternative Procedure for Assessing Convergent and Discriminant Validity , 1988 .

[52]  Multiple Group Factor Analysis of Multitrait-Multimethod Matrices. , 1988, Multivariate behavioral research.

[53]  R. Cudeck Msultiplicative Models and MTMM Matrices , 1988 .

[54]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[55]  H. Marsh,et al.  A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. , 1988 .

[56]  Kenneth A. Bollen,et al.  Outliers and Improper Solutions , 1987 .

[57]  W. McGaghie,et al.  Construct Validity of Medical Clinical Competence Measures: A Multitrait-Multimethod Matrix Study Using Confirmatory Factor Analysis , 1986 .

[58]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[59]  K. Widaman Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[60]  M. Mount,et al.  Psychometric properties of subordinate ratings of managerial performance. , 1984 .

[61]  H. Marsh,et al.  Evaluating Reading Diagnostic Tests: An Application of Confirmatory Factor Analysis To Multitrait-Multimethod Data , 1984 .

[62]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[63]  H. Sypher,et al.  SEEING OURSELVES AS OTHERS SEE US , 1984 .

[64]  Herbert W. Marsh,et al.  Confirmatory Factor Analysis of Multitrait Multimethod Matrices. , 1983 .

[65]  S Flamer,et al.  Assessment of the Multitrait-Multimethod Matrix Validity of Likert Scales Via Confirmatory Factor Analysis. , 1983, Multivariate behavioral research.

[66]  C. Schriesheim Causal Analysis: Assumptions, Models, and Data , 1982 .

[67]  Paul R. Sackett,et al.  Constructs and assessment center dimensions: Some troubling empirical findings , 1982 .

[68]  C G Thornton,et al.  Assessment Center and managerial performance , 1982 .

[69]  John E. Hunter,et al.  Halo in a multidimensional forced-choice performance evaluation scale. , 1980 .

[70]  D. A. Kenny,et al.  Statistical approaches to the correction of correlational bias , 1980 .

[71]  Lawrence R. James,et al.  The unmeasured variables problem in path analysis. , 1980 .

[72]  COMPARISON OF TWO PROCEDURES FOR ANALYZING MULTITRAIT MULTIMETHOD MATRICES , 1979 .

[73]  D. A. Kenny,et al.  Correlation and causality , 1979 .

[74]  Robert L. Holzbach,et al.  Rater bias in performance ratings: Superior, self-, and peer ratings. , 1978 .

[75]  Stephen A. Stumpf,et al.  Student Evaluations of Courses and Faculty Based on a Perceived Learning Criterion: Scale Construction, Validation, and Comparison of Results , 1978 .

[76]  Neal Schmitt,et al.  Path Analysis of Multitrait-Multimethod Matrices , 1978 .

[77]  D. A. Kenny,et al.  An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix , 1976 .

[78]  James R. Kluegel,et al.  Analysis of the multitrait-multimethod matrix: Some limitations and an alternative. , 1975 .

[79]  Walter C. Borman,et al.  The rating of individuals in organizations: An alternate approach , 1974 .

[80]  T. Dickinson,et al.  A multitrait-multi method analysis of scales developed by retranslation , 1973 .

[81]  David H. Ryman,et al.  Convergent and discriminant validities of performance evaluations in extremely isolated groups. , 1971 .

[82]  Michael J. Kavanagh,et al.  Issues in managerial performance: Multitrait-multimethod analyses of ratings. , 1971 .

[83]  R. Boruch,et al.  Alternative Methods of Analysis: Multitrait-Multimethod Data , 1970 .

[84]  Leroy Wolins,et al.  A Procedure for Estimation of Trait, Method, and Error Variance Attributable to a Measure1 2 , 1970 .

[85]  Robert L. Linn,et al.  Path analysis: Psychological examples. , 1970 .

[86]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[87]  E. Lawler,et al.  The multitrait-multirater approach to measuring managerial job performance. , 1967, The Journal of applied psychology.

[88]  V B Cline,et al.  Prediction of creativity and other performance measures from biographical information among pharmaceutical scientists. , 1967, The Journal of applied psychology.

[89]  Paul D. Nelson,et al.  CRITERION MEASURES FOR EXTREMELY ISOLATED GROUPS , 1966 .

[90]  E. Glaser,et al.  Validation of a multiple-assessment procedure for managerial personnel. , 1964 .

[91]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[92]  D. Springer Ratings of candidates for promotion by co-workers and supervisors. , 1953 .