Controlling Correlational Bias via Confirmatory Factor Analysis of MTMM Data.

Confirmatory factor analysis of multitrait-multimethod (MTMM) data has proven to be a useful tool for assessing convergent and discriminant validity. However, researchers have not made full use of the results of MTMM analyses in examining the relationship between MTMM factors and variables outside the MTMM. Often, researchers simply average the various measures of each trait. Alternatively, they estimate LISREL MTMM models, but estimate only relationships between MTMM traits and the outside variables. In the present article, we show that these two approaches to analyzing data outside the MTMM produce equally highly biased parameter estimates when the actual correlations between MTMM method factors and the outside variables are substantial. An algebraic explanation and a simulated data illustration are given for the bias due to misspecification. Also, the problem is illustrated with a brief empirical example. Implications for applied research are discussed.

[1]  J. Graham,et al.  Convergent and discriminant validity for assessment of skill in resisting a role play alcohol offer. , 1989 .

[2]  J. Long.  Confirmatory Factor Analysis , 1983 .

[3]  R. Cudeck.  Msultiplicative Models and MTMM Matrices , 1988 .

[4]  J. Graham,et al.  Preventing alcohol, marijuana, and cigarette use among adolescents: peer pressure resistance training versus establishing conservative norms. , 1991, Preventive medicine.

[5]  Norman Miller,et al.  Ten years of research on the false-consensus effect: an empirical and theoretical review , 1987 .

[6]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[7]  Robert L. Linn,et al.  Path analysis: Psychological examples. , 1970 .

[8]  J. Graham,et al.  Differential Impact of Three Alcohol Prevention Curricula on Hypothesized Mediating Variables , 1988, Journal of drug education.

[9]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[10]  J. Graham,et al.  Evaluation of resistance skills training using multitrait-multimethod role play skill assessments , 1987 .

[11]  H. Marsh.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[12]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[13]  D. A. Kenny,et al.  Correlational bias in observer ratings. , 1976 .

[14]  D. A. Kenny,et al.  An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix , 1976 .

[15]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[16]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[17]  Karl G. Jöreskog,et al.  Analyzing psychological data by structural analysis of covariance matrices , 1974 .

[18]  D Kaplan,et al.  The Impact of Specification Error on the Estimation, Testing, and Improvement of Structural Equation Models. , 1988, Multivariate behavioral research.

[19]  R. Stein,et al.  Factors associated with erection in adolescent sex offenders , 1989 .

[20]  D. A. Kenny,et al.  Statistical approaches to the correction of correlational bias , 1980 .