Modeling Common Traits and Method Effects in Multitrait-Multimethod Analysis

Method effects often occur when constructs are measured by different methods. In traditional multitrait-multimethod (MTMM) models method effects are regarded as residuals, which implies a mean method effect of zero and no correlation between trait and method effects. Furthermore, in some recent MTMM models, traits are modeled to be specific to a certain method. However, often we are not interested in a method-specific trait but in a trait that is common to all methods. Here we present the Method Effect model with common trait factors, which allows modeling “common” trait factors and method factors that represent method “effects” rather than residuals. The common trait factors are defined as the mean of the true-score variables of all variables measuring the same trait and the method factors are defined as differences between true-score variables and means of true-score variables. Because the model allows estimating mean method effects, correlations between method factors, and correlations between trait and method factors, new research questions may be investigated. The application of the model is demonstrated by 2 examples studying the effect of negative, as compared with positive, item wording for the measurement of mood states.

[1]  S. Vautier,et al.  Do balanced scales assess bipolar constructs? The case of the STAI scales. , 2009, Psychological assessment.

[2]  A. Hinde.  Editorial: The analysis of panel data , 2008 .

[3]  Steffi Pohl,et al.  Modelling method effects as individual causal effects , 2007 .

[4]  R. Devellis.  Classical Test Theory , 2006, Medical care.

[5]  Denny Borsboom,et al.  When does measurement invariance matter? , 2006, Medical care.

[6]  J. A. Gómez-Fraguela,et al.  Assessment of the Validity of Parenting Constructs Using the Multitrait-Multimethod Model , 2006 .

[7]  Gilles E. Gignac.  Evaluating subtest ‘g’ saturation levels via the single trait-correlated uniqueness (STCU) SEM approach: Evidence in favor of crystallized subtests as the best indicators of ‘g’ , 2006 .

[8]  Steven E. Scullen,et al.  Bias in the Correlated Uniqueness Model for MTMM Data , 2004 .

[9]  R. Steyer,et al.  Is it Possible to Feel Good and Bad at the Same Time? New Evidence on the Bipolarity of Mood-state Dimensions , 2004 .

[10]  Julia Dmitrieva,et al.  Item-wording and the dimensionality of the Rosenberg Self-Esteem Scale: do they matter? , 2003 .

[11]  Christine DiStefano,et al.  Wording Effects in Self-Esteem Scales: Methodological Artifact or Response Style? , 2003 .

[12]  R. Motl,et al.  Longitudinal Invariance of Self-Esteem and Method Effects Associated With Negatively Worded Items , 2002 .

[13]  A. McConnell,et al.  Relations among the Implicit Association Test, Discriminatory Behavior, and Explicit Measures of Racial Attitudes , 2001 .

[14]  Tron Foss,et al.  The Performance of ML, GLS, and WLS Estimation in Structural Equation Modeling Under Conditions of Misspecification and Nonnormality , 2000 .

[15]  Michael Eid,et al.  A multitrait-multimethod model with minimal assumptions , 2000 .

[16]  Auke Tellegen,et al.  Issues in dimensional structure of affect--Effects of descriptors, measurement error, and response formats: Comment on Russell and Carroll (1999). , 1999 .

[17]  Beverly G. Burke.  Item Reversals and Response Validity in the Job Diagnostic Survey , 1999 .

[18]  J. M. Carroll,et al.  On the bipolarity of positive and negative affect. , 1999, Psychological bulletin.

[19]  Allen I. Huffcutt,et al.  Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. , 1997 .

[20]  M. Eid,et al.  Modeling true intraindividual change: True change as a latent variable. , 1997 .

[21]  D. Cole,et al.  Modeling causal relations between academic and social competence and depression: a multitrait-multimethod longitudinal study of children. , 1996, Journal of abnormal psychology.

[22]  H W Marsh,et al.  Positive and negative global self-esteem: a substantively meaningful distinction or artifactors? , 1996, Journal of personality and social psychology.

[23]  Herbert W. Marsh,et al.  Latent variable models of multitrait-multimethod data. , 1995 .

[24]  Julian C. L. Lai.  Differential Predictive Power of the Positively versus the Negatively Worded Items of the Life Orientation Test , 1994, Psychological reports.

[25]  H. Marsh,et al.  Self-Other Agreement on Multiple Dimensions of Preadolescent Self-Concept: Inferences by Teachers, Mothers, and Fathers. , 1991 .

[26]  H. Marsh.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[27]  Rolf Steyer,et al.  Models of classical psychometric test theory as stochastic measurement models: Representation, uniqueness, meaningfulness, identifiability, and testability. , 1989 .

[28]  S Epstein,et al.  Does aggregation produce spuriously high estimates of behavior stability? , 1986, Journal of personality and social psychology.

[29]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[30]  M. Mount,et al.  Psychometric properties of subordinate ratings of managerial performance. , 1984 .

[31]  Seymour Epstein,et al.  Aggregation and beyond: Some basic issues on the prediction of behavior. , 1983, Journal of personality.

[32]  D. A. Kenny,et al.  An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix , 1976 .

[33]  Donald W. Zimmerman.  Probability spaces, hilbert spaces, and the axioms of test theory , 1975 .

[34]  Karl G. Jöreskog,et al.  Analyzing psychological data by structural analysis of covariance matrices , 1974 .

[35]  K. Jöreskog.  Simultaneous factor analysis in several populations , 1971 .

[36]  K. G. Jöreskog,et al.  Statistical analysis of sets of congeneric tests , 1971 .

[37]  C. S. Bernhardson.  Social desirability as a confounding variable in the reversed item approach to studying acquiescence in the MMPI. , 1970 .

[38]  M. R. Novick.  The axioms and principal results of classical test theory , 1965 .

[39]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.