Multigroup Comparisons and the Assumption of Equivalent Construct Validity Across Groups: Methodological and Substantive Issues.

The purposes of this article are (a) to compare construct validity findings from Campbell-Fiske and LISREL confirmatory factor analyses (CFA) of a multitrait-multimethod matrix for each of two groups, and then to test for construct validity equivalence across groups -- the methodological issue, and (b) to demonstrate how construct validity can differ across groups -- the substantive issue. Multidimensional self-concept (general, academic, English, mathematics) responses to three types of measurement scales (Likert, semantic differential, Guttman) for low- and high4rack grade 11 and 12 students provided the exemplary data base. Methodologically, findings demonstrate the superiority of CFA over the Campbell-Fiske approach by (a) providing more detailed evidence of construct validity within groups, and (b) testing for the equivalency of construct validity across groups. Substantively, the findings illustrate that the assumption of group-invariant construct validity cannot be taken for granted; differences were found in both the measurement and structure of self-concept. Results bear importantly on the validity of findings based on multigroup comparisons.

[1]  T. Ostrom.  The relationship between the affective, behavioral, and cognitive components of attitude. , 1969 .

[2]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[3]  Barbara M. Byrne,et al.  Adolescent Self-Concept: Testing the Assumption of Equivalent Structure Across Gender , 1987 .

[4]  Lee J. Cronbach,et al.  Construct validation after thirty years. , 1989 .

[5]  James Jaccard,et al.  A Multitrait Multimethod Analysis of Four Attitude Assessment Procedures. , 1975 .

[6]  B. Byrne.  Adolescent Self-Concept, Ability Grouping, and Social Comparison , 1988 .

[7]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[8]  Barbara M. Byrne,et al.  A Multifaceted Academic Self-Concept: Its Hierarchical Structure and Its Relation to Academic Achievement. , 1988 .

[9]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[10]  M. Rosenberg.  Society and the adolescent self-image , 1966 .

[11]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[12]  Willem E. Saris,et al.  Causal modelling in nonexperimental research : an introduction to the LISREL approach , 1985, American Political Science Review.

[13]  P. Bentler,et al.  A comparison of two latent variable causal models for adolescent drug use. , 1981, Journal of personality and social psychology.

[14]  S Flamer,et al.  Assessment of the Multitrait-Multimethod Matrix Validity of Likert Scales Via Confirmatory Factor Analysis. , 1983, Multivariate behavioral research.

[15]  E. Carmines,et al.  Analyzing models with unobserved variables: analysis of covariance structures , 1981 .

[16]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[17]  H. Marsh.  The Structure of Masculinity/Femininity: An Application of Confirmatory Factor Analysis to Higher-Order Factor Structures and Factorial Invariance. , 1985, Multivariate behavioral research.

[18]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[19]  H. Marsh,et al.  Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. , 1985 .

[20]  A. Anastasi.  Evolving Concepts of Test Validation , 1986 .

[21]  D. J. Lee.  Society and the Adolescent Self-Image , 1969 .

[22]  Herbert W. Marsh,et al.  Confirmatory Factor Analysis of Multitrait Multimethod Matrices. , 1983 .

[23]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[24]  B. Byrne.  The Self Description Questionnaire III: Testing for Equivalent Factorial Validity across Ability , 1988 .

[25]  B. Byrne,et al.  On the Structure of Adolescent Self-Concept. , 1986 .

[26]  Samuel Messick,et al.  Constructs and their vicissitudes in educational and psychological measurement. , 1981 .

[27]  Isaac I. Bejar,et al.  Biased assessment of program impact due to psychometric artifacts. , 1980 .

[28]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[29]  K. Jöreskog.  A general approach to confirmatory maximum likelihood factor analysis , 1969 .

[30]  B. Byrne.  Measuring Adolescent Self-Concept: Factorial Validity and Equivalency of the SDQ III Across Gender. , 1988, Multivariate behavioral research.

[31]  Barbara M. Byrne.  Investigating Measures of Self-Concept. , 1983 .

[32]  R. Kanfer,et al.  Equivalence of psychological measurement in heterogeneous populations. , 1985, The Journal of applied psychology.

[33]  Herbert W. Marsh,et al.  Self Description Questionnaire III: The construct validity of multidimensional self-concept ratings by late adolescents. , 1984 .

[34]  Scott E. Maxwell,et al.  Multitrait-Multimethod Comparisons Across Populations: A Confirmatory Factor Analytic Approach. , 1985, Multivariate behavioral research.