On the Assessment of Unidimensional Measurement: Internal and External Consistency, and Overall Consistency Criteria

Kumar and Dillon recently presented a conceptual, overall consistency criterion that represents a sufficient condition for consistency. In commenting on their article, the authors (1) clarify the interrelated nature of internal consistency and external consistency, (2) show that the “bogus perfect fit” example is itself “bogus” in that it cannot occur in either theory or practice, (3) underscore that the specific overall consistency criterion formula defined by Kumar and Dillon cannot be applied in practice, whereas the internal consistency and external consistency criteria can, and (4) caution against using within-block factor analyses as recommended by Kumar and Dillon, and instead advocate the use of confirmatory factor analysis with multiple-indicator measurement models for assessing unidimensionality. In an addendum, the authors discuss their position on unidimensionality and its assessment, contrasting it with the Kumar and Dillon position on unidimensionality and consistency.

[1]  C. Spearman,et al.  THE SAMPLING ERROR IN THE THEORY OF TWO FACTORS , 1924 .

[2]  C. Burt Factor Analysis by Sub-Matrices , 1938 .

[3]  R. Tryon Cluster Analysis , 1939 .

[4]  L. Tucker The role of correlated factors in factor analysis , 1940 .

[5]  K. Holzinger,et al.  A simple method of factor analysis , 1944 .

[6]  L. Cronbach Test “reliability”: Its meaning and determination , 1947, Psychometrika.

[7]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[8]  THE SQUARE ROOT METHOD , 1952 .

[9]  Harry H. Harman,et al.  The square root method and multiple group methods of factor analysis , 1954 .

[10]  G. Freytag [CORRELATION AND CAUSALITY]. , 1964, Psychiatrie, Neurologie, und medizinische Psychologie.

[11]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[12]  K. Jöreskog A general approach to confirmatory maximum likelihood factor analysis , 1969 .

[13]  K. Jöreskog Statistical analysis of sets of congeneric tests , 1971 .

[14]  J. Hunter Methods of Reordering the Correlation Matrix to Facilitate Visual Inspection and Preliminary Cluster Analysis. , 1973 .

[15]  K. Jöreskog,et al.  Intraclass Reliability Estimates: Testing Structural Assumptions , 1974 .

[16]  K. Jöreskog Structural analysis of covariance and correlation matrices , 1978 .

[17]  Roderick P. McDonald,et al.  The dimensionality of tests and items , 1981 .

[18]  David W. Gerbing,et al.  Some Methods for Respecifying Measurement Models to Obtain Unidimensional Construct Measurement , 1982 .

[19]  P. Bentler Some contributions to efficient statistics in structural models: Specification and estimation of moment structures , 1983 .

[20]  James C. Anderson,et al.  On the Meaning of Within-Factor Correlated Measurement Errors , 1984 .

[21]  John Hattie,et al.  Methodology Review: Assessing Unidimensionality of Tests and ltenls , 1985 .

[22]  William R. Dillon,et al.  The Interaction of Measurement and Structure in Simultaneous Equation Models with Unobservable Variables , 1987 .

[23]  William R. Dillon,et al.  Some Further Remarks on Measurement-Structure Interaction and the Unidimensionality of Constructs , 1987 .