Traditional Dimensionality Versus Essential Dimensionality

This article addresses testing the hypothesis of one versus more than one dominant (essential) dimension in the possible presence of minor dimensions. The method used is Stout's statistical test of essential unidimensionality, which is based on the theory of essential unidimensionality. Differences between the traditional definition of dimensionality provided by item response theory, which counts all dimensions present, and essential dimensionality, which counts only dominant dimensions, are discussed. As Monte Carlo studies demonstrate, Stout's test of essential unidimensionality tends to indicate essential unidimensionality in the presence of one dominant dimension and one or more minor dimensions that have a relatively small influence on item scores. As the influence of the minor dimensions increases, Stout's test is more likely to reject the hypothesis of essential unidimensionality. To assist in interpreting these studies, a rough index of the deviation from essential unidimensionality is proposed.

[1]  M. Reckase.  Unifactor Latent Trait Models Applied to Multifactor Tests: Results and Implications , 1979 .

[2]  L. Humphreys.  An analysis and evaluation of test and item bias in the prediction context. , 1986 .

[3]  The Definition of Difficulty and Discrimination for Multidimensional Item Response Theory Models. , 1983 .

[4]  Patrick Suppes,et al.  When are Probabilistic Explanations Possible , 1981 .

[5]  William Stout,et al.  A New Item Response Theory Modeling Approach with Applications to Unidimensionality Assessment and Ability Estimation , 1990 .

[6]  Fritz Drasgow,et al.  Study of the measurement bias of two standardized psychological tests. , 1987 .

[7]  Mark D. Reckase,et al.  Building a Unidimensional Test Using Multidimensional Items , 1988 .

[8]  W. M. Yen.  Increasing item complexity: A possible cause of scale shrinkage for unidimensional item response theory , 1985 .

[9]  David A. Harrison,et al.  Robustness of Irt Parameter Estimation to Violations of The Unidimensionality Assumption , 1986 .

[10]  R. D. Bock,et al.  Item Operating Characteristics of the Armed Services Vocational Aptitude Battery (ASVAB), Form 8A, , 1984 .

[11]  J. Lumsden,et al.  The construction of unidimensional tests. , 1961, Psychological bulletin.

[12]  Marek Libura,et al.  Multidimensional Item Response Theory Estimation: A computer program , 1987 .

[13]  Terry A. Ackerman.  Unidimensional IRT Calibration of Compensatory and Noncompensatory Multidimensional Items , 1989 .

[14]  Robert A. Forsyth,et al.  An Examination of the Characteristics of Unidimensional IRT Parameter Estimates Derived From Two-Dimensional Data , 1985 .

[15]  R. P. McDonald,et al.  Nonlinear factor analysis. , 1967 .

[16]  Mark D. Reckase,et al.  The Difficulty of Test Items That Measure More Than One Ability , 1985 .

[17]  David J. Weiss.  Proceedings of the 1977 Computerized Adaptive Testing Conference , 1977 .

[18]  Mark D. Reckase.  The Interpretation and Application of Multidimensional Item Response Theory Models; and Computerized Testing in the Instructional Environment , 1989 .

[19]  C. Parsons,et al.  Application of Unidimensional Item Response Theory Models to Multidimensional Data , 1983 .

[20]  Roderick P. McDonald,et al.  DIFFICULTY FACTORS IN BINARY DATA , 1974 .

[21]  F. Drasgow,et al.  A Revision of the Job Diagnostic Survey: Elimination of a Measurement Artifact , 1987 .

[22]  Harvey Goldstein,et al.  Dimensionality, bias, independence and measurement scale problems in latent trait test score models , 1980 .

[23]  Lloyd G. Humphreys,et al.  The organization of human abilities. , 1962 .

[24]  David Thissen,et al.  Trace Lines for Testlets: A Use of Multiple-Categorical-Response Models. , 1989 .

[25]  Frederic M. Lord,et al.  An Analysis of the Verbal Scholastic Aptitude Test Using Birnbaum's Three-Parameter Logistic Model , 1968 .

[26]  Wendy M. Yen,et al.  Effects of Local Item Dependence on the Fit and Equating Performance of the Three-Parameter Logistic Model , 1984 .

[27]  Roderick P. McDonald,et al.  The dimensionality of tests and items , 1981 .

[28]  William Stout,et al.  A nonparametric approach for assessing latent trait unidimensionality , 1987 .

[29]  Lloyd G. Humphreys,et al.  The Primary Mental Ability , 1981 .