An Assessment of Stout's Index of Essential Unidimensionality

A simulation study was conducted to evaluate the dependability of Stout's T index of unidimensionality as used in his DIMTEST procedure. DIMTEST was found to dependably provide indications of unidimensionality, to be reasonably robust, and to allow for a practical demar cation between one and many dimensions. The proce dure was not affected by the method used to identify the initial subset of unidimensional items. It was, how ever, found to be sensitive to whether the multidimen sional data arose from a compensatory model or a partially compensatory model. DIMTEST failed when the matrix of tetrachoric correlations was non-Gramian and hence is not appropriate in such cases.

[1]  K. Pearson.  Mathematical contributions to the theory of evolution. VIII. On the correlation of characters not quantitatively measurable , 2022, Proceedings of the Royal Society of London.

[2]  W. Elderton.  Frequency Curves and Correlation , 1907, Nature.

[3]  H. M. Johnson.  Some Neglected Principles in Aptitude-Testing , 1935 .

[4]  John B. Carroll,et al.  The effect of difficulty and chance success on correlations between items or between tests , 1945 .

[5]  Q. Mcnemar,et al.  Opinion-attitude methodology. , 1946, Psychological bulletin.

[6]  N. Gourlay.  DIFFICULTY FACTORS ARISING FROM THE USE OF TETRACHORIC CORRELATIONS IN FACTOR ANALYSIS , 1951 .

[7]  C. Coombs.  A theory of data. , 1965, Psychology Review.

[8]  J. Carroll.  The nature of the data, or how to choose a correlation coefficient , 1961 .

[9]  Raymond B. Cattell,et al.  Validity and reliability: A proposed more basic set of concepts. , 1964 .

[10]  W Meredith,et al.  Some results based on a general stochastic model for mental tests , 1965, Psychometrika.

[11]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[12]  D. B. Kirk.  On the numerical approximation of the bivariate normal (tetrachoric) correlation coefficient , 1973 .

[13]  Roderick P. McDonald,et al.  DIFFICULTY FACTORS IN BINARY DATA , 1974 .

[14]  Anders Christoffersson,et al.  Factor analysis of dichotomized variables , 1975 .

[15]  R P McDonald,et al.  The Structural Analysis Of Multivariate Data: A Sketch Of A General Theory. , 1979, Multivariate behavioral research.

[16]  R. P. McDonald,et al.  Determinacy of common factors: A nontechnical review. , 1979 .

[17]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[18]  Roderick P. McDonald,et al.  The dimensionality of tests and items , 1981 .

[19]  Ross E. Traub,et al.  Latent Trait Theories and the Assessment of Educational Achievement , 1981 .

[20]  P. Holland.  When are item response models consistent with observed data? , 1981 .

[21]  J. Hattie.  A Four-Stage Factor Analytic Approach to Studying Behavioral Domains , 1981 .

[22]  Roderick P. McDonald,et al.  Linear Versus Models in Item Response Theory , 1982 .

[23]  Fritz Drasgow,et al.  Item response theory : application to psychological measurement , 1983 .

[24]  Mark D. Reckase,et al.  MAXLOG: A computer program for the estimation of the parameters of a multidimensional logistic model , 1983 .

[25]  R. P. McDonald,et al.  A second generation nonlinear factor analysis , 1983 .

[26]  Frederic M. Lord,et al.  CONJUNCTIVE AND DISJUNCTIVE ITEM RESPONSE FUNCTIONS , 1984 .

[27]  John Hattie,et al.  An Empirical Study of Various Indices for Determining Unidimensionality. , 1984, Multivariate behavioral research.

[28]  John Hattie,et al.  Methodology Review: Assessing Unidimensionality of Tests and ltenls , 1985 .

[29]  Robert A. Forsyth,et al.  An Examination of the Characteristics of Unidimensional IRT Parameter Estimates Derived From Two-Dimensional Data , 1985 .

[30]  Robert J. Jannarone,et al.  Conjunctive item response theory kernels , 1986 .

[31]  P. Rosenbaum,et al.  Conditional Association and Unidimensionality in Monotone Latent Variable Models , 1985 .

[32]  L. Humphreys.  An analysis and evaluation of test and item bias in the prediction context. , 1986 .

[33]  Terry A. Ackerman.  The Robustness of LOGIST and BILOG IRT Estimation Programs to Violations of Local Independence. , 1987 .

[34]  William Stout,et al.  A nonparametric approach for assessing latent trait unidimensionality , 1987 .

[35]  H. Jane Rogers,et al.  A Monte Carlo Investigation of Several Person and Item Fit Statistics for Item Response Models , 1987 .

[36]  Marek Libura,et al.  Multidimensional Item Response Theory Estimation: A computer program , 1987 .

[37]  Mark D. Reckase,et al.  Building a Unidimensional Test Using Multidimensional Items , 1988 .

[38]  William F. Strout.  A new item response theory modeling approach with applications to unidimensionality assessment and ability estimation , 1990 .

[39]  B. Junker.  Progress in Characterizing Strictly Unidimensional IRT Representations , 1990 .

[40]  Marc E. Gessaroli,et al.  Assessing Test Dimensionality Using an Index Based on Nonlinear Factor Analysis. , 1991 .

[41]  Lloyd G. Humphreys,et al.  Three Approaches to Determining the Dimensionality of Binary Items , 1991 .

[42]  Brian W. Junker,et al.  Essential independence and likelihood-based ability estimation for polytomous items , 1991 .

[43]  Ratna Nandakumar,et al.  Assessing Dimensionality of a Set of Items - Comparison of Different Approaches , 1992 .

[44]  Terry A. Ackerman.  A Didactic Explanation of Item Bias, Item Impact, and Item Validity from a Multidimensional Perspective , 1992 .

[45]  J. Hattie,et al.  Construct validity and achievement assessment , 1993 .

[46]  Ratna Nandakumar,et al.  Refinements of Stout’s Procedure for Assessing Latent Trait Unidimensionality , 1993 .

[47]  J. Hattie,et al.  Dimension: A Program to Generate Unidimensional and Multidimensional Item Response Data , 1993 .

[48]  Identifiers California,et al.  Annual Meeting of the National Council on Measurement in Education , 1998 .