论文信息 - 31B Some Notes on Models for Cognitively Based Skills Diagnosis

31B Some Notes on Models for Cognitively Based Skills Diagnosis

Publisher Summary Cognitive diagnostic assessment traditionally has been performed through the use of specialized tests designed for this purpose. These tests are traditionally analyzed by straightforward statistical methods. However, within psychometrics, recently a much different picture of cognitive diagnosis has emerged in which statistical models are employed to obtain cognitive diagnosis information from conventional assessments not designed for cognitive diagnosis purposes. This chapter examines whether use of these statistical models accomplishes its purpose. The challenge to cognitive diagnostic models arises when a single test designed to measure a single proficiency is analyzed in an attempt to extract more information. Such design leads to a test relatively well described by the use of conventional univariate item response theory. To be sure, such an item response model does not provide a perfect description of the data, but the room for improvement appears to be modest. In addition, some causes of model variation are much more prosaic than the causes considered by cognitive diagnostic models.

Matthias von Davier | Shelby J. Haberman

[1] Anne Thissen-Roe,et al. The DIAGNOSER project: Combining assessment and learning , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[2] M. Reckase. The Past and Future of Multidimensional Item Response Theory , 1997 .

[3] S. Haberman. WHEN CAN SUBSCORES HAVE VALUE , 2005 .

[4] Mark D. Reckase,et al. The Difficulty of Test Items That Measure More Than One Ability , 1985 .

[5] Raymond J. Adams,et al. The Multidimensional Random Coefficients Multinomial Logit Model , 1997 .

[6] Sandip Sinharay,et al. Assessing Fit of Unidimensional Item Response Theory Models Using a Bayesian Approach. , 2005 .

[7] Matthias von Davier,et al. 19 Mixture Distribution Item Response Models , 2006 .

[8] J. Pannekoek,et al. Bootstrapping Goodness-of-Fit Measures in Categorical Data Analysis , 1996 .

[9] Christopher Hitchcock,et al. Prediction Versus Accommodation and the Risk of Overfitting , 2004, The British Journal for the Philosophy of Science.

[10] E. Maris. Estimating multiple classification latent class models , 1999 .

[11] B. Junker,et al. Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[12] Jeffrey A Douglas,et al. Higher-order latent trait models for cognitive diagnosis , 2004 .

[13] Matthias von Davier,et al. A GENERAL DIAGNOSTIC MODEL APPLIED TO LANGUAGE TESTING DATA , 2005 .