论文信息 - Cognitive Diagnostic Attribute-Level Discrimination Indices

Cognitive Diagnostic Attribute-Level Discrimination Indices

Cognitive diagnostic models (CDMs) model the probability of correctly answering an item as a function of an examinee's attribute mastery pattern. Because estimation of the mastery pattern involves more than a continuous measure of ability, reliability concepts introduced by classical test theory and item response theory do not apply. The cognitive diagnostic index (CDI) measures an item's overall discrimination power, which indicates an item's usefulness in examinee attribute pattern estimation. Because of its relationship with correct classification rates, the CDI was shown to be instrumental in cognitively diagnostic test assembly. This article generalizes the CDI to attribute-level discrimination indices for an item. Two different attribute-level discrimination indices are defined; their relationship with correct classification rates is explored using Monte Carlo simulations. There are strong relationships between the defined attribute indices and correct classification rates. Thus, one important potential application of these indices is test assembly from a CDM-calibrated item bank.

[1] M. R. Novick,et al. Statistical Theories of Mental Test Scores. , 1971 .

[2] F. Lord. Applications of Item Response Theory To Practical Testing Problems , 1980 .

[3] R. Hambleton,et al. Item Response Theory , 1984, The History of Educational Measurement.

[4] C. Mitchell Dayton,et al. The Use of Probabilistic Models in the Assessment of Mastery , 1977 .

[5] E. Maris. Estimating multiple classification latent class models , 1999 .

[6] Ding Shuliang,et al. Test Construction for Cognitive Diagnosis , 2010, 2010 Asia-Pacific Conference on Wearable Computing Systems.

[7] David Rindskopf. A general framework for using latent class analysis to test hierarchical and nonhierarchical learning models , 1983 .

[8] Hua-Hua Chang,et al. A Global Information Approach to Computerized Adaptive Testing , 1996 .

[9] Jeffrey A Douglas,et al. Test Construction for Cognitive Diagnosis , 2005 .

[10] Edward H. Haertel. Using restricted latent class models to map the skill structure of achievement items , 1989 .

[11] Sarah M. Hartz,et al. A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality. , 2002 .

[12] C. Radhakrishna Rao,et al. Efficient Estimates and Optimum Inference Procedures in Large Samples , 1962 .

[13] B. Junker,et al. Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .