A One-Parameter Diagnostic Classification Model with Familiar Measurement Properties

Diagnostic classification models (DCMs) are psychometric models designed to classify examinees according to their proficiency or non-proficiency of specified latent characteristics. These models are well-suited for providing diagnostic and actionable feedback to support formative assessment efforts. Several DCMs have been developed and applied in different settings. This study proposes a DCM with functional form similar to the 1-parameter logistic item response theory model. Using data from a large-scale mathematics education research study, we demonstrate that the proposed DCM has measurement properties akin to the Rasch and 1-parameter logistic item response theory models, including test score sufficiency, item-free and person-free measurement, and invariant item and person ordering. We discuss the implications and limitations of these developments, as well as directions for future research.

[1]  Hamdollah Ravand,et al.  Examining Parameter Invariance in a General Diagnostic Classification Model , 2020, Frontiers in Psychology.

[2]  Matthew J Madison,et al.  Assessing Growth in a Diagnostic Classification Model Framework , 2018, Psychometrika.

[3]  Robert A. Henson,et al.  Applications of Diagnostic Classification Models: A Literature Review and Critical Commentary , 2018 .

[4]  H. Lao.  Estimation of Diagnostic Classification Models without Constraints: Issues with Class Label Switching , 2016 .

[5]  Michael D. Toland,et al.  Impact of Enhanced Anchored Instruction in Inclusive Math Classrooms , 2015 .

[6]  Michael D. Toland,et al.  Effects of Blended Instructional Models on Math Performance , 2014 .

[7]  J. Templin,et al.  Measuring the Reliability of Diagnostic Classification Model Examinee Estimates , 2013, J. Classif..

[8]  George Engelhard,et al.  Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences , 2012 .

[9]  R. Philip Chalmers,et al.  mirt: A Multidimensional Item Response Theory Package for the R Environment , 2012 .

[10]  André A. Rupp,et al.  The Impact of Model Misspecification on Parameter Estimation and Item‐Fit Assessment in Log‐Linear Diagnostic Classification Models , 2012 .

[11]  Jonathan Templin,et al.  Diagnostic Measurement: Theory, Methods, and Applications , 2010 .

[12]  J. D. L. Torre,et al.  A Note on the Invariance of the DINA Model Parameters. , 2010 .

[13]  John T. Willse,et al.  Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables , 2009 .

[14]  J. D. L. Torre,et al.  DINA Model and Parameter Estimation: A Didactic , 2009 .

[15]  J. Templin,et al.  Measurement of psychological disorders using cognitive diagnosis models. , 2006, Psychological methods.

[16]  Elizabeth A. Watson,et al.  Effects of Video-Based and Applied Problems on the Procedural Math Skills of Average- and Low-Achieving Adolescents , 2003 .

[17]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[18]  Edward H. Haertel.  Using restricted latent class models to map the skill structure of achievement items , 1989 .

[19]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[20]  G. Masters,et al.  Rating Scale Analysis. Rasch Measurement. , 1983 .

[21]  G. Engelhard,et al.  Rasch Models for Solving Measurement Problems: Invariant Measurement in the Social Sciences , 2021 .