The R Package CDM for Cognitive Diagnosis Models

This paper introduces the R package CDM for cognitive diagnosis models (CDMs). The package implements parameter estimation procedures for two general CDM frameworks, the generalized-deterministic input noisy-and-gate (G-DINA) and the general diagnostic model (GDM). It contains additional functions for analyzing data under these frameworks, like tools for simulating and plotting data, or for evaluating global model and item fit. The paper describes the theoretical aspects of implemented CDM frameworks and it illustrates the usage of the package with empirical data of the common fraction subtraction test by Tatsuoka (1984).

[1]  Pierre Foy,et al.  PIRLS 2006 International Report IEA's Progress in International Reading Literacy Study in Primary Schools in 40 Countries , 2007 .

[2]  G. H. Fischer,et al.  The linear logistic test model as an instrument in educational research , 1973 .

[3]  R. P. McDonald,et al.  Goodness of Fit in Item Response Models. , 1995, Multivariate behavioral research.

[4]  Mark J. Gierl,et al.  The Attribute Hierarchy Method for Cognitive Assessment: A Variation on Tatsuoka's Rule-Space Approach , 2004 .

[5]  André A. Rupp,et al.  A practical illustration of multidimensional diagnostic skills profiling: Comparing results from confirmatory factor analysis and diagnostic classification models , 2009 .

[6]  Jurgen A. Doornik,et al.  Object-orientd matrix programming using OX , 1996 .

[7]  R. Henson,et al.  Cognitive Diagnostic Attribute-Level Discrimination Indices , 2008 .

[8]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[9]  J. D. L. Torre,et al.  DINA Model and Parameter Estimation: A Didactic , 2009 .

[10]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[11]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[12]  Jonathan Templin,et al.  Robustness of Hierarchical Modeling of Skill Association in Cognitive Diagnosis Models , 2008 .

[13]  Jean-Claude Falmagne,et al.  Knowledge spaces , 1998 .

[14]  Jimmy de la Torre,et al.  Differential Item Functioning Assessment in Cognitive Diagnostic Modeling: Application of the Wald Test to Investigate DIF in the DINA Model. , 2014 .

[15]  Tao Xin,et al.  A Polytomous Extension of the Generalized Distance Discriminating Method , 2013 .

[16]  Matthias von Davier,et al.  The DINA model as a constrained general diagnostic model: Two variants of a model equivalency. , 2014 .

[17]  Matthias von Davier,et al.  COMPARING MULTIPLE-GROUP MULTINOMIAL LOG-LINEAR MODELS FOR MULTIDIMENSIONAL SKILL DISTRIBUTIONS IN THE GENERAL DIAGNOSTIC MODEL , 2008 .

[18]  Albert Maydeu-Olivares.  Goodness-of-Fit Assessment of Item Response Theory Models , 2013 .

[19]  D. Thissen,et al.  Local Dependence Indexes for Item Pairs Using Item Response Theory , 1997 .

[20]  Alexander Robitzsch,et al.  Cognitive Diagnosis Modeling , 2015 .

[21]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[22]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[23]  Wenchao Ma.  Diagnostic Measurement: Theory, Methods, and Applications , 2018 .

[24]  Youn Seon Lim,et al.  Efficient Models for Cognitive Diagnosis With Continuous and Mixed-Type Latent Variables , 2015, Applied psychological measurement.

[25]  Jimmy de la Torre,et al.  A Cognitive Diagnosis Model for Cognitively Based Multiple-Choice Options. , 2009 .

[26]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[27]  Louis V. DiBello,et al.  31A Review of Cognitively Diagnostic Assessment and a Summary of Psychometric Models , 2006 .

[28]  Mark Gierl,et al.  Estimating Classification Consistency and Accuracy for Cognitive Diagnostic Assessment. , 2012 .

[29]  Gregory J. Cizek,et al.  Setting Performance Standards: Contemporary Methods , 2005 .

[30]  ANTON K. FORMANN,et al.  Structural Latent Class Models , 1998 .

[31]  Kikumi K. Tatsuoka,et al.  Analysis of Errors in Fraction Addition and Subtraction Problems. Final Report. , 1984 .

[32]  J. D. L. Torre,et al.  The Generalized DINA Model Framework. , 2011 .

[33]  Jimmy de la Torre,et al.  An Empirically Based Method of Q‐Matrix Validation for the DINA Model: Development and Applications , 2008 .

[34]  Jimmy de la Torre,et al.  A General Cognitive Diagnosis Model for Expert-Defined Polytomous Attributes , 2013 .

[35]  Li Cai,et al.  A Comparison of Item Parameter Standard Error Estimation Procedures for Unidimensional and Multidimensional Item Response Theory Modeling , 2014 .

[36]  Yoon Soo Park,et al.  Relationships between cognitive diagnosis, CTT, and IRT indices: an empirical investigation , 2012 .

[37]  Alan Huebner,et al.  A Note on Comparing Examinee Classification Methods for Cognitive Diagnosis Models , 2011 .

[38]  Gerhard Tutz,et al.  Sequential Models for Ordered Responses , 1997 .

[39]  Susan E. Whitely,et al.  Multicomponent latent trait models for ability tests , 1980 .

[40]  J. D. L. Torre,et al.  Evaluating the Wald Test for Item‐Level Comparison of Saturated and Reduced Models in Cognitive Diagnosis , 2013 .

[41]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[42]  Matthias von Davier,et al.  FITTING THE STRUCTURED GENERAL DIAGNOSTIC MODEL TO NAEP DATA , 2008 .

[43]  Jimmy de la Torre,et al.  Estimating a Cognitive Diagnostic Model for Multiple Strategies via the EM Algorithm , 2014 .

[44]  Laine Bradshaw,et al.  Hierarchical Diagnostic Classification Models: A Family of Models for Estimating and Testing Attribute Hierarchies , 2014, Psychometrika.

[45]  John T. Willse,et al.  Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables , 2009 .

[46]  Jeroen K. Vermunt,et al.  LEM: A general program for the analysis of categorical data. Users manual , 1997 .

[47]  Ann Cathrice George,et al.  On Permissible Attribute Classes in Noncompensatory Cognitive Diagnosis Models , 2014 .

[48]  Edward H. Haertel.  Using restricted latent class models to map the skill structure of achievement items , 1989 .

[49]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[50]  Matthias von Davier,et al.  Some Notes on the Reinvention of Latent Structure Models as Diagnostic Classification Models , 2009 .

[51]  Jimmy de la Torre,et al.  Relative and Absolute Fit Evaluation in Cognitive Diagnosis Modeling. , 2013 .

[52]  C. Mitchell Dayton,et al.  The Use of Probabilistic Models in the Assessment of Mastery , 1977 .

[53]  A. Formann.  Linear Logistic Latent Class Analysis for Polytomous Data , 1992 .

[54]  Chia-Yi Chiu,et al.  Cluster Analysis for Cognitive Diagnosis: Theory and Applications , 2009 .

[55]  Lesa Hoffman,et al.  Obtaining Diagnostic Classification Model Estimates Using Mplus , 2013 .

[56]  Matthias von Davier,et al.  A general diagnostic model applied to language testing data. , 2008, The British journal of mathematical and statistical psychology.