Bayesian DINA Modeling Incorporating Within-Item Characteristic Dependency

The within-item characteristic dependency (WICD) means that dependencies exist among different types of item characteristics/parameters within an item. The potential WICD has been ignored by current modeling approaches and estimation algorithms for the deterministic inputs noisy “and” gate (DINA) model. To explicitly model WICD, this study proposed a modified Bayesian DINA modeling approach where a bivariate normal distribution was employed as a joint prior distribution for correlated item parameters. Simulation results indicated that the model parameters were well recovered and that explicitly modeling WICD improved model parameter estimation accuracy, precision, and efficiency. In addition, when potential item blocks existed, the proposed modeling approach still demonstrated good performance and high robustness. Furthermore, the fraction subtraction data were analyzed to illustrate the application and advantage of the proposed modeling approach.

[1]  Jean-Paul Fox,et al.  Bayesian Item Response Modeling , 2010 .

[2]  J. D. L. Torre.  Multidimensional Scoring of Abilities: The Ordered Polytomous Response Case: , 2008 .

[3]  Ying Cheng.  When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT , 2009 .

[4]  L. T. DeCarlo.  On the Analysis of Fraction Subtraction Data: The DINA Model, Classification, Latent Class Sizes, and the Q-Matrix , 2011 .

[5]  Steven Andrew Culpepper,et al.  Bayesian Estimation of the DINA Model With Gibbs Sampling , 2015 .

[6]  J. D. L. Torre,et al.  DINA Model and Parameter Estimation: A Didactic , 2009 .

[7]  Wenchao Ma,et al.  A sequential cognitive diagnosis model for polytomous responses. , 2016, The British journal of mathematical and statistical psychology.

[8]  Hua-Hua Chang,et al.  a-Stratified CAT design with content blocking. , 2003, The British journal of mathematical and statistical psychology.

[9]  Gongjun Xu,et al.  Identifiability of Diagnostic Classification Models , 2015, Psychometrika.

[10]  J. D. L. Torre,et al.  The Generalized DINA Model Framework. , 2011 .

[11]  Lesa Hoffman,et al.  Obtaining Diagnostic Classification Model Estimates Using Mplus , 2013 .

[12]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[13]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[14]  Yoon Soo Park,et al.  Relationships between cognitive diagnosis, CTT, and IRT indices: an empirical investigation , 2012 .

[15]  George B. Macready,et al.  The application of latent class models in adaptive testing , 1992 .

[16]  Chia-Yi Chiu,et al.  A Proof of the Duality of the DINA Model and the DINO Model , 2016, J. Classif..

[17]  Wim J. van der Linden,et al.  Computerized Adaptive Testing With Item Cloning , 2003 .

[18]  J. Templin,et al.  Measurement of psychological disorders using cognitive diagnosis models. , 2006, Psychological methods.

[19]  Jimmy de la Torre,et al.  An Empirically Based Method of Q‐Matrix Validation for the DINA Model: Development and Applications , 2008 .

[20]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[21]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[22]  John T. Willse,et al.  Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables , 2009 .

[23]  Matthias von Davier,et al.  A General Diagnostic Model Applied to Language Testing Data. Research Report. ETS RR-05-16. , 2005 .

[24]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo in Practice: A Roundtable Discussion , 1998 .

[25]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[26]  Wen-Chung Wang,et al.  Improving measurement precision of test batteries using multidimensional item response models. , 2004, Psychological methods.

[27]  Chia-Yi Chiu,et al.  A General Method of Empirical Q-matrix Validation , 2016, Psychometrika.

[28]  van der Linden,et al.  A hierarchical framework for modeling speed and accuracy on test items , 2007 .

[29]  Matthias von Davier,et al.  The DINA model as a constrained general diagnostic model: Two variants of a model equivalency. , 2014 .

[30]  Yuguo Chen,et al.  Bayesian Estimation of the DINA Q matrix , 2018, Psychometrika.