A Hidden Markov Model for Learning Trajectories in Cognitive Diagnosis With Application to Spatial Rotation Skills

The increasing presence of electronic and online learning resources presents challenges and opportunities for psychometric techniques that can assist in the measurement of abilities and even hasten their mastery. Cognitive diagnosis models (CDMs) are ideal for tracking many fine-grained skills that comprise a domain, and can assist in carefully navigating through the training and assessment of these skills in e-learning applications. A class of CDMs for modeling changes in attributes is proposed, which is referred to as learning trajectories. The authors focus on the development of Bayesian procedures for estimating parameters of a first-order hidden Markov model. An application of the developed model to a spatial rotation experimental intervention is presented.

[1]  A. Cohen,et al.  A Latent Transition Analysis Model for Assessing Change in Cognitive Skills , 2016, Educational and psychological measurement.

[2]  E. Maris.  Estimating multiple classification latent class models , 1999 .

[3]  Jeff Douglas,et al.  Sequential detection of learning in cognitive diagnosis. , 2016, The British journal of mathematical and statistical psychology.

[4]  J. Templin,et al.  Measurement of psychological disorders using cognitive diagnosis models. , 2006, Psychological methods.

[5]  Yanbo Xu,et al.  Comparison of methods to trace multiple subskills: Is LR-DBN best? , 2012, EDM.

[6]  Gongjun Xu,et al.  Identifiability of restricted latent class models with binary responses , 2016, 1603.04140.

[7]  Jack Mostow,et al.  What and When do Students Learn? Fully Data-Driven Joint Estimation of Cognitive and Student Models , 2013, EDM.

[8]  Chia-Yi Chiu,et al.  Cluster Analysis for Cognitive Diagnosis: Theory and Applications , 2009 .

[9]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[10]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[11]  Cassandra Studer,et al.  Incorporating Learning Over Time into the Cognitive Assessment Framework , 2010 .

[12]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[13]  Walter L. Leite,et al.  Assessing Change in Latent Skills Across Time With Longitudinal Cognitive Diagnosis Modeling: An Evaluation of Model Performance , 2017, Educational and psychological measurement.

[14]  John T. Willse,et al.  Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables , 2009 .

[15]  Russell G. Almond,et al.  Assessing Fit of Cognitive Diagnostic Models A Case Study , 2007 .

[16]  Hal S. Stern,et al.  Posterior Predictive Assessment of Item Response Theory Models , 2006 .

[17]  Peter Brusilovsky,et al.  General Features in Knowledge Tracing to Model Multiple Subskills, Temporal Item Response Theory, and Expert Knowledge , 2014, EDM.

[18]  So Yoon Yoon,et al.  Psychometric properties of the Revised Purdue Spatial Visualization Tests: Visualization of Rotations (the Revised PSVT:R) , 2011 .

[19]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .