Analyzing pre-test/post-test designs in a diagnostic classification model framework

.................................................................................................................15 Method ...................................................................................................................20 Simulation Study ....................................................................................................32 Evaluation of TDCM Performance ........................................................................37 Simulation Study Results .......................................................................................40

[1]  L. Collins,et al.  Latent Class Models for Stage-Sequential Dynamic Latent Variables , 1992 .

[2]  J. Templin,et al.  Measurement of psychological disorders using cognitive diagnosis models. , 2006, Psychological methods.

[3]  Mark J. Gierl,et al.  Estimating Classification Consistency and Accuracy for Cognitive Diagnostic Assessment. , 2012 .

[4]  Louis A. Roussos,et al.  The fusion model skills diagnosis system , 2007 .

[5]  Matthew J. Madison,et al.  Invariance Properties for General Diagnostic Classification Models , 2016 .

[6]  J. Templin,et al.  Modification Indices for Diagnostic Classification Models , 2013, Multivariate behavioral research.

[7]  E. Andersen.  Comparing latent distributions , 1980 .

[8]  Jonathan Templin,et al.  Diagnostic Measurement: Theory, Methods, and Applications , 2010 .

[9]  Matthias von Davier,et al.  A general diagnostic model applied to language testing data. , 2008, The British journal of mathematical and statistical psychology.

[10]  Cynthia E. Glidden.  How to Design and Evaluate Research in Education (2nd ed.). , 1993 .

[11]  Educational Evaluation.  Standards for Educational and Psychological Testing , 1999 .

[12]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[13]  Stephanie T. Lanza,et al.  A mixture model of discontinuous development in heavy drinking from ages 18 to 30: the role of college enrollment. , 2006, Journal of studies on alcohol.

[14]  D. Reboussin,et al.  Estimating Equations for a Latent Transit ion Model with Multiple Discrete Indicators , 1999, Biometrics.

[15]  Linda M. Collins,et al.  Latent class and latent transition analysis , 2009 .

[16]  Eunice Eunhee Jang,et al.  A *Validity Narrative: Effects of Reading Skills Diagnosis on Teaching and Learning in the Context of NG TOEFL , 2005 .

[17]  Kikumi K. Tatsuoka,et al.  Computerized Cognitive Diagnostic Adaptive Testing: Effect on Remedial Instruction as Empirical Validation , 1997 .

[18]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[19]  Edward H. Haertel.  Using restricted latent class models to map the skill structure of achievement items , 1989 .

[20]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[21]  Laine Bradshaw,et al.  Measuring the Reliability of Diagnostic Classification Model Examinee Estimates , 2013, J. Classif..

[22]  Kristen Huff,et al.  Cognitive Diagnostic Assessment for Education: The Demand for Cognitive Diagnostic Assessment , 2007 .

[23]  Using Latent Transition Analysis in Nursing Research to Explore Change Over Time , 2011, Nursing research.

[24]  R. Darrell Bock,et al.  Multiple Group IRT , 1997 .

[25]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[26]  Elizabeth A. Watson,et al.  Effects of Video-Based and Applied Problems on the Procedural Math Skills of Average- and Low-Achieving Adolescents , 2003 .

[27]  Gerhard H. Fischer,et al.  An irt-based model for dichotomous longitudinal data , 1989 .

[28]  Allan S. Cohen,et al.  Defining Error Rates and Power for Detecting Answer Copying , 2001 .

[29]  Stephanie T. Lanza,et al.  Latent Class and Latent Transition Analysis: With Applications in the Social, Behavioral, and Health Sciences , 2009 .

[30]  K Humphreys,et al.  Latent Transition Analysis with Covariates, Nonresponse, Summary Statistics and Diagnostics: Modelling Children's Drawing Development , 2000, Multivariate behavioral research.

[31]  D. Reboussin,et al.  Latent Transition Modeling of Progression of Health-Risk Behavior. , 1998, Multivariate behavioral research.

[32]  Matthias von Davier,et al.  Measuring Growth in a Longitudinal Large-Scale Assessment with a General Latent Variable Model , 2011 .

[33]  Matthias von Davier,et al.  A General Diagnostic Model Applied to Language Testing Data. Research Report. ETS RR-05-16. , 2005 .

[34]  E. Maris.  Estimating multiple classification latent class models , 1999 .

[35]  J. Vermunt,et al.  Discrete-Time Discrete-State Latent Markov Models with Time-Constant and Time-Varying Covariates , 1999 .

[36]  Michael D. Toland,et al.  Effects of Blended Instructional Models on Math Performance , 2014 .

[37]  Allan S. Cohen,et al.  A Mixture Item Response Model for Multiple-Choice Data , 2001 .

[38]  Wim J. van der Linden,et al.  Handbook of Item Response Theory, Three Volume Set , 2018 .

[39]  Stephanie T. Lanza,et al.  A new SAS procedure for latent transition analysis: transitions in dating and sexual risk behavior. , 2008, Developmental psychology.

[40]  André A. Rupp,et al.  A practical illustration of multidimensional diagnostic skills profiling: Comparing results from confirmatory factor analysis and diagnostic classification models , 2009 .

[41]  Matthew J Madison,et al.  The Effects of Q-Matrix Design on Classification Accuracy in the Log-Linear Cognitive Diagnosis Model , 2015, Educational and psychological measurement.

[42]  D. W. Zimmerman,et al.  Are Simple Gain Scores Obsolete? , 1996 .

[43]  Michael D. Toland,et al.  Impact of Enhanced Anchored Instruction in Inclusive Math Classrooms , 2015 .

[44]  Ronald C. Serlin,et al.  Anchoring Adolescents' Understanding of Math Concepts in Rich Problem-Solving Environments , 2001 .

[45]  J. Templin,et al.  Unique Characteristics of Diagnostic Classification Models: A Comprehensive Review of the Current State-of-the-Art , 2008 .

[46]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[47]  C. Tienken.  Common Core State Standards: I Wonder? , 2010 .

[48]  Yanbo Xu,et al.  Using Logistic Regression to Trace Multiple Sub-skills in a Dynamic Bayes Net , 2011, EDM.

[49]  Sarah M. Hartz,et al.  A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality. , 2002 .

[50]  Andrew Izsák,et al.  Diagnosing Teachers’ Understandings of Rational Numbers: Building a Multidimensional Test Within the Diagnostic Classification Framework , 2014 .

[51]  H. Lao.  Estimation of Diagnostic Classification Models without Constraints: Issues with Class Label Switching , 2016 .

[52]  J. M. Foy,et al.  Guessing in Multiple‐choice Tests , 1967, British journal of medical education.

[53]  J. D. L. Torre,et al.  The Generalized DINA Model Framework. , 2011 .

[54]  Karen Bandeen-Roche,et al.  Residual Diagnostics for Growth Mixture Models , 2005 .

[55]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[56]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[57]  Lesa Hoffman,et al.  Obtaining Diagnostic Classification Model Estimates Using Mplus , 2013 .

[58]  Laine Bradshaw,et al.  Hierarchical Diagnostic Classification Models: A Family of Models for Estimating and Testing Attribute Hierarchies , 2014, Psychometrika.

[59]  Mark Wilson,et al.  On the Relationship Between Differential Item Functioning and Item Difficulty , 2012 .

[60]  John T. Willse,et al.  Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables , 2009 .

[61]  Laine Bradshaw,et al.  An Illustration of Diagnostic Classification Modeling in Student Learning Outcomes Assessment , 2014 .

[62]  André A. Rupp,et al.  The Impact of Model Misspecification on Parameter Estimation and Item‐Fit Assessment in Log‐Linear Diagnostic Classification Models , 2012 .

[63]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[64]  Norman E. Wallen,et al.  How to Design and Evaluate Research in Education , 1990 .

[65]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[66]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[67]  A. Cohen,et al.  A Latent Transition Analysis Model for Assessing Change in Cognitive Skills , 2016, Educational and psychological measurement.

[68]  John D. Bransford,et al.  The Jasper Project: Lessons in Curriculum, Instruction, Assessment, and Professional Development , 1997 .

[69]  Sun-Joo Cho,et al.  Detecting Intervention Effects Using a Multilevel Latent Transition Analysis with a Mixture IRT Model , 2013, Psychometrika.

[70]  Susan E. Embretson,et al.  A multidimensional latent trait model for measuring learning and change , 1991 .

[71]  Z. Šidák.  Rectangular Confidence Regions for the Means of Multivariate Normal Distributions , 1967 .

[72]  Neil Henry.  Latent structure analysis , 1969 .

[73]  Jeffrey A Douglas,et al.  Test Construction for Cognitive Diagnosis , 2005 .

[74]  O. J. Dunn.  Multiple Comparisons among Means , 1961 .

[75]  L. T. DeCarlo.  On the Analysis of Fraction Subtraction Data: The DINA Model, Classification, Latent Class Sizes, and the Q-Matrix , 2011 .

[76]  Megan E. Patrick,et al.  Latent Transition Analysis: Benefits of a Latent Variable Approach to Modeling Transitions in Substance Use , 2010, Journal of drug issues.