DIAGNOSING COGNITIVE ERRORS: STATISTICAL PATTERN CLASSIFICATION BASED ON ITEM RESPONSE THEORY

This paper introduces a probabilistic model that is capable of diagnosing and classifying cognitive errors in a general problem-solving domain. The model is different from the usual deterministic strategies common in the area of artificial intelligence because item response theory is utilized to handle the variability of response errors. As for illustrating the model, the dataset obtained from a 38-item fraction addition test is used, and the students’ responses are classified into 34 groups of misconceptions. These groups are predetermined by the result of an error analysis previously done, and validated with the error diagnostic program written by a typical formal logic approach.

[1]  K. Tatsuoka,et al.  Standardized Extended Caution Indices and Comparisons of their Rule Detection Rates. , 1982 .

[2]  Kikumi K. Tatsuoka,et al.  Rule Space, the Product Space of Two Score Components in Signed-Number Subtraction: An Approach to Dealing with Inconsistent Use of Erroneous Rules. , 1982 .

[3]  Kurt VanLehn,et al.  Felicity conditions for human skill acquisition: validating an ai-based theory , 1983 .

[4]  Herbert A. Simon,et al.  Problem Solving and Reasoning. , 1984 .

[5]  Kikumi K. Tatsuoka,et al.  A Probabilistic Model for Diagnosing Misconceptions By The Pattern Classification Approach , 1985 .

[6]  A FACTOR ANALYTIC STUDY OF SOME NON‐INTELLECTUAL INDICES OF ACADEMIC ACHIEVEMENT , 1966 .

[7]  Kikumi K. Tatsuoka,et al.  Spotting Incorrect Rules in Signed-Number Arithmetic by the Individual Consistency Index. , 1981 .

[8]  K. Tatsuoka,et al.  The Effect of a Scoring System Based on the Algorithm Underlying the Students' Response Patterns on the Dimensionality of Achievement Test Data of the Problem Solving Type. , 1983 .

[9]  Kikumi K. Tatsuoka,et al.  Bug Distribution and Pattern Classification. , 1985 .

[10]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[11]  Kikumi K. Tatsuoka,et al.  Caution indices based on item response theory , 1984 .

[12]  Kikumi K. Tatsuoka,et al.  Detection of Aberrant Response Patterns and their Effect on Dimensionality , 1982 .

[13]  K. Tatsuoka,et al.  ON THE DIMENSIONALITY OF ACHIEVEMENT TEST DATA , 1982 .

[14]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[15]  John Seely Brown,et al.  Diagnostic Models for Procedural Bugs in Basic Mathematical Skills , 1978, Cogn. Sci..

[16]  Kikumi K. Tatsuoka,et al.  Analysis of Errors in Fraction Addition and Subtraction Problems. Final Report. , 1984 .

[17]  Delwyn L. Harnisch,et al.  ANALYSIS OF ITEM RESPONSE PATTERNS. QUESTIONABLE TEST DATA AND DISSIMILAR CURRICULUM PRACTICES , 1981 .