Detecting Carelessness through Contextual Estimation of Slip Probabilities among Students Using an Intelligent Tutor for Mathematics

A student is said to have committed a careless error when a student's answer is wrong despite the fact that he or she knows the answer (Clements, 1982). In this paper, educational data mining techniques are used to analyze log files produced by a cognitive tutor for Scatterplots to derive a model and detector for carelessness. Bayesian Knowledge Tracing and its variant, the Contextual-Slip-and-Guess Estimation, are used to model and predict carelessness behavior in the Scatterplot Tutor. The study examines as well the robustness of this detector to a major difference in the tutor's interface, namely the presence or absence of an embodied conversational agent, as well as robustness to data from a different school setting (USA versus Philippines).

[1]  Ryan Shaun Joazeiro de Baker,et al.  Case studies in the use of ROC curve analysis for sensor-based estimates in human computer interaction , 2005, Graphics Interface.

[2]  Ryan Shaun Joazeiro de Baker,et al.  Contextual Slip and Prediction of Student Performance after Use of an Intelligent Tutor , 2010, UMAP.

[3]  Susanne P. Lajoie,et al.  Proceedings of the 9th international conference on Intelligent Tutoring Systems , 2008 .

[4]  M. Sobel,et al.  Sociological Methodology - 2001 , 2001 .

[5]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[6]  Ryan Shaun Joazeiro de Baker,et al.  An Analysis of the Differences in the Frequency of Students' Disengagement in Urban, Rural, and Suburban High Schools , 2010, EDM.

[7]  D. Levitin.  The foundations of cognitive psychology: Core readings , 2005, History & Philosophy of Psychology.

[8]  Ryan Shaun Joazeiro de Baker,et al.  Modeling and understanding students' off-task behavior in intelligent tutoring systems , 2007, CHI.

[9]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[10]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[11]  James C. Lester,et al.  Early Prediction of Student Frustration , 2007, ACII.

[12]  M. A. Clements.  Analyzing children's errors on written mathematical tasks , 1980 .

[13]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[14]  Ralph L. Rosnow,et al.  Essentials of Behavioral Research: Methods and Data Analysis , 1984 .

[15]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[16]  M. A. Clements.  Careless Errors Made by Sixth-Grade Children on Written Mathematical Tasks. , 1982 .

[17]  A. Raftery.  Bayesian Model Selection in Social Research , 1995 .

[18]  Vincent Aleven,et al.  Improving Contextual Models of Guessing and Slipping with a Trucated Training Set , 2008, EDM.

[19]  Ryan Shaun Joazeiro de Baker,et al.  Adapting to When Students Game an Intelligent Tutoring System , 2006, Intelligent Tutoring Systems.

[20]  Raymond J. Corsini,et al.  The concise Corsini encyclopedia of psychology and behavioral science , 2004 .

[21]  Martin Guha.  The Concise Corsini Encyclopedia of Psychology and Behavioral Science (3rd edition) , 2004 .