Modeling Students' Natural Language Explanations

Intelligent tutoring systems have achieved demonstrable success in supporting formal problem solving. More recently such systems have begun incorporating student explanations of problem solutions. Typically, these natural language explanations are entered with menus, but some ITSs accept open-ended typed inputs. Typed inputs require more work by both developers and students and evaluations of the added value for learning outcomes has been mixed. This paper examines whether typed input can yield more accurate student modeling than menu-based input. This paper examines the application of Knowledge Tracing student modeling to natural language inputs and examines the standard Knowledge Tracing definition of errors. The analyses indicate that typed explanations can yield more predictive models of student test performance than menu-based explanations and that focusing on semantic errors can further improve predictive accuracy.

[1]  Beverly Park Woolf,et al.  Inferring learning and attitudes from a Bayesian Network of log file data , 2005, AIED.

[2]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[3]  Kurt VanLehn,et al.  Interactive Conceptual Tutoring in Atlas-Andes , 2002 .

[4]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[5]  Claus Zinn,et al.  A 3-Tier Planning Architecture for Managing Tutorial Dialogue , 2002, Intelligent Tutoring Systems.

[6]  Albert T. Corbett,et al.  The Impact on Learning of Generating vs. Selecting Descriptions in Analyzing Algebra Example Solutions , 2006, ICLS.

[7]  Cristina Conati,et al.  Toward Computer-Based Support of Meta-Cognitive Skills: a Computational Framework to Coach Self-Explanation , 2000 .

[8]  S. Derry,et al.  Learning from Examples: Instructional Principles from the Worked Examples Research , 2000 .

[9]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Five Years of Evaluations , 2005, AIED.

[10]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[11]  Ramzan Khuwaja,et al.  Architecture of CIRCSIM-Tutor (v.3): a smart cardiovascular physiology tutor , 1994, Proceedings of IEEE Symposium on Computer-Based Medical Systems (CBMS).

[12]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[13]  Vincent Aleven,et al.  A Tutorial Dialog System to Support Self- Explanation: Evaluation and Open Questions , 2003 .

[14]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[15]  Arthur C. Graesser,et al.  Teaching Tactics and Dialog in AutoTutor , 2001 .