A Tutorial Dialog System to Support Self- Explanation: Evaluation and Open Questions

We conducted an experiment to test the hypothesis that self-explanation can be supported more effectively by means of natural language dialog than by means of menu selection of explanations. The study was carried out in a school in the Pittsburgh area and involved 78 students, 42 of whom satisfied all requirements. There was some evidence that students whose self-explanations were supported by dialog acquired better problem-solving skills than students who selected explanations from a menu. The evidence however was not sufficient to decisively confirm the hypothesis. Lessons learned include: it is more difficult for students to produce accurate free-form explanations than we expected and it may be better to delay strict requirements on explanation quality for students early in learning. It might be valuable to increase explanation strictness gradually. Also, knowledge- based natural language understanding capabilities push on hardware capabilities and have potentially negative consequences for software useability.

[1]  Susan Bell Trickett,et al.  Note-Taking for Self-Explanation and Problem Solving , 2001, Hum. Comput. Interact..

[2]  Ann L. Brown,et al.  Training in Self-Explanation and Self-Regulation Strategies: Investigating the Effects of Knowledge Acquisition Activities on Problem Solving , 1995 .

[3]  Vincent Aleven,et al.  Pilot-Testing a Tutorial Dialogue System That Supports Self-Explanation , 2002, Intelligent Tutoring Systems.

[4]  Silke Schworm,et al.  Learning by Solved Example Problems: Instructional Explanations Reduce Self-Explanation Activity , 2002 .

[5]  Regina M. F. Wong,et al.  The Effects of Self-Explanation Training on Students' Problem Solving in High-School Mathematics. , 2002 .

[6]  A. Renkl.  Learning mathematics from worked-out examples: Analyzing and fostering self-explanations , 1999 .

[7]  Cristina Conati,et al.  Toward Computer-Based Support of Meta-Cognitive Skills: a Computational Framework to Coach Self-Explanation , 2000 .

[8]  A. Renkl.  Worked-out examples: instructional explanations support learning by self- explanations , 2002 .

[9]  Robert Mac Gregor,et al.  THE EVOLVING TECHNOLOGY OF CLASSIFICATION-BASED KNOWLEDGE REPRESENTATION SYSTEMS , 1991 .

[10]  Vincent Aleven,et al.  Towards Tutorial Dialog to Support Self- Explanation: Adding Natural Language Understanding to a Cognitive Tutor * , 2001 .

[11]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[12]  Vincent Aleven,et al.  The Need for Tutorial Dialog to Support Self-Explanation , 2000 .

[13]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..