Diagnosing Natural Language Answers to Support Adaptive Tutoring

Understanding answers to open-ended explanation questions is important in intelligent tutoring systems. Existing systems use natural language techniques in essay analysis, but revert to scripted interaction with short-answer questions during remediation, making adapting dialogue to individual students difficult. We describe a corpus study that shows that there is a relationship between the types of faulty answers and the remediation strategies that tutors use; that human tutors respond differently to different kinds of correct answers; and that re-stating correct answers is associated with improved learning. We describe a design for a diagnoser based on this study that supports remediation in open-ended questions and provides an analysis of natural language answers that enables adaptive generation of tutorial feedback for both correct and faulty answers.

[1]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[2]  Gwyneth Doherty-Sneddon,et al.  The Reliability of a Dialogue Structure Coding Scheme , 1997, CL.

[3]  Vincent Aleven,et al.  combatting Shallow Learning in a Tutor for Geometry Problem Solving , 1998, Intelligent Tutoring Systems.

[4]  Arthur C. Graesser,et al.  AutoTutor: A simulation of a human tutor , 1999, Cognitive Systems Research.

[5]  Vincent Aleven,et al.  Towards Tutorial Dialog to Support Self- Explanation: Adding Natural Language Understanding to a Cognitive Tutor * , 2001 .

[6]  C. Rosé.  The Role of Why Questions in Effective Human Tutoring , 2003 .

[7]  Kaska Porayska-Pomsta,et al.  Influence of situational context on language production : modelling teachers' corrective responses , 2004 .

[8]  Pamela W. Jordan.  Using Student Explanations as Models for Adapting Tutorial Dialogue , 2004, FLAIRS Conference.

[9]  Kurt VanLehn,et al.  Taking Control of Redundancy in Scripted Tutorial Dialogue , 2005, AIED.

[10]  Reva Freedman,et al.  Annotation of Tutorial Dialogue Goals for Natural Language Generation , 2006 .

[11]  Diane J. Litman,et al.  Correlations between dialogue acts and learning in spoken tutoring dialogues , 2006, Natural Language Engineering.

[12]  Kurt VanLehn,et al.  A Natural Language Tutorial Dialogue System for Physics , 2006, FLAIRS Conference.

[13]  Johanna D. Moore,et al.  The Beetle and BeeDiff tutoring systems , 2007, SLaTE.