The DIAG experiments: Natural Language Generation for Intelligent Tutoring Systems

We added a sentence planning component to an existing ITS that teaches students how to troubleshoot mechanical systems. We evaluated the original version of the system and the enhanced one via a user study in which we collected performance, learning and usability metrics. We show that on the whole the enhanced system is better than the original one. We discuss how to use the binomial cumulative distribution to assess cumulative effects.

[1]  Douglas M. Towne.  Approximate Reasoning Techniques for Intelligent Diagnostic Instruction , 1997 .

[2]  Johanna D. Moore,et al.  Generating descriptions of complex activities , 1997 .

[3]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[4]  李幼升,et al.  Ph , 1989 .

[5]  Arthur C. Graesser,et al.  Intelligent Tutoring Systems with Conversational Dialogue , 2001, AI Mag..

[6]  Xiaorong Huang,et al.  Paraphrasing and Aggregating Argumentative Texts Using Text Structure , 1996, INLG.

[7]  Chris Mellish,et al.  An Empirical Study on the Generation of Anaphora in Chinese , 1997, Comput. Linguistics.

[8]  Marilyn A. Walker,et al.  PARADISE: A Framework for Evaluating Spoken Dialogue Agents , 1997, ACL.

[9]  James C. Lester,et al.  Developing and Empirically Evaluating Robust Explanation Generators: The KNIGHT Experiments , 1997, Comput. Linguistics.

[10]  James Shaw,et al.  Segregatory Coordination and Ellipsis in Text Generation , 1998, ACL.

[11]  Johanna D. Moore,et al.  An Empirical Study of the Influence of Argument Conciseness on Argument Effectiveness , 2000, ACL.

[12]  Barbara Di Eugenio,et al.  Generating Natural Language Aggregations Using a Propositional Representation of Sets , 2002, FLAIRS Conference.

[13]  José Coch.  Evaluating and comparing three text-production techniques , 1996, COLING.

[14]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[15]  Ehud Reiter,et al.  Using a Randomised Controlled Clinical Trial to Evaluate an NLG System , 2001, ACL.

[16]  Chris Mellish,et al.  Towards Evaluation in Natural Language Generation , 1998, LREC.

[17]  Barbara Di Eugenio,et al.  The binomial cumulative distribution function, or, is my system better than yours? , 2002, LREC.

[18]  Sandra Carberry,et al.  Integrating Text Plans for Conciseness and Coherence , 1998, COLING-ACL.

[19]  W. Rapaport,et al.  The SNePS family , 1992 .

[20]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[21]  Carolyn Penstein Rosé,et al.  Fading and Deepening: The Next Steps for Andes and other Model-Tracing Tutors , 2000, Intelligent Tutoring Systems.

[22]  Michael White,et al.  EXEMPLARS: A Practical, Extensible Framework For Dynamic Text Generation , 1998, INLG.