Development and Deployment of a Large-Scale Dialog-based Intelligent Tutoring System

There are significant challenges involved in the design and implementation of a dialog-based tutoring system (DBT) ranging from domain engineering to natural language classification and eventually instantiating an adaptive, personalized dialog strategy. These issues are magnified when implementing such a system at scale and across domains. In this paper, we describe and reflect on the design, methods, decisions and assessments that led to the successful deployment of our AI driven DBT currently being used by several hundreds of college level students for practice and self-regulated study in diverse subjects like Sociology, Communications, and American Government.

[1]  Lorin Wilde,et al.  The Personality of AI Systems in Education: Experiences with the Watson Tutor, a one-on-one virtual tutoring system , 2019, Childhood Education.

[2]  Shazia Afzal,et al.  Impact of Tutor Errors on Student Engagement in a Dialog Based Intelligent Tutoring System , 2018, ITS.

[3]  Eneko Agirre,et al.  SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity , 2012, *SEMEVAL.

[4]  Arthur C. Graesser,et al.  Guru: Designing a Conversational Expert Intelligent Tutoring System , 2012 .

[5]  Jaime R. Carbonell,et al.  AI in CAI : An artificial intelligence approach to computer-assisted instruction , 1970 .

[6]  Peter Brusilovsky,et al.  ELM-ART: An Intelligent Tutoring System on World Wide Web , 1996, Intelligent Tutoring Systems.

[7]  Bikram Sengupta,et al.  Sentence Level or Token Level Features for Automatic Short Answer Grading?: Use Both , 2018, AIED.

[8]  Chris Brew,et al.  SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge , 2013, *SEMEVAL.

[9]  Shazia Afzal,et al.  Preliminary Evaluations of a Dialogue-Based Digital Tutor , 2018, AIED.

[10]  Arthur C. Graesser,et al.  Recent Advances in Conversational Intelligent Tutoring Systems , 2013, AI Mag..

[11]  Martha W. Evens,et al.  CIRCSIM-Tutor: An Intelligent Tutoring System Using Natural Language Dialogue , 1997, ANLP.

[12]  Joel A. Michael,et al.  The Use of Hints by Human and Computer Tutors: The Consequences of the Tutoring Protocol , 1996, ICLS.

[13]  Nirmal K. Mukhi,et al.  Using a serverless framework for implementing a cognitive tutor: experiences and issues , 2017, WOSC@Middleware.

[14]  V. Shute Focus on Formative Feedback. Research Report. ETS RR-07-11. , 2007 .

[15]  Arthur C. Graesser,et al.  AutoTutor: A simulation of a human tutor , 1999, Cognitive Systems Research.

[16]  Bikram Sengupta,et al.  Creating Scoring Rubric from Representative Student Answers for Improved Short Answer Grading , 2018, CIKM.

[17]  Arthur C. Graesser,et al.  AutoTutor: an intelligent tutoring system with mixed-initiative dialogue , 2005, IEEE Transactions on Education.