Some useful tactics to modify, map and mine data from intelligent tutors

Mining data logged by intelligent tutoring systems has the potential to discover information of value to students, teachers, authors, developers, researchers, and the tutors themselves – information that could make education dramatically more efficient, effective, and responsive to individual needs. We factor this discovery process into tactics to modify tutors, map heterogeneous event streams into tabular data sets, and mine them. This model and the tactics identified mark out a roadmap for the emerging area of tutorial data mining, and may provide a useful vocabulary and framework for characterizing past, current, and future work in this area. We illustrate this framework using experiments that tested interventions by an automated reading tutor to help children decode words and comprehend stories.

[1]  Amy Soller,et al.  Understanding knowledge-sharing breakdowns: a meeting of the quantitative and qualitative minds , 2004, J. Comput. Assist. Learn..

[2]  Lisa A. Gawlick-Grendell,et al.  An experiential system for learning probability: Stat Lady description and evaluation , 1996 .

[3]  Jack Mostow,et al.  The Sounds of Silence: Towards Automated Evaluation of Student Learning in a Reading Tutor that Listens , 1997, AAAI/IAAI.

[4]  Jack Mostow,et al.  A La Recherche du Temps Perdu, or As Time Goes By: Where Does the Time Go in a Reading Tutor That Listens? , 2002, Intelligent Tutoring Systems.

[5]  Mark Weiser,et al.  Program Slicing , 1981, IEEE Transactions on Software Engineering.

[6]  Albert T. Corbett,et al.  Modeling Student Knowledge: Cognitive Tutors in High School and College , 2000, User Modeling and User-Adapted Interaction.

[7]  Amy Soller,et al.  Computational Modeling and Analysis of Knowledge Sharing in Collaborative Distance Learning , 2004, User Modeling and User-Adapted Interaction.

[8]  Joseph E. Beck,et al.  ADVISOR: A Machine Learning Architecture for Intelligent Tutor Construction , 2000, AAAI/IAAI.

[9]  Julita Vassileva,et al.  A Multi-agent Approach to the Design of Peer-help Environments , 1999 .

[10]  Jack Mostow,et al.  A Generic Tool to Browse Tutor-Student Interactions: Time Will Tell! , 2005, AIED.

[11]  Jack Mostow,et al.  Can Automated Questions Scaffold Children's Reading Comprehension? , 2004, Intelligent Tutoring Systems.

[12]  Jack Mostow,et al.  When do Students Interrupt Help? Effects of Time, Help Type, and Individual Differences , 2005, AIED.

[13]  Jack Mostow,et al.  Estimating the Effectiveness of Conversational Behaviors in a Reading Tutor that Listens , 2002 .

[14]  Jack Mostow,et al.  Improving the Help Selection Policy in a Reading Tutor that Listens , 2004 .

[15]  B. Rosenshine,et al.  Teaching Students to Generate Questions: A Review of the Intervention Studies , 1996 .

[16]  David Allbritton,et al.  Tutoring Bilingual Students with an Automated Reading Tutor that Listens , 2007 .

[17]  Joseph E. Beck,et al.  Macroadapting Animalwatch to Gender and Cognitive Differnces with Respect to Hint Interactivity and Symbolism , 2000, Intelligent Tutoring Systems.

[18]  Vincent Aleven,et al.  Pilot-Testing a Tutorial Dialogue System That Supports Self-Explanation , 2002, Intelligent Tutoring Systems.

[19]  Amy Soller,et al.  Supporting Social Interaction in an Intelligent Collaborative Learning System , 2001 .

[20]  Kalina Yacef,et al.  Educational Data Mining: a Case Study , 2005, AIED.

[21]  Jack Mostow,et al.  Using Automated Questions to Assess Reading Comprehension, Vocabulary, and Effects of Tutorial Interventions , 2004 .

[22]  Marti A. Hearst.  The debate on automated essay grading , 2000 .

[23]  Jack Mostow,et al.  Evaluating tutors that listen: an overview of project LISTEN , 2001 .

[24]  Jack Mostow,et al.  Viewing and analyzing multimodal human-computer tutorial dialogue: a database approach , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[25]  Albert T. Corbett,et al.  Evaluation of an Automated Reading Tutor That Listens: Comparison to Human Tutoring and Classroom Instruction , 2003 .

[26]  Jack Mostow,et al.  Giving Help and Praise in a Reading Tutor with Imperfect Listening--Because Automated Speech Recognition Means Never Being Able to Say You're Certain , 2013, CALICO Journal.

[27]  Bradley A. Goodman,et al.  Towards Intelligent Agents for Collaborative Learning: Recognizing the Roles of Dialogue Participants , 2003, User Modeling.

[28]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[29]  Jack Mostow,et al.  Automatically Assessing Oral Reading Fluency in a Computer Tutor that Listens , 2004 .

[30]  S. Menard.  Applied Logistic Regression Analysis , 1996 .

[31]  Gregory Aist.  Towards automatic glossarization: automatically constructing and administering vocabulary assistance factoids and multiple-choice assessment , 2001 .