New Potentials for Data-Driven Intelligent Tutoring System Development and Optimization

Increasing widespread use of educational technologies is producing vast amounts of data. Such data can be used to help advance our understanding of student learning and enable more intelligent, interactive, engaging, and effective education. In this article, we discuss the status and prospects of this new and powerful opportunity for data-driven development and optimization of educational technologies, focusing on intelligent tutoring systems We provide examples of use of a variety of techniques to develop or optimize the select, evaluate, suggest, and update functions of intelligent tutors, including probabilistic grammar learning, rule induction, Markov decision process, classification, and integrations of symbolic search and statistical inference.

[1]  E. Mandinach,et al.  The role of cognitive engagement in classroom learning and motivation , 1983 .

[2]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[3]  L. Corno.  The Metacognitive Control Components of Self-Regulated Learning. , 1986 .

[4]  Joseph E. Beck,et al.  ADVISOR: A Machine Learning Architecture for Intelligent Tutor Construction , 2000, AAAI/IAAI.

[5]  Antonija Mitrovic,et al.  An Intelligent SQL Tutor on the Web , 2003, Int. J. Artif. Intell. Educ..

[6]  Kurt VanLehn,et al.  Looking Ahead to Select Tutorial Actions: A Decision-Theoretic Approach , 2004, Int. J. Artif. Intell. Educ..

[7]  Ryan Shaun Joazeiro de Baker,et al.  Detecting Student Misuse of Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[8]  Arthur C. Graesser,et al.  AutoTutor: an intelligent tutoring system with mixed-initiative dialogue , 2005, IEEE Transactions on Education.

[9]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[12]  Ryan Shaun Joazeiro de Baker,et al.  Adapting to When Students Game an Intelligent Tutoring System , 2006, Intelligent Tutoring Systems.

[13]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[14]  Sebastián Ventura,et al.  Educational data mining: A survey from 1995 to 2005 , 2007, Expert Syst. Appl..

[15]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[16]  Joseph E. Beck,et al.  Identifiability: A Fundamental Problem of Student Modeling , 2007, User Modeling.

[17]  Ryan Shaun Joazeiro de Baker,et al.  Modeling and understanding students' off-task behavior in intelligent tutoring systems , 2007, CHI.

[18]  Arthur C. Graesser,et al.  Automatic detection of learner’s affect from conversational cues , 2008, User Modeling and User-Adapted Interaction.

[19]  Tiffany Barnes,et al.  Toward Automatic Hint Generation for Logic Proof Tutoring Using Historical Student Data , 2008, Intelligent Tutoring Systems.

[20]  Ryan Shaun Joazeiro de Baker,et al.  Labeling Student Behavior Faster and More Precisely with Text Replays , 2008, EDM.

[21]  K. Koedinger,et al.  Example-Tracing Tutors : A New Paradigm for Intelligent Tutoring Systems , 2008 .

[22]  Marsha C. Lovett,et al.  The Open Learning Initiative: Measuring the Effectiveness of the OLI Statistics Course in Accelerating Student Learning. , 2008 .

[23]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[24]  Davide Fossati,et al.  I learn from you, you learn from me: How to make iList learn from students , 2009, AIED.

[25]  Arthur C. Graesser,et al.  Responding to Learners' Cognitive-Affective States with Supportive and Shakeup Dialogues , 2009, HCI.

[26]  Cristina Conati,et al.  Empirically building and evaluating a probabilistic model of user affect , 2009, User Modeling and User-Adapted Interaction.

[27]  Vincent Aleven,et al.  A New Paradigm for Intelligent Tutoring Systems: Example-Tracing Tutors , 2009, Int. J. Artif. Intell. Educ..

[28]  Stuart J. Russell,et al.  RAPID: A Reachable Anytime Planner for Imprecisely-sensed Domains , 2010, UAI.

[29]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[30]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[31]  Emma Brunskill,et al.  Evaluating an Adaptive Multi-User Educational Tool for Low-Resource Environments , 2010 .

[32]  Ryan Shaun Joazeiro de Baker,et al.  Contextual Slip and Prediction of Student Performance after Use of an Intelligent Tutor , 2010, UMAP.

[33]  Jeremy Roschelle,et al.  Integration of Technology, Curriculum, and Professional Development for Advancing Middle School Mathematics , 2010 .

[34]  Luo Si,et al.  Automatic Detection of Off-Task Behaviors in Intelligent Tutoring Systems with Machine Learning Techniques , 2010, IEEE Transactions on Learning Technologies.

[35]  Ryan Shaun Joazeiro de Baker,et al.  Using Text Replay Tagging to Produce Detectors of Systematic Experimentation Behavior Patterns , 2010, EDM.

[36]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[37]  Kurt VanLehn,et al.  An Evaluation of Pedagogical Tutorial Tactics for a Natural Language Tutoring System: A Reinforcement Learning Approach , 2011, Int. J. Artif. Intell. Educ..

[38]  Thomas L. Griffiths,et al.  Faster Teaching by POMDP Planning , 2011, AIED.

[39]  Ryan Shaun Joazeiro de Baker,et al.  Detecting Carelessness through Contextual Estimation of Slip Probabilities among Students Using an Intelligent Tutor for Mathematics , 2011, AIED.

[40]  Kasia Muldner,et al.  The Impact of Animated Pedagogical Agents on Girls' and Boys' Emotions, Attitudes, Behaviors and Learning , 2011, 2011 IEEE 11th International Conference on Advanced Learning Technologies.

[41]  James C. Lester,et al.  Modeling Learner Affect with Theoretically Grounded Dynamic Bayesian Networks , 2011, ACII.

[42]  Tiffany Barnes,et al.  Enhancing the Automatic Generation of Hints with Expert Seeding , 2011, Int. J. Artif. Intell. Educ..

[43]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[44]  Diane J. Litman,et al.  Benefits and challenges of real-time uncertainty detection and adaptation in a spoken dialogue computer tutor , 2011, Speech Commun..

[45]  Vincent Aleven,et al.  Sensor-free automated detection of affect in a Cognitive Tutor for Algebra , 2012, EDM.

[46]  Kenneth R. Koedinger,et al.  Automated Student Model Improvement , 2012, EDM.

[47]  Sumit Gulwani,et al.  Automatically Generating Algebra Problems , 2012, AAAI.

[48]  Kenneth R. Koedinger,et al.  Efficient Complex Skill Acquisition Through Representation Learning , 2012 .

[49]  Emma Brunskill,et al.  The Impact on Individualizing Student Models on Necessary Practice Opportunities , 2012, EDM.

[50]  Michael Eagle,et al.  Program Representation for Automatic Hint Generation for a Data-Driven Novice Programming Tutor , 2012, ITS.

[51]  Matthew M. Chingos,et al.  Interactive Learning Online at Public Universities: Evidence from a Six-Campus Randomized Trial. , 2014 .