The Behavior of Tutoring Systems

Tutoring systems are described as having two loops. The outer loop executes once for each task, where a task usually consists of solving a complex, multi-step problem. The inner loop executes once for each step taken by the student in the solution of a task. The inner loop can give feedback and hints on each step. The inner loop can also assess the student's evolving competence and update a student model, which is used by the outer loop to select a next task that is appropriate for the student. For those who know little about tutoring systems, this description is meant as a demystifying introduction. For tutoring system experts, this description illustrates that although tutoring systems differ widely in their task domains, user interfaces, software structures, knowledge bases, etc., their behaviors are in fact quite similar.

[1]  Nicholas J. Pioch,et al.  Verbal Coaching During a Real-Time Task , 1998, Intelligent Tutoring Systems.

[2]  Joel D. Martin,et al.  Student assessment using Bayesian nets , 1995, Int. J. Hum. Comput. Stud..

[3]  Allen Munro,et al.  Integrating Pedagogical Agents into Virtual Environments , 1998, Presence.

[4]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[5]  Patrick Lardieri,et al.  The Advanced Embedded Training System (AETS): An Intelligent Embedded Tutoring System for Tactical Team Training , 1998 .

[6]  John Self Bypassing the intractable problem of student modelling , 1988 .

[7]  Brady Clark,et al.  Advantages of Spoken Language Interaction in Dialogue-Based Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[8]  Stellan Ohlsson,et al.  Learning from Performance Errors. , 1996 .

[9]  James O. Carey,et al.  The systematic design of instruction , 1978 .

[10]  Marios C. Angelides,et al.  A comprehensive method for the evaluation of complete intelligent tutoring systems , 1998, Decis. Support Syst..

[11]  Kurt VanLehn,et al.  Minimally Invasive Tutoring of Complex Physics Problem Solving , 2002, Intelligent Tutoring Systems.

[12]  Antonija Mitrovic,et al.  An Intelligent SQL Tutor on the Web , 2003, Int. J. Artif. Intell. Educ..

[13]  Allan Collins,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[14]  Kristen N. Moreno,et al.  AutoTutor Improves Deep Learning of Computer Literacy : Is it the Dialog or the Talking Head ? , 2004 .

[15]  B. Bloom The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[16]  Joel A. Shapiro Algebra Subsystem for an Intelligent Tutoring System , 2002 .

[17]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[18]  A. Renkl Worked-out examples: instructional explanations support learning by self- explanations , 2002 .

[19]  Valerie J. Shute,et al.  A Large-Scale Evaluation of an Intelligent Discovery World: Smithtown , 1990, Interact. Learn. Environ..

[20]  Claus Zinn,et al.  A 3-Tier Planning Architecture for Managing Tutorial Dialogue , 2002, Intelligent Tutoring Systems.

[21]  Michelene T. H. Chi,et al.  Self-Explanations: How Students Study and Use Examples in Learning To Solve Problems. Technical Report No. 9. , 1987 .

[22]  D. Middleton,et al.  An Experimental Evaluation of Four Face-to-Face Teaching Strategies , 1978 .

[23]  Joel A. Shapiro An Algebra Subsystem for Diagnosing Students' Input in a Physics Tutoring System , 2005, Int. J. Artif. Intell. Educ..

[24]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[25]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[26]  Steven Ritter,et al.  User Modeling and Problem-Space Representation in the Tutor Runtime Engine , 2003, User Modeling.

[27]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[28]  Vladan Devedzic,et al.  Software Patterns in ITS Architectures , 2005, Int. J. Artif. Intell. Educ..

[29]  Albert T. Corbett,et al.  Intelligent Tutoring Systems , 1985, Science.

[30]  Sandra Katz,et al.  Going Beyond the Problem Given: How Human Tutors Use Post-Solution Discussions to Support Transfer , 2003, Int. J. Artif. Intell. Educ..

[31]  Valerie J. Shute,et al.  Principles for Evaluating Intelligent Tutoring Systems. , 1993 .

[32]  Vincent Aleven,et al.  Limitations of Student Control: Do Students Know When They Need Help? , 2000, Intelligent Tutoring Systems.

[33]  Jim E. Greer,et al.  Evaluation Methodologies for Intelligent Tutoring Systems. , 1993 .

[34]  J. Schofield Computers and classroom culture , 1995 .

[35]  Arthur C. Graesser,et al.  AutoTutor: A simulation of a human tutor , 1999, Cognitive Systems Research.

[36]  D. Norman Categorization of action slips. , 1981 .

[37]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[38]  Gordon I. McCalla,et al.  Using Planning Techniques in Intelligent Tutoring Systems , 1986, Int. J. Man Mach. Stud..

[39]  Heather H. Mitchell,et al.  AutoTutor: A tutor with dialogue in natural language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[40]  John R. Anderson,et al.  The Transfer of Cognitive Skill , 1989 .

[41]  Antonija Mitrovic,et al.  Evaluation of a Constraint-Based Tutor for a Database Language , 1999 .

[42]  K. Korta,et al.  Plan Recognition in Natural Language Dialogue , 1994 .

[43]  Antonija Mitrovic,et al.  Automatic Problem Generation in Constraint-Based Tutors , 2002, Intelligent Tutoring Systems.

[44]  Kurt VanLehn,et al.  Looking Ahead to Select Tutorial Actions: A Decision-Theoretic Approach , 2004, Int. J. Artif. Intell. Educ..

[45]  KURT VANLEHN Bayesian student modeling, user interfaces and feedback : A sensitivity analysis , 2001 .

[46]  Jeff Rickel,et al.  Intelligent computer-aided instruction: a survey organized around system components , 1989, IEEE Trans. Syst. Man Cybern..

[47]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[48]  D. Wood,et al.  Help seeking, learning and contingent tutoring , 1999, Comput. Educ..

[49]  Valerie J. Shute,et al.  Intelligent Tutoring Systems: Past, Present, and Future. , 1994 .

[50]  Tom Murray,et al.  Authoring Intelligent Tutoring Systems: An analysis of the state of the art , 1999 .

[51]  Zhendong Niu Bayesian student modeling, user interfaces and feedback: A sensitivity analysis , 2001 .

[52]  G. Hanley e‐Learning and the Science of Instruction , 2004 .

[53]  Antonija Mitrovic,et al.  Evaluating Intelligent Tutoring Systems with Learning Curves , 2004 .

[54]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[55]  Kurt VanLehn,et al.  Effects of Dissuading Unnecessary Help Requests While Providing Proactive Help , 2005, AIED.

[56]  Anthony Jameson,et al.  Numerical uncertainty management in user and student modeling: An overview of systems and issues , 2005, User Modeling and User-Adapted Interaction.

[57]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[58]  Joel A. Michael,et al.  Hinting as a Tactic in One-on-One Tutoring , 1996 .

[59]  Elizabeth Owen Bratt,et al.  A Scalable , Reusable Spoken Conversational Tutor : SCoT 1 , 2003 .

[60]  Neil T. Heffernan,et al.  Why Are Algebra Word Problems Difficult? Using Tutorial Log Files and the Power Law of Learning to Select the Best Fitting Cognitive Model , 2004, Intelligent Tutoring Systems.

[61]  David C. Wilkins,et al.  Automated Instructor Assistant for Ship Damage Control , 1999, AAAI/IAAI.

[62]  Mia Stern,et al.  Applications of AI in education , 1996, CROS.