Integrating Case-Based Reasoning and Meta-Learning for a Self-Improving Intelligent Tutoring System

A framework integrating case-based reasoning (CBR) and meta-learning is proposed in this paper as the underlying methodology enabling self-improving intelligent tutoring systems (ITSs). Pedagogical strategies are stored in cases, each dictating, given a specific situation, which tutoring action to make next. Reinforcement learning is used to improve various aspects of the CBR module - cases are learned and retrieval and adaptation are improved, thus modifying the pedagogical strategies based on empirical feedback on each tutoring session. To minimize canceling out effects due to the multiple strategies used for meta-learning - for example, the learning result of one strategy undoes or reduces the impact of the learning result of another strategy, a principled design that is both cautious and prioritized is put in place. An ITS application, called Intelligent Learning Material Delivery Agent (ILMDA), has been implemented, powered by this framework, on introductory computer science topics, and deployed at the Computer Science and Engineering Department of the University of Nebraska. Studies show the feasibility of such a framework and impact analyses are reported on pedagogical strategies and outcomes.

[1]  Padraig Cunningham,et al.  Using Introspective Learning to Improve Retrieval in CBR: A Case Study in Air Traffic Control , 1997, ICCBR.

[2]  C. Thomas Wu An Introduction to Object-Oriented Programming With Java , 1998 .

[3]  Ingoo Han,et al.  A case-based reasoning with the feature weights derived by analytic hierarchy process for bankruptcy prediction , 2002, Expert Syst. Appl..

[4]  Isabel Fernández-Castro,et al.  Using Case-Based Reasoning in Instructional Planning. Towards a Hybrid Self-improving Instructional Planner , 2000 .

[5]  Farhi Marir,et al.  Case-based reasoning: A review , 1994, The Knowledge Engineering Review.

[6]  Armin Stahl,et al.  Learning Similarity Measures: A Formal View Based on a Generalized CBR Model , 2005, ICCBR.

[7]  B. Bloom Taxonomy of educational objectives , 1956 .

[8]  Tim O'Shea,et al.  A self-improving quadratic tutor , 1979 .

[9]  Joseph E. Beck,et al.  Growth and maturity of intelligent tutoring systems: a status report , 2001 .

[10]  Gheorghe Tecuci,et al.  Developing an Intelligent Educational Agent with Disciple , 1999 .

[11]  Paul Libbrecht,et al.  ActiveMath: A Generic and Adaptive Web-Based Learning Environment , 2001 .

[12]  Anna Perini,et al.  The Twofold Integration of CBR in Decision Support Systems , 1998 .

[13]  Lev Vygotsky Mind in society , 1978 .

[14]  Eric Gutstein Using Expert Tutor Knowledge to Design a Self-Improving Intelligent Tutoring System , 1992, Intelligent Tutoring Systems.

[15]  Beverly Park Woolf,et al.  Multiple Knowledge Sources in Intelligent Teaching Systems , 1987, IEEE Expert.

[16]  John Cook Bridging the Gap Between Empirical Data on Open-Ended Tutorial Interactions and Computational Models , 2007 .

[17]  Antonija Mitrovic,et al.  Optimising ITS Behaviour with Bayesian Networks and Decision Theory , 2001 .

[18]  David W. Aha,et al.  Weighting Features , 1995, ICCBR.

[19]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[20]  Leen-Kiat Soh,et al.  An Intelligent Agent that Learns How to Tutor Students: Design and Results , 2005, ICCE.

[21]  David Leake,et al.  Learning to improve case adaptation , 2001 .

[22]  Mykola Galushka,et al.  A regression based adaptation strategy for case-based reasoning , 2002, AAAI/IAAI.

[23]  Qiang Yang,et al.  Feature Weight Maintenance in Case Bases Using Introspective Learning , 2001, Journal of Intelligent Information Systems.

[24]  Derek Sleeman,et al.  An architecture for a self‐improving instructional planner for intelligent tutoring systems , 1987, Comput. Intell..

[25]  Lee Dee Miller,et al.  Case-based learning mechanisms to deliver learning materials , 2004, 2004 International Conference on Machine Learning and Applications, 2004. Proceedings..

[26]  Lee Dee Miller,et al.  Analyzing Student Motivation and Self-Efficacy in Using an Intelligent Tutoring System , 2005, ICCE.

[27]  Ashwin Ram,et al.  Introspective Multistrategy Learning: On the Construction of Learning Strategies , 1999, Artif. Intell..

[28]  Susan Craw,et al.  Self-optimising CBR retrieval , 2000, Proceedings 12th IEEE Internationals Conference on Tools with Artificial Intelligence. ICTAI 2000.

[29]  Pierre Dillenbourg Designing a self-improving tutor: PROTO-TEG , 1989 .

[30]  Maria Virvou,et al.  Adding an Instructor Modelling Component to the Architecture of ITS Authoring Tools , 2001 .

[31]  Tom Murray,et al.  Authoring Intelligent Tutoring Systems: An analysis of the state of the art , 1999 .

[32]  Claire Cardie,et al.  Integrating case-based learning and cognitive biases for machine learning of natural language , 1999, J. Exp. Theor. Artif. Intell..

[33]  Jim E. Greer,et al.  The IRIS Shell: "How to Build ITSs from Pedagogical and Design Requisites" , 1997 .