Using and Evaluating Differential Modeling in Intelligent Tutoring and Apprentice Learning Systems.

Abstract : A powerful approach to debugging and refining the knowledge structures of a problem solving agent is to differentially model the actions of the agent against a gold standard. This paper proposes a framework for exploring the inherent limitations of such an approach when a problem solver is differentially modeled against an expert system. A procedure is described for determining a performance upper bound for debugging via differential modeling, called the synthetic agent method. The synthetic agent method systematically explores the space of near miss training instances and expresses the limits of debugging in terms of the knowledge representation and control language constructs of the expert system. Keywords: Learning, Knowledge acquisition, Tutoring, Debugging, Differential modeling.

[1]  William J. Clancey,et al.  A Qualitative Modeling Shell for Process Diagnosis , 1986, IEEE Software.

[2]  Bruce G. Buchanan,et al.  Inductive knowledge acquisition for rule-based expert systems , 1985 .

[3]  Kurt VanLehn,et al.  Repair Theory: A Generative Theory of Bugs in Procedural Skills , 1980, Cogn. Sci..

[4]  William J. Clancey,et al.  The Epistemology of a Rule-Based Expert System - A Framework for Explanation , 1981, Artif. Intell..

[5]  Alan W. Biermann,et al.  The Inference of Regular LISP Programs from Examples , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Sholom M. Weiss,et al.  SEEK2: A Generalized Approach to Automatic Knowledge Base Refinement , 1985, IJCAI.

[7]  Michael R. Genesereth,et al.  Diagnosis Using Hierarchical Design Models , 1982, AAAI.

[8]  Allen Ginsberg.  A Metalinguistic Approach to the Construction of Knowledge Base Refinement Systems , 1986, AAAI.

[9]  Thomas Glen Dietterich.  Constraint propagation techniques for theory-driven data interpretation (artificial intelligence, machine learning) , 1985 .

[10]  A. C. Scott,et al.  Evaluating the performance of a computer-based consultant. , 1979, Computer programs in biomedicine.

[11]  John Seely Brown,et al.  An Investigation of Computer Coaching for Informal Learning Activities. , 1978 .

[12]  David C. Wilkins,et al.  On Debugging Rule Sets When Reasoning Under Uncertainty , 1986, AAAI.

[13]  Donald A. Waterman,et al.  Generalization Learning Techniques for Automating the Learning of Heuristics , 1970, Artif. Intell..

[14]  William J. Clancey,et al.  Representing Control Knowledge as Abstract Task and Metarules. ONR Technical Report #15. , 1985 .

[15]  Harry E. Pople,et al.  An Experimental Computer-Based Diagnostic Consultant for General Internal Medicine , 1982 .

[16]  Tom M. Mitchell,et al.  LEAP: A Learning Apprentice for VLSI Design , 1985, IJCAI.

[17]  Thomas G. Dietterich,et al.  The Role of the Critic in Learning Systems , 1984 .

[18]  David Heckerman,et al.  Probabilistic Interpretation for MYCIN's Certainty Factors , 1990, UAI.

[19]  William John Clancey,et al.  Transfer of rule-based expertise through a tutorial dialogue , 1979 .

[20]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..