A knowledge-intensive, integrated approach to problem solving and sustained learning

The problem addressed in this research is that of developing a method which integrates problem solving with learning from experience within an extensive model of different knowledge types. A unified framework is developed through an analysis of various types, aspects and roles of knowledge relevant for the kind of systems described above. The framework contains a knowledge representation platform and a generic model of problem solving. It further specifies a general reasoning approach that combines reasoning within a deep model with reasoning from heuristic rules and past cases. Finally, it provides a model of learning methods that retain concrete problem solving cases in a way that makes them useful for solving similar problems later. The framework emphasizes knowledge-intensive case-based reasoning and learning as the major paradigm. A comprehensive and thorough knowledge model is the basis for generation of goal related explanations that support the reasoning and learning processes. Reasoning from heuristic rules or from 'scratch' within the deeper model is regarded partly as supporting methods to the case-based reasoning, partly as methods to 'fall back on' if the case-based method fails. The purpose of the framework is to provide an environment for discussion of different approaches to knowledge intensive problem solving and learning. Four systems focus on different methodological issues of knowledge intensive problem solving and learning. Each system represents interesting solutions to subproblems, but none of them provide a scope that is broad enough to represent the type of method requested for developing and maintaining complex applications in a practical, real world setting. CREEK specifies a structural and functional architecture based on an expressive, frame-based knowledge representation language, and an explicit model of control knowledge. It has a reasoning strategy which first attempts case-based reasoning, then rule-based reasoning, and, finally, model-based reasoning. The system interacts with the user during both problem solving and learning, e.g. by asking for confirmation or rejection of unexplained facts. The knowledge representation system, including an explicit model of basic representational constructs and basic inference methods, has been implemented. Otherwise, CREEK is an architectural specification--a system design. Its main characteristics are demonstrated by an example from the domain of diagnosis and treatment of oil well drilling fluid (mud). (Abstract shortened with permission of author.)

[1]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[2]  Roger C. Schank,et al.  Dynamic memory - a theory of reminding and learning in computers and people , 1983 .

[3]  G. Tecuci Disciple : a theory, methodology and system for learning expert knowledge , 1988 .

[4]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[5]  Koton Phyllis,et al.  Using experience in learning and problem solving , 1988 .

[6]  Bob Wielinga,et al.  Models of Expertise in Knowledge Acquisition , 1989 .

[7]  Enric Plaza,et al.  A case-based apprentice that learns from fuzzy examples , 1991 .

[8]  J. Carbonell Learning by Analogy: Formulating and Generalizing Plans from Past Experience , 1983 .

[9]  Ronald J. Brachman,et al.  An overview of the KL-ONE Knowledge Representation System , 1985 .

[10]  B. Chandrasekaran,et al.  A Mechanism for Forming Composite Explanatory Hypotheses , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Edward H. Shortliffe,et al.  A model of inexact reasoning in medicine , 1990 .

[12]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.

[13]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[14]  李幼升,et al.  Ph , 1989 .

[15]  Rogers P. Hall,et al.  Computational Approaches to Analogical Reasoning: A Comparative Analysis , 1989, Artif. Intell..

[16]  Paul William Kuczora,et al.  Implementation of meronymic (part-whole) inheritance for semantic networks , 1989, Knowl. Based Syst..

[17]  Piero P. Bonissone,et al.  A Comparative Study of Different Approaches to Qualitative Physics Theories , 1985, CAIA.

[18]  E. R. Bareiss,et al.  PROTOS: An Experiment in Knowledge Acquisition for Heuristic ClassificationTasks , 1986 .

[19]  Luc Steels,et al.  Learning in second generation expert systems , 1986 .

[20]  斉藤 康己,et al.  Douglas B. Lenat and R. V. Guha : Building Large Knowledge-Based Systems, Representation and Inference in the Cyc Project, Addison-Wesley (1990). , 1990 .

[21]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[22]  Luc Steels,et al.  Components of Expertise , 1990, AI Mag..

[23]  M. Resnik,et al.  Aspects of Scientific Explanation. , 1966 .

[24]  C SchankRoger,et al.  Dynamic Memory: A Theory of Reminding and Learning in Computers and People , 1983 .

[25]  Tom M. Mitchell,et al.  LEAP: A Learning Apprentice for VLSI Design , 1985, IJCAI.

[26]  Jr. Robert Lee Simpson,et al.  A computer model of case-based reasoning in problem solving: an investigation in the domain of dispute mediation (analogy, machine learning, conceptual memory) , 1985 .

[27]  Yves Kodratoff,et al.  Is AI a Sub-Field of Computer Science - or is AI the Science of Explanations? , 1987, EWSL.

[28]  John R. Anderson The Architecture of Cognition , 1983 .

[29]  Douglas B. Lenat,et al.  CYC: Using Common Sense Knowledge to Overcome Brittleness and Knowledge Acquisition Bottlenecks , 1986, AI Mag..

[30]  Ramanathan V. Guha,et al.  CYC: A Midterm Report , 1990, AI Mag..

[31]  John R. Anderson Cognitive Psychology and Its Implications , 1980 .

[32]  Paul R. Cohen,et al.  Beyond ISA: Structures for Plausible Inference In Semantic Networks , 1988, AAAI.

[33]  Gheorghe Tecuci,et al.  Learning Based on Conceptual Distance , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Casimir A. Kulikowski,et al.  A Model-Based Method for Computer-Aided Medical Decision-Making , 1978, Artif. Intell..

[35]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[36]  Stephen W. Smoliar,et al.  On making expert systems more like experts , 1987 .

[37]  B. Chandrasekaran,et al.  Generic Tasks in Knowledge-Based Reasoning: High-Level Building Blocks for Expert System Design , 1986, IEEE Expert.

[38]  Phyllis Koton,et al.  Using experience in learning and problem solving , 1988 .

[39]  Luc Steels,et al.  Second-Generation Expert Systems , 1985, IEEE Expert.

[40]  Robert A. Adey,et al.  Knowledge Based Expert Systems for Engineering: Classification, Education and Control , 1987 .

[41]  John F. Sowa,et al.  Conceptual Structures: Information Processing in Mind and Machine , 1983 .

[42]  Benjamin Kuipers,et al.  Qualitative Simulation as Causal Explanation , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[43]  Randall Davis,et al.  Diagnosis Based on Description of Structure and Function , 1982, AAAI.

[44]  Kristian J. Hammond,et al.  CHEF: A Model of Case-Based Planning , 1986, AAAI.

[45]  Pamela K. Fink,et al.  Expert Systems and Diagnostic Expertise in the Mechanical and Electrical Domains , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[46]  Raj Reddy,et al.  Foundations and Grand Challenges of Artificial Intelligence: AAAI Presidential Address , 1988, AI Mag..

[47]  Paul Harmon,et al.  Expert systems: tools and applications , 1988 .

[48]  Donald Michie,et al.  Machine Intelligence 4 , 1970 .

[49]  Bernard A. Engel,et al.  Knowledge transformation , 1990, Appl. Artif. Intell..

[50]  Thomas R. Gruber,et al.  A method for acquiring strategic knowledge , 1989 .

[51]  Ronald J. Brachman,et al.  ON THE EPISTEMOLOGICAL STATUS OF SEMANTIC NETWORKS , 1979 .

[52]  Oren Etzioni,et al.  Explanation-Based Learning: A Problem Solving Perspective , 1989, Artif. Intell..

[53]  Sholom M. Weiss,et al.  SEEK2: A Generalized Approach to Automatic Knowledge Base Refinement , 1985, IJCAI.

[54]  B. Chandrasekaran,et al.  Explaining control strategies in problem solving , 1989, IEEE Expert.

[55]  Paul R. Cohen,et al.  Representativeness and Uncertainty in Classification Schemes , 1985, AI Mag..

[56]  D. Bobrow Qualitative Reasoning about Physical Systems , 1985 .

[57]  Bruce W. Porter,et al.  Controlling Search for the Consequences of New Information During Knowledge Integration , 1989, ML.

[58]  Paul J. Feltovich,et al.  LCS: The role and development of medivcal knowledge in diagnostic expertise , 1984 .

[59]  Walter Van de Velde,et al.  (Re)Presentation Issues in Second Generation Expert Systems , 1987, Knowledge Representation and Organization in Machine Learning.

[60]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[61]  Dedre Gentner,et al.  Structure-Mapping: A Theoretical Framework for Analogy , 1983, Cogn. Sci..

[62]  Daniel G. Bobrow,et al.  On Overview of KRL, a Knowledge Representation Language , 1976, Cogn. Sci..

[63]  Christopher K. Riesbeck,et al.  Experience, Memory and Reasoning , 1986 .

[64]  Kristian J. Hammond,et al.  Case-based planning: an integrated theory of planning, learning and memory , 1986 .

[65]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[66]  W. Bion,et al.  Learning from experience , 2007 .

[67]  B. Chandrasekaran Towards a Functional Architecture for Intelligence Based on Generic Information Processing Tasks , 1987, IJCAI.

[68]  G. DeJong,et al.  A introduction to explanation-based learning , 1988 .

[69]  Derek H. Sleeman,et al.  REFINER: A Case-Based Differential Diagnosis Aide for Knowledge Acquisition and Knowledge Refinement , 1988, EWSL.

[70]  W. Long,et al.  REASONING ABOUT THERAPY FROM A PHYSIOLOGICAL MODEL , 1986 .

[71]  Janet L. Kolodner,et al.  Extending Problem Solver Capabilities Through Case-Based Inference , 1987 .

[72]  R. Mayer Thinking, Problem Solving, Cognition , 1983 .

[73]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[74]  M. Shepherd Tools for adding knowledge to the CYC LSKB , 1988, Proceedings of the International Workshop on Artificial Intelligence for Industrial Applications.

[75]  Elpida T. Keravnou,et al.  Expert systems architectures , 1988 .

[76]  Walter Van de Velde Learning through Progressive Refinement , 1988, EWSL.

[77]  Luc Steels,et al.  The Deepening of Expert Systems , 1989, AI Commun..

[78]  Bruce W. Porter,et al.  Developing a Tool for Knowledge Integration: Initial Results , 1990, Int. J. Man Mach. Stud..

[79]  D. Bobrow,et al.  Representation and Understanding: Studies in Cognitive Science , 1975 .

[80]  Balakrishnan Chandrasekaran,et al.  Modularity of domain knowledge , 1987 .

[81]  William J. Clancey,et al.  The Epistemology of a Rule-Based Expert System - A Framework for Explanation , 1981, Artif. Intell..

[82]  Ramanathan V. Guha,et al.  Building Large Knowledge-Based Systems: Representation and Inference in the Cyc Project , 1990 .

[83]  John McDermott,et al.  Preliminary steps toward a taxonomy of problem-solving methods , 1993 .

[84]  Alan Bundy,et al.  An Analytical Comparison of Some Rule-Learning Programs , 1985, Artif. Intell..

[85]  Adele E. Howe,et al.  How evaluation guides AI research , 1988 .

[86]  William J. Clancey Viewing knowledge bases as qualitative models , 1989, IEEE Expert.

[87]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[88]  Boi Faltings,et al.  Qualitative Kinematics: A Framework , 1987, IJCAI.

[89]  Sharon C. Salveter Review of Conceptual structures: information processing in mind and machine by John F. Sowa. Addison-Wesley 1984. , 1986 .

[90]  Drew McDermott,et al.  Introduction to artificial intelligence , 1986, Addison-Wesley series in computer science.

[91]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[92]  Agnar Aamodt,et al.  Knowledge-Intensive Case-Based Reasoning and Sustained Learning , 1990, ECAI.

[93]  Bruce Porter,et al.  Protos: a unified approach to concept representation, classification, and learning , 1988 .

[94]  Brian R. Gaines,et al.  EKAW 89 : Third European Workshop on Knowledge Acquisition for Knowledge-Based Systems, Paris, July 89 , 1989 .

[95]  Hubert L. Dreyfus,et al.  Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer , 1987, IEEE Expert.

[96]  Russell Greiner,et al.  A Representation Language Language , 1980, AAAI.

[97]  Sandra Marcus,et al.  Automating Knowledge Acquisition for Expert Systems , 1988 .

[98]  David Littmann Constructing expert systems as building mental models or toward a cognitive ontology for expert systems , 1989 .

[99]  Ray Bareiss,et al.  Concept Learning and Heuristic Classification in WeakTtheory Domains , 1990, Artif. Intell..

[100]  Smadar T. Kedar-Cabelli,et al.  Analogy — From a Unified Perspective , 1988 .

[101]  William J. Clancey,et al.  Heuristic Classification , 1986, Artif. Intell..

[102]  Roger C. Schank,et al.  Creativity and Learning in a Case-Based Explainer , 1989, Artif. Intell..

[103]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[104]  C. K. Ogden,et al.  The Meaning of Meaning , 1923 .

[105]  Phyllis Koton,et al.  Reasoning about Evidence in Causal Explanations , 1988, AAAI.

[106]  William J. Clancey Knowledge acquisition for classification expert systems , 1984, ACM '84.

[107]  Peter G. Politakis,et al.  Empirical analysis for expert systems , 1985 .

[108]  Michael Grimes,et al.  KNACK - Report-Driven Knowledge Acquisition , 1987, Int. J. Man Mach. Stud..

[109]  Douglas B. Lenat,et al.  On the thresholds of knowledge , 1987, Proceedings of the International Workshop on Artificial Intelligence for Industrial Applications.

[110]  E. R. Bareiss,et al.  Protos: An Exemplar-Based Learning Apprentice , 1988, Int. J. Man Mach. Stud..

[111]  Jon Doyle A truth maintenance system , 1981 .

[112]  Y. Kodratoff,et al.  WHAT IS AN EXPLANATION IN DISCIPLE , 1987 .

[113]  Richard J. Doyle,et al.  Constructing and Refining Causal Explanations from an Inconsistent Domain Theory , 1986, AAAI.

[114]  Ingeborg Sølvberg,et al.  Learning in a Knowledge Acquisition Toolkit , 1989, SCAI.

[115]  Randall Davis,et al.  Negotiation as a Metaphor for Distributed Problem Solving , 1988, Artif. Intell..

[116]  Michael R. Genesereth,et al.  Logical foundations of artificial intelligence , 1987 .

[117]  J. Woodroffe,et al.  A learning experience. , 1987, New Zealand hospital.

[118]  Enric Plaza,et al.  Case-Based Learning of Strategic Knowledge , 1991, EWSL.

[119]  Elpida T. Keravnou,et al.  Competent Expert Systems: A Case Study in Fault Diagnosis , 1986 .

[120]  G. Collins,et al.  Transcending inductive category formation in learning , 1986, Behavioral and Brain Sciences.

[121]  Bob J. Wielinga,et al.  Models of Expertise , 1986, ECAI.

[122]  William Mark,et al.  Explanation-Based Indexing of Cases , 1988, AAAI.

[123]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[124]  Robert C. Moore,et al.  Formal Theories of the Commonsense World , 1985 .

[125]  Daniel Offutt SIZZLE: A Knowledge-Acquisition Tool Specialized for the Sizing Task , 1988 .

[126]  Hector J. Levesque,et al.  Krypton: A Functional Approach to Knowledge Representation , 1983, Computer.

[127]  Robert C. Holte An Analytical Framework for Learning Systems , 1988 .

[128]  Sandra Marcus,et al.  Taking Backtracking with a Grain of SALT , 1987, Int. J. Man Mach. Stud..

[129]  William James Van Melle,et al.  A domain-independent system that aids in constructing knowledge-based consultation programs , 1980 .

[130]  Terry Winograd,et al.  FRAME REPRESENTATIONS AND THE DECLARATIVE/PROCEDURAL CONTROVERSY , 1975 .