Automated knowledge acquisition for strategic knowledge

Strategic knowledge is used by an agent to decide what action to perform next, where actions have consequences external to the agent. This article presents a computer-mediated method for acquiring strategic knowledge. The general knowledge acquisition problem and the special difficulties of acquiring strategic knowledge are analyzed in terms of representation mismatch: the difference between the form in which knowledge is available from the world and the form required for knowledge systems. ASK is an interactive knowledge acquisition tool that elicits strategic knowledge from people in the form of justifications for action choices and generates strategy rules that operationalize and generalize the expert's advice. The basic approach is demonstrated with a human-computer dialog in which ASK acquires strategic knowledge for medical diagnosis and treatment. The rationale for and consequences of specific design decisions in ASK are analyzed, and the scope of applicability and limitations of the approach are assessed. The paper concludes by discussing the contribution of knowledge representation to automated knowledge acquisition.

[1]  Larry Eshelman,et al.  MOLE: A Knowledge-Acquisition Tool for Cover-and-Differentiate Systems , 1988 .

[2]  Sandra Marcus,et al.  Automating Knowledge Acquisition for Expert Systems , 1988 .

[3]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[4]  J. Cassinelli,et al.  A superluminous object in the Large Cloud of Magellan. , 1984 .

[5]  Alan Garvey,et al.  A Layered Environment for Reasoning about Action , 1986 .

[6]  R. Mooney,et al.  Explanation-Based Learning: An Alternative View , 1986, Machine Learning.

[7]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[8]  John McDermott,et al.  Preliminary steps toward a taxonomy of problem-solving methods , 1993 .

[9]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[10]  William J. Clancey,et al.  The Advantages of Abstract Control Knowledge in Expert System Design , 1983, AAAI.

[11]  Lee D. Erman,et al.  Seperating and integrating control in a rule-based tool , 1984 .

[12]  Jon Sticklen,et al.  Control Issues in Classificatory Diagnosis , 1985, IJCAI.

[13]  Yumi Iwasaki,et al.  The concept and implementation of skeletal plans , 1985, Journal of Automated Reasoning.

[14]  D. Paul Benjamin,et al.  Learning Strategies by Reasoning about Rules , 1987, IJCAI.

[15]  Paul R. Cohen,et al.  Design for Acquisition: Principles of Knowledge-System Design to Facilitate Knowledge Acquisition , 1987, Int. J. Man Mach. Stud..

[16]  B. Chandrasekaran,et al.  Generic Tasks in Knowledge-Based Reasoning: High-Level Building Blocks for Expert System Design , 1986, IEEE Expert.

[17]  Katharina Morik,et al.  Sloppy Modeling , 1987, Knowledge Representation and Organization in Machine Learning.

[18]  Lawrence M. Fagan,et al.  Graphical specification of procedural knowledge for an expert system , 1987 .

[19]  Douglas B. Lenat,et al.  Why AM and EURISKO Appear to Work , 1984, Artif. Intell..

[20]  William A. Gale.  Knowledge-Based Knowledge Acquisition for a Statistical Consulting System , 1987, Int. J. Man Mach. Stud..

[21]  Thomas G. Dietterich,et al.  Learning to Predict Sequences , 1985 .

[22]  Georg Klinker.  KNACK: Sample-Driven Knowledge Acquisition for Reporting Systems , 1988 .

[23]  Thomas R. Gruber,et al.  The Acquisition of Strategic Knowledge , 1989 .

[24]  Thomas G. Dietterich,et al.  Varieties of Operationality , 2022 .

[25]  Philip E. Agre,et al.  ABSTRACT REASONING AS EMERGENT FROM CONCRETE ACTIVITY , 1987 .

[26]  Jeffrey M. Bradshaw,et al.  Expertise Transfer and Complex Problems: Using AQUINAS as a Knowledge-Acquisition Workbench for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[27]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[28]  William R. Swartout,et al.  XPLAIN: A System for Creating and Explaining Expert Consulting Programs , 1983, Artif. Intell..

[29]  Terry Winograd,et al.  Understanding computers and cognition , 1986 .

[30]  William J. Clancey.  Viewing knowledge bases as qualitative models , 1989, IEEE Expert.

[31]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[32]  Paul R. Cohen,et al.  MU: A Development Environment for Prospective Reasoning Systems , 1987, AAAI.

[33]  Edward H. Shortliffe,et al.  ONCOCIN: An Expert System for Oncology Protocol Management , 1981, IJCAI.

[34]  R. Jeffrey Davis,et al.  Applications of meta level knowledge to the construction, maintainance and use of large knowledge b , 1976 .

[35]  Jeffrey M. Bradshaw,et al.  AQUINAS: a knowledge-acquisition workbench , 1989 .

[36]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[37]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[38]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[39]  Tom M. Mitchell,et al.  LEAP: A Learning Apprentice for VLSI Design , 1985, IJCAI.

[40]  Leslie Pack Kaelbling,et al.  An Architecture for Intelligent Reactive Systems , 1987 .

[41]  Tom M. Mitchell,et al.  Learning by experimentation: acquiring and refining problem-solving heuristics , 1993 .

[42]  Paul R. Cohen,et al.  Management of uncertainty in medicine , 1986, Int. J. Approx. Reason..

[43]  Edward H. Shortliffe,et al.  Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project (The Addison-Wesley series in artificial intelligence) , 1984 .

[44]  S G Pauker,et al.  Clinical decision analysis by personal computer. , 1981, Archives of internal medicine.

[45]  Peter Politakis,et al.  ESSA: An Approach to Acquiring Decision Rules for Diagnostic Expert Systems , 1985, CAIA.

[46]  Donald A. Waterman,et al.  Generalization Learning Techniques for Automating the Learning of Heuristics , 1970, Artif. Intell..

[47]  Kevin D Ashley.  Modelling Legal Argument: Reasoning with Cases and Hypotheticals, a Thesis Proposal. , 1986 .

[48]  Lawrence M. Fagan,et al.  Use of a Domain Model to Drive an Interactive Knowledge-Editing Tool , 1987, Int. J. Man Mach. Stud..

[49]  Richard M. Keller,et al.  Defining Operationality for Explanation-Based Learning , 1987, Artificial Intelligence.

[50]  Johanna D. Moore,et al.  Enhanced Maintenance and Explanation of Expert Systems Through Explicit Models of Their Development , 1984, IEEE Transactions on Software Engineering.

[51]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[52]  G. Gorry,et al.  Clinical problem solving: a behavioral analysis. , 1978, Annals of internal medicine.

[53]  David Chapman,et al.  Pengi: An Implementation of a Theory of Activity , 1987, AAAI.

[54]  Earl D. Sacerdoti,et al.  Planning in a Hierarchy of Abstraction Spaces , 1974, IJCAI.

[55]  Sandra Marcus,et al.  Taking Backtracking with a Grain of SALT , 1987, Int. J. Man Mach. Stud..

[56]  Barbara Hayes-Roth,et al.  Learning control heuristics in BB1 , 1985 .

[57]  William J. Clancey,et al.  Representing Control Knowledge as Abstract Task and Metarules. ONR Technical Report #15. , 1985 .

[58]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[59]  Kristian J. Hammond,et al.  Case-Based Planning: Viewing Planning as a Memory Task , 1989 .

[60]  Ray Bareiss,et al.  Exemplar-Based Knowledge Acquisition: A Unified Approach to Concept Representation, Classification, and Learning , 1990 .

[61]  Brian R. Gaines,et al.  KITTEN: Knowledge Initiation and Transfer Tools for Experts and Novices , 1987, Int. J. Man Mach. Stud..

[62]  Avron Barr,et al.  The Handbook of Artificial Intelligence , 1982 .

[63]  B. Chandrasekaran,et al.  Towards a Taxonomy of Problem Solving Types , 1983, AI Mag..

[64]  William J. Clancey,et al.  Heuristic Classification , 1986, Artif. Intell..

[65]  David J. Mostow,et al.  Machine Transformation of Advice Into a Heuristic Search Procedure , 1983 .

[66]  John H. Boose,et al.  Expertise transfer for expert system design , 1986 .

[67]  William Clancey.  Details of the Revised Therapy Algorithm , 1984 .

[68]  Douglas B. Lenat,et al.  Knowledge-based systems in artificial intelligence , 1981 .

[69]  John E. Laird,et al.  Learning General Search Control from Outside Guidance , 1987, IJCAI.

[70]  Mark A. Musen.  Automated generation of model-based knowledge acquisition tools , 1989 .

[71]  B. Chandrasekaran,et al.  Generic Tasks for Knowledge-Based Reasoning: The "Right" Level of Abstraction for Knowledge Acquisition , 1987, Int. J. Man Mach. Stud..

[72]  Donald A. Norman,et al.  User Centered System Design , 1986 .

[73]  Brian R. Gaines,et al.  New Directions in the Analysis and Interactive Elicitation of Personal Construct Systems , 1980, Int. J. Man Mach. Stud..

[74]  Lawrence M. Fagan,et al.  Episodic skeletal-plan refinement based on temporal data , 1989, CACM.

[75]  Tom Michael Mitchell,et al.  Explanation-based generalization: A unifying view , 1986 .

[76]  Paul E. Utgoff,et al.  Machine Learning of Inductive Bias , 1986 .

[77]  William J. Clancey,et al.  The Epistemology of a Rule-Based Expert System - A Framework for Explanation , 1981, Artif. Intell..

[78]  Thomas G. Dietterich,et al.  Learning and Inductive Inference , 1982 .

[79]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[80]  B. Chandrasekaran.  Towards a Functional Architecture for Intelligence Based on Generic Information Processing Tasks , 1987, IJCAI.

[81]  Thomas G. Dietterich,et al.  A Comparative Review of Selected Methods for Learning from Examples , 1983 .

[82]  James S. Bennett.  ROGET: A knowledge-based system for acquiring the conceptual structure of a diagnostic expert system , 2004, Journal of Automated Reasoning.

[83]  Jaime G. Carbonell,et al.  Strategies for Learning Search Control Rules: An Explanation-based Approach , 1987, IJCAI.

[84]  Ross D. Shachter,et al.  Thinking Backward for Knowledge Acquisition , 1987, AI Mag..

[85]  Barbara Hayes-Roth,et al.  A Blackboard Architecture for Control , 1985, Artif. Intell..

[86]  Gary S. Kahn,et al.  The Mud System , 1986, IEEE Expert.

[87]  Sandra Marcus,et al.  SALT: A Knowledge-Acquisition Tool for Propose-and-Revise Systems , 1988 .