Use of Models in the Interpretation of Verbal Data

The experience of building expert systems for a decade has revealed a number of problems and bottlenecks at each stage of the life cycle. Although the evidence is not abundant, because the number of fully operational expert systems is small with respect to the number of systems that have been developed, it appears that ad hoc or post hoc solutions for problems in early stages can create new and even bigger problems at later stages (McDermott, 1983, 1984): Problems propagate. The fact that few systems ever reach operational maturity is probably indicative of the fact that the art of knowledge engineering is not well established yet. The major problems are listed in the reverse order of their life cycle stages, because problems at later stages are more easily identified.

[1]  J A Breuker,et al.  KADS—structured knowledge acquisition for expert systems , 1987 .

[2]  Janice Sue Aikins,et al.  Prototypes and production rules : a knowledge representation for computer consultations , 1980 .

[3]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[4]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[5]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[6]  J. Guilford,et al.  The nature of human intelligence. , 1968 .

[7]  Mark Stefik,et al.  Planning with Constraints (MOLGEN: Part 1) , 1981, Artif. Intell..

[8]  Kent M. Pitman.  CREF: An Editing Facility for Managing Structured Text , 1985 .

[9]  Douglas B. Lenat,et al.  Knowledge-based systems in artificial intelligence , 1981 .

[10]  Randall Davis,et al.  Meta-Rules: Reasoning about Control , 1980, Artif. Intell..

[11]  John P. McDermott,et al.  R1: The Formative Years , 1981, AI Mag..

[12]  Ronald J. Brachman,et al.  A Structural Paradigm for Representing Knowledge. , 1978 .

[13]  Perry L. Miller.  Medical plan-analysis by computer , 1984 .

[14]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[15]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[16]  Luc Steels,et al.  Design Requirements for Knowledge Representation Systems , 1984, GWAI.

[17]  Ronald J. Brachman,et al.  ON THE EPISTEMOLOGICAL STATUS OF SEMANTIC NETWORKS , 1979 .

[18]  Donald Michie,et al.  Expert systems in the micro-electronic age , 1979 .

[19]  Bob J. Wielinga,et al.  Semi-Automated Analysis of Protocols From Novices and Experts Solving Physics Problems , 1983, IJCAI.

[20]  D. Bobrow.  Qualitative Reasoning about Physical Systems , 1985 .

[21]  William J. Clancey,et al.  Heuristic Classification , 1986, Artif. Intell..

[22]  Randall Davis,et al.  Interactive Transfer of Expertise: Acquisition of New Inference Rules , 1993, IJCAI.

[23]  Peter Friedland.  Acquisition of Procedural Knowledge from Domain Experts , 1981, IJCAI.

[24]  Mark D. Grover,et al.  A Pragmatic Knowledge Acquisition Methodology , 1983, IJCAI.

[25]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[26]  Randall Davis,et al.  Reasoning from First Principles in Electronic Troubleshooting , 1983, Int. J. Man Mach. Stud..

[27]  Victor Lesser,et al.  Organization of the Hearsay II speech understanding system , 1975 .

[28]  William J. Clancey,et al.  The Epistemology of a Rule-Based Expert System - A Framework for Explanation , 1981, Artif. Intell..

[29]  Joost Breuker,et al.  A Case Study in Structured Knowledge Acquisition , 1985, IJCAI.

[30]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[31]  William J. Clancey,et al.  NEOMYCIN: Reconfiguring a Rule-Based Expert System for Application to Teaching , 1981, IJCAI.

[32]  Julia Hirschberg,et al.  User Participation in the Reasoning Processes of Expert Systems , 1982, AAAI.

[33]  J. William,et al.  System aids in constructing consultation programs , 1981 .

[34]  Albert Pilot,et al.  Linking factual and procedural knowledge in solving science problems: A case study in a thermodynamics course , 1981 .

[35]  John P. McDermott.  Extracting Knowledge From Expert Systems , 1983, IJCAI.