A survey of methods for eliciting the knowledge of experts

A variety of methods have been used by expert system developers to elicit experts' knowledge and reasoning strategies. Additionally, a number of methods have been used by experimental psychologists to explore hypotheses about the nature of expertise. Methods can be placed into three broad categories: (1) Analyses of the tasks that experts perform, (2) Interview techniques, and (3) Special tasks. A comparison of knowledge elicitation methods yields recommendations about how expert system developers can deal with the "knowledge acquisition bottleneck."

[1]  G A Klein,et al.  The use of analogues in comparability analysis. , 1982, Applied ergonomics.

[2]  J. Fox,et al.  Knowledge acquisition for expert systems: experience in leukaemia diagnosis. , 1985, Methods of information in medicine.

[3]  B. Adelson.  When Novices Surpass Experts: The Difficulty of a Task May Increase With Expertise , 1984 .

[4]  Douglas B. Lenat.  Computer Software for Intelligent Systems. , 1984 .

[5]  A. Osborn.  Applied Imagination: Principles and Procedures of Creative Thinking , 1953 .

[6]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[7]  P. Slater.  Contrasting Correlates of Group Size , 1958 .

[8]  Benjamin Kuipers,et al.  Causal Reasoning in Medicine: Analysis of a Protocol , 1984 .

[9]  Deborah A. Boehm-Davis.  Special Issue Preface , 1988 .

[10]  Anna Hart,et al.  Knowledge acquisition for expert systems , 1988 .

[11]  William J. Clancey,et al.  Heuristic Classification , 1986, Artif. Intell..

[12]  Janet L. Kolodner,et al.  Towards an Understanding of the Role of Experience in the Evolution from Novice to Expert , 1983, Int. J. Man Mach. Stud..

[13]  Bob Wielinga,et al.  Use of Models in the Interpretation of Verbal Data , 1987 .

[14]  H. Simon,et al.  Perception in chess , 1973 .

[15]  Mark S. Sanders,et al.  Human Factors in Engineering and Design , 2016 .

[16]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[17]  Edwin J. Kay,et al.  Structural analysis of verbal data , 1986, CHI '87.

[18]  M. Chi,et al.  The Nature of Expertise , 1988 .

[19]  Casimir A. Kulikowski,et al.  A Practical Guide to Designing Expert Systems , 1984 .

[20]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[21]  Lawrence Birnbaum,et al.  The Organization of Expert Systems, A Tutorial , 1982, Artif. Intell..

[22]  Robert M. Hamm,et al.  The Relative Efficacy of Intuitive and Analytical Cognition: A Second Direct Comparison , 1984 .

[23]  Mark Chignell,et al.  Strategic Issues in Knowledge Engineering , 1988 .

[24]  J. Shanteau,et al.  Livestock judges: How much information can an expert use? , 1978 .

[25]  H. J. Einhorn.  Expert judgment: Some necessary conditions and an example. , 1974 .

[26]  J. Weitzenfeld.  Valid Reasoning by Analogy , 1984, Philosophy of Science.

[27]  Roger Nett,et al.  A methodology for social research , 1968 .

[28]  P. E. Johnson,et al.  Multimethod study of clinical judgment. , 1982, Organizational behavior and human performance.

[29]  Gary A. Klein,et al.  Applications of Analogical Reasoning , 1987 .

[30]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[31]  M. Azad,et al.  The role of human factors in expert systems design and acceptance , 1988 .

[32]  R R Hoffman,et al.  Methodological Preliminaries to the Development of an Expert System for Aerial Photo Interpretation. , 1984 .

[33]  James E. McDonald,et al.  The Application of Psychological Scaling Techniques to Knowledge Elicitation for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[34]  Nigel Shadbolt,et al.  A formal evaluation of knowledge elicitation techniques for expert systems: domain 1 , 1988 .

[35]  Walter G. Rolandi.  Knowledge engineering in practice , 1986 .

[36]  Robert K. Merton,et al.  The Focused Interview , 1956 .

[37]  Roger W. Schvaneveldt,et al.  Measuring the Structure of Expertise , 1985, Int. J. Man Mach. Stud..

[38]  Paul J. Feltovich,et al.  Representation of physics knowledge by experts and novices , 1980 .

[39]  Alison Kidd.  Human Factors Problems in the Design and Use of Expert Systems , 1985 .

[40]  H. Dreyfus.  Mind Over Machine , 1986 .

[41]  David S. Prerau,et al.  Knowledge acquisition in expert system development , 1987 .

[42]  Robert R. Hoffman,et al.  The Problem of Extracting the Knowledge of Experts from the Perspective of Experimental Psychology , 1987, AI Mag..

[43]  Jeffrey K. Liker,et al.  A day at the races: A study of IQ, expertise, and cognitive complexity. , 1986 .

[44]  Robin Jeffries,et al.  The Processes Involved in Designing Software. , 1980 .

[45]  G. Kelly.  The Psychology of Personal Constructs , 2020 .

[46]  R. Duda,et al.  Expert Systems Research. , 1983, Science.

[47]  Peter Hart,et al.  EXPERT SYSTEMS INTERVIEW , 1986 .

[48]  John Zeisel,et al.  Inquiry by Design: Tools for Environment-Behavior Research , 1981 .