Structuring interviews with experts during knowledge elicitation

We have developed interviewing techniques for knowledge elicitation based on (1) relevant research and techniques from the social sciences, (2) the nature of expertise, (3) a desire to assist a knowledge engineer to avoid reductive bias, one of the pitfalls associated with the acquisition of highly complex concepts, and (4) the desirability of de‐coupling elicitation from implementation. the approach consists of four phases with guidelines for questions suited to each stage. First, the descriptive elicitation stage is intended to reveal the important entities and concepts in the domain as reflected in the terms and specialized language used by the expert. A second stage, structured expansion, is designed to probe the relationships between the domain concepts and the organization of the expert's knowledge using the terminology uncovered in the previous stage. the scripting phase relies on the declarative knowledge found through the two previous stages to discover procedural knowledge, and the final component, validation, is important throughout the process of knowledge elicitation to ensure that the knowledge being elicited is correct and adequate to enable a system in which it is implemented to solve the class of problems with which it is concerned. © 1993 John Wiley & Sons, Inc.

[1]  Benjamin Kuipers,et al.  How to Discover a Knowledge Representation for Causal Reasoning by Studying an Expert Physician , 1983, IJCAI.

[2]  Gary S. Kahn,et al.  The Mud System , 1986, IEEE Expert.

[3]  Fred N. Finley.  Measuring Knowledge Within a Domain: A Critique of NAGY, P , 1986 .

[4]  John R. Anderson,et al.  Learning to Program in LISP , 1984, Cogn. Sci..

[5]  John R. Anderson,et al.  Learning to Program in LISP , 1984, Cogn. Sci..

[6]  Robert R. Hoffman,et al.  The Problem of Extracting the Knowledge of Experts from the Perspective of Experimental Psychology , 1987, AI Mag..

[7]  Nancy E. Johnson.  Mediating representations in knowledge elicitation , 1989 .

[8]  Christopher J. R. Green,et al.  Verification and validation of expert systems , 1991 .

[9]  Marianne LaFrance,et al.  The quality of expertise: implications of expert-novice differences for knowledge acquisition , 1989, SGAR.

[10]  Marianne LaFrance,et al.  The Knowledge Acquisition Grid: A Method for Training Knowledge Engineers , 1987, Int. J. Man Mach. Stud..

[11]  P. Feltovich,et al.  The nature of conceptual understanding in biomedicine : the deep structure of complex ideas and the development of misconceptions , 1988 .

[12]  B. Chandrasekaran,et al.  Generic Tasks in Knowledge-Based Reasoning: High-Level Building Blocks for Expert System Design , 1986, IEEE Expert.

[13]  Dorothea P. Simon,et al.  Expert and Novice Performance in Solving Physics Problems , 1980, Science.

[14]  Diana E. Forsythe,et al.  Knowledge acquisition for expert systems: some pitfalls and suggestions , 1989, IEEE Trans. Syst. Man Cybern..

[15]  Michael J. Prietula,et al.  Expertise and Error in Diagnostic Reasoning , 1981, Cogn. Sci..

[16]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[17]  Bob Wielinga,et al.  Models of Expertise in Knowledge Acquisition , 1989 .

[18]  Mildred L. G. Shaw,et al.  Modeling expert knowledge , 1990 .

[19]  Jill Bell,et al.  The third role—the naturalistic knowledge engineer , 1989 .

[20]  Benjamin Kuipers,et al.  Critical Decisions under Uncertainty: Representation and Structure , 1990, Cogn. Sci..

[21]  B. Kuipers,et al.  Critical Decisions under Uncertainty: Representation and Structure , 1990, Cogn. Sci..

[22]  Michael J. Freiling,et al.  Ontological Analysis: An Ongoing Experiment , 1987, Int. J. Man Mach. Stud..

[23]  R. Brown.  How shall a thing be called. , 1958, Psychological review.

[24]  Lindsey Churchill.  Questioning strategies in sociolinguistics , 1978 .

[25]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[26]  D. Diaper,et al.  Knowledge Elicitation: Principles, Techniques and Applications , 1989 .

[27]  Oswald Werner,et al.  Systematic Fieldwork. Vol. I: Foundations of Ethnography and Interviewing. , 1989 .

[28]  H. Simon,et al.  A simulation of memory for chess positions. , 1973 .

[29]  John R. Anderson.  The Architecture of Cognition , 1983 .

[30]  Enrico Motta,et al.  A Methodology and Tool for Knowledge Acquisition in Keats-2 , 1989 .

[31]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[32]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .