The knowledge elicitation problem: a psychological perspective

Abstract The knowledge elicitation problem arises from the need to acquire the knowledge of human experts in an explicit form suitable for encoding in a computer program such as an expert system. This is very difficult to perform successfully because of the size and complexity of knowledge structures in the human brain, and because much procedural knowledge is tacit and unavailable to conscious verbal report via interview methods. The present paper draws upon an extensive review of research in the field of cognitive psychology in an attempt to offer a practical approach to this problem. First, a wide range of cognitive theories concerning the nature of knowledge representation in humans is considered, and a synthesis of the current state of theory is provided. Second, attention is drawn to a number of performance factors which may constrain the exhibition of a person's underlying cognitive competence. There then follows a review and discussion of a number of alternative psychological methodologies that mi...

[1]  P. C. Wason,et al.  Dual processes in reasoning? , 1975, Cognition.

[2]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[3]  B. Fischhoff,et al.  Judged frequency of lethal events , 1978 .

[4]  J. St B. T. Evans,et al.  Human biases and computer decision-making: a discussion of Jacob et al. , 1987 .

[5]  M. Henle.  On the relation between logic and thinking. , 1962, Psychological review.

[6]  Allan Paivio,et al.  Imagery and synchronic thinking. , 1975 .

[7]  P. Johnson-Laird,et al.  Only connections: A critique of semantic networks. , 1984 .

[8]  P. Johnson-Laird,et al.  The psychology of syllogisms , 1978, Cognitive Psychology.

[9]  William M. Smith,et al.  A Study of Thinking , 1956 .

[10]  Graeme S. Halford,et al.  Does a concurrent memory load interfere with reasoning? , 1984 .

[11]  John R. Anderson.  Arguments concerning representations for mental imagery. , 1978 .

[12]  D. Berkeley,et al.  Structuring decision problems and the ‘bias heuristic’ , 1982 .

[13]  P. G. Brooks,et al.  Competing with reasoning: A test of the working memory hypothesis , 1981 .

[14]  Alan D. Baddeley,et al.  Verbal Reasoning and Working Memory , 1976 .

[15]  J. Piaget,et al.  The Growth Of Logical Thinking From Childhood To Adolescence: An Essay On The Construction Of Formal Operational Structures , 1958 .

[16]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[17]  P. Johnson-Laird.  Mental models , 1989 .

[18]  M. Braine.  On the Relation Between the Natural Logic of Reasoning and Standard Logic. , 1978 .

[19]  D. Krantz,et al.  The use of statistical heuristics in everyday inductive reasoning , 1983 .

[20]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[21]  K. Duncker,et al.  On problem-solving , 1945 .

[22]  Richard Bell,et al.  A manual for repertory grid technique , 1977 .

[23]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[24]  D. Broadbent,et al.  On the Relationship between Task Performance and Associated Verbalizable Knowledge , 1984 .

[25]  Shelley E. Taylor,et al.  Stalking the elusive "vividness" effect. , 1982 .

[26]  L. Rips.  Cognitive Processes in Propositional Reasoning. , 1983 .

[27]  Anna Hart.  The role of induction in knowledge elilcitation , 1985 .

[28]  L. Cohen.  Can human irrationality be experimentally demonstrated? , 1981, Behavioral and Brain Sciences.

[29]  Keith J Holyoak,et al.  Pragmatic reasoning schemas , 1985, Cognitive Psychology.

[30]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[31]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[32]  Lynn Hasher,et al.  Is memory schematic , 1983 .

[33]  V. Coltheart,et al.  An investigation of semantic memory in individuals , 1981, Memory & cognition.

[34]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[35]  E. Shortliffe.  Computer-based medical consultations: mycin (elsevier north holland , 1976 .

[36]  A. Luchins.  Mechanization in problem solving: The effect of Einstellung. , 1942 .

[37]  Z. Pylyshyn.  The imagery debate: Analogue media versus tacit knowledge. , 1981 .

[38]  E. Rosch.  Cognitive Representations of Semantic Categories. , 1975 .

[39]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[40]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[41]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[42]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[43]  Edward E. Smith,et al.  Concepts and concept formation. , 1984, Annual review of psychology.

[44]  P. Pollard,et al.  On the conflict between logic and belief in syllogistic reasoning , 1983, Memory & cognition.

[45]  Herbert A. Simon,et al.  Problem Solving in Semantically Rich Domains: An Example from Engineering Thermodynamics , 1977, Cogn. Sci..

[46]  Gavriel Salvendy,et al.  Strategies and biases in human decision-making and their implications for expert systems , 1986 .

[47]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[48]  Baruch Fischhoff,et al.  Judgment under uncertainty: For those condemned to study the past: Heuristics and biases in hindsight , 1982 .

[49]  A. Tversky,et al.  The simulation heuristic , 1982 .

[50]  P. Humphreys,et al.  Experiences with MAUD: Aiding decision structuring versus bootstrapping the decision maker☆ , 1980 .

[51]  Jonathan Evans.  Heuristic and analytic processes in reasoning , 1984 .

[52]  G. A. Miller,et al.  Book Review Nisbett, R. , & Ross, L.Human inference: Strategies and shortcomings of social judgment.Englewood Cliffs, N.J.: Prentice-Hall, 1980. , 1982 .

[53]  K. Holyoak,et al.  Pragmatic versus syntactic approaches to training deductive reasoning , 1986, Cognitive Psychology.

[54]  John A. Self,et al.  Building expert systems, edited by F. Hayes-Roth D.A. Waterman and D.B. Lenat Addison-Wesley, London, 1983 (£27.50) , 1984, Robotica.

[55]  Ryszard S. Michalski,et al.  Knowledge acquisition by encoding expert rules versus computer induction from examples: a case study , 1980 .

[56]  Edward H. Shortliffe,et al.  Computer-based medical consultations, MYCIN , 1976 .