Knowledge Elicitation of Recognition-Primed Decision Making

Abstract : A Critical Decision Method (CDM) has been developed for knowledge elicitation. The CDM, an extension of the critical incident technique, includes protocol analysis and memory recall tasks to study cognitive performance. A set of probes is employed to trace the development of situation assessment during critical incidents, and to determine the decision strategies used. The outputs of the method include inventories of the critical cues, graphic portrayals of the situation assessment process, and categorization of the decision strategies. Thus far, the method has been used with a variety of decisions and appears especially well suited to studying cognitive performance in naturalistic settings. It also appears valuable for addressing the highly skilled decision maker, and for eliciting the analytical and perceptual bases of proficient performance. Applications have been made for training, decision support systems, and the development and evaluation of knowledge based systems. Keywords: Knowledge elicitation, Decision making, Situation assessment, Knowledge engineering, Expertise.

[1]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[2]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[3]  K. R. Hammond,et al.  SOME METHODOLOGICAL CONSIDERATIONS IN MULTIPLE-CUE PROBABILITY STUDIES. , 1964, Psychological review.

[4]  J. C. Naylor,et al.  Characteristics of the human inference process in complex choice behavior situations , 1966 .

[5]  P. Slovic,et al.  Reversals of preference between bids and choices in gambling decisions. , 1971 .

[6]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[7]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[8]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[9]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[10]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[11]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[12]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[13]  Gary A. Klein.  Phenomenological Vs. Behavioral Objectives for Training Skilled Performance , 1978 .

[14]  Laurie Thomas,et al.  FOCUS on education—an interactive computer system for the development and analysis of repertory grids , 1978 .

[15]  A. D. D. Groot.  Thought and Choice in Chess , 1978 .

[16]  H. Dreyfus.  What Computers Can't Do: The Limits of Artificial Intelligence , 1978 .

[17]  C. Gettys,et al.  Hypothesis plausibility and hypothesis generation , 1979 .

[18]  O. Svenson.  Process descriptions of decision making. , 1979 .

[19]  Baruch Fischhoff,et al.  The Experienced Utility of Expected Utility Approaches , 1980 .

[20]  G. Pitz,et al.  Procedures for eliciting choices in the analysis of individual decisions , 1980 .

[21]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[22]  Mark Easterby-Smith,et al.  The Design, Analysis and Interpretation of Repertory Grids , 1980, Int. J. Man Mach. Stud..

[23]  S. Schiffman.  Introduction to Multidimensional Scaling , 1981 .

[24]  B. Fischhoff,et al.  Subjective Confidence in Forecasts. , 1982 .

[25]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[26]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[27]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[28]  W. C. Howell,et al.  Task Influences in the Analytic-Intuitive Approach to Decision Making , 1984 .

[29]  Robert M. Hamm,et al.  The Relative Efficacy of Intuitive and Analytical Cognition: A Second Direct Comparison , 1984 .

[30]  Roger W. Schvaneveldt,et al.  Measuring the Structure of Expertise , 1985, Int. J. Man Mach. Stud..

[31]  D. Mackinnon,et al.  Eyewitness memory enhancement in the police interview: cognitive retrieval mnemonics versus hypnosis. , 1985, The Journal of applied psychology.

[32]  Alex Goodall,et al.  The guide to expert systems , 1985 .

[33]  John H. Boose,et al.  A Knowledge Acquisition Program for Expert Systems Based on Personal Construct Psychology , 1985, Int. J. Man Mach. Stud..

[34]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[35]  Gary Klein,et al.  Design Engineers and the Design Process: Decision Strategies and Human Factors Literature , 1986 .

[36]  Gary Klein,et al.  Rapid Decision Making on the Fire Ground , 1986 .

[37]  H. Brachinger,et al.  Decision analysis , 1997 .

[38]  Gary Klein,et al.  Expert and Novice Fire Ground Command Decisions , 1987 .

[39]  B. Fischhoff,et al.  KNOWING WHAT YOU WANT: MEASURING LABILE VALUES , 1988 .

[40]  Gary Klein,et al.  Decision Making in Armored Platoon Command , 1990 .

[41]  Gary Klein,et al.  Distributed Decision Making in Wildland Firefighting , 1990 .