Cognitive ‘ Dipsticks ’ : Knowledge Elicitation Techniques for Cognitive Engineering Research

Cognitive engineering research frequently requires one to investigate the content, structure, and form of what people know. This technical report presents a number of knowledge elicitation techniques which are believed to be potentially useful in examining the nature and extent of subjects’ knowledge. Several procedures designed to act as process measures (how subjects do what they do) are presented followed in more detail by other procedures which are specifically designed to examine subject competencies (what subjects know). The techniques are presented in their original form and are then discussed in the context of cognitive engineering research. Specific examples are presented of how they have been applied within the context of research with a thermal-hydraulic process control simulation.

[1]  M. Chi,et al.  The Nature of Expertise , 1988 .

[2]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[3]  Renée Elio,et al.  Modeling Novice-to-Expert Shifts in Problem-Solving Strategy and Knowledge Organization , 1990, Cogn. Sci..

[4]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[5]  L. Bainbridge,et al.  A Study of Real-Time Human Decision-Making Using a Plant Simulator , 1968 .

[6]  K. A. Ericsson,et al.  Expert chess memory without chess knowledge-a training study , 1990 .

[7]  Henk G. Schmidt,et al.  On the Role of Biomedical Knowledge in Clinical Reasoning by Experts, Intermediates and Novices , 1992, Cogn. Sci..

[8]  Elwyn Edwards,et al.  The Human Operator in Process Control , 1974 .

[9]  W. C. Robertson,et al.  Detection of Cognitive Structure with Protocol Data: Predicting Performance on Physics Transfer Problems , 1990, Cogn. Sci..

[10]  Sam C. Brown,et al.  Comparison of measures for the estimation of clustering in free recall. , 1971 .

[11]  K. VanLehn.  Problem solving and cognitive skill acquisition , 1989 .

[12]  Kim J. Vicente,et al.  Making the abstraction hierarchy concrete , 1994, Int. J. Hum. Comput. Stud..

[13]  Penelope M Sanderson,et al.  State-space and verbal protocol methods for studying the human operator in process control. , 1989, Ergonomics.

[14]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[15]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[16]  Neville Moray,et al.  Acquisition of Process Control Skills , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  F. T. Eggemeier,et al.  Recommendations for Mental Workload Measurement in a Test and Evaluation Environment , 1993 .

[18]  Jens Rasmussen,et al.  Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[19]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[20]  Merrick Frank Kossack.  Ecological task analysis :a method for display enhancement , 1992 .

[21]  Robert J. Sternberg,et al.  Expertise and Intelligent Thinking: When is it Worse to Know Better , 1989 .

[22]  K J Vicente,et al.  Memory recall in a process control system: a measure of expertise and display effectiveness , 1992, Memory & cognition.

[23]  Pertti Saariluoma,et al.  Visuospatial and articulatory interference in chess players' information intake , 1992 .