Cognitive task analysis

This chapter presents an overview of the current state of cognitive task analysis (CTA) in research and practice. CTA uses a variety of interview and observation strategies to capture a description of the explicit and implicit knowledge that experts use to perform complex tasks. The captured knowledge is most often transferred to training or the development of expert systems. The first section presents descriptions of a variety of CTA techniques, their common characteristics, and the typical strategies used to elicit knowledge from experts and other sources. The second section describes research on the impact of CTA and synthesizes a number of studies and reviews pertinent to issues underlying knowledge elicitation. In the third section, we discuss the integration of CTA with training design. Finally, in the fourth section, we present a number of recommendations for future research and conclude with general comments.

[1]  David F. Feldon,et al.  Instructional implications of cognitive task analysisas a method for improving the accuracy of experts’ self-report , 2006 .

[2]  Jan Elen,et al.  When less is more: research and theory insights about instruction for complex learning , 2006 .

[3]  Theresa M. Mullin,et al.  Experts' estimation of uncertain quantities and its implications for knowledge acquisition , 1989, IEEE Trans. Syst. Man Cybern..

[4]  Jeffrey M. Bradshaw,et al.  New approaches to constructivist knowledge acquisition tool development , 1993 .

[5]  K. A. Ericsson,et al.  Toward a general theory of expertise : prospects and limits , 1991 .

[6]  Paul A. Kirschner,et al.  Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design , 2007 .

[7]  R. Glaser.  Education and Thinking: The Role of Knowledge. , 1984 .

[8]  Harold Maurice Collins,et al.  Where's the expertise? Expert systems as a medium of knowledge transfer , 1986 .

[9]  R. Glaser.  Components of a Psychology of Instruction: Toward a Science of Design , 1976 .

[10]  Sherrie P. Gott,et al.  A Procedural Guide to Cognitive Task Analysis: The PARI Methodology. , 1995 .

[11]  Richard E. Clark,et al.  Blueprints for complex learning: The 4C/ID-model , 2002 .

[12]  Robert R. Hoffman,et al.  Knowledge modeling for the preservation of institutional memory , 2003, J. Knowl. Manag..

[13]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[14]  Richard E. Clark.  Design Document for A Guided Experiential Learning Course 1 , 2008 .

[15]  Kenneth A. Yates,et al.  Advancing the practice of cognitive task analysis: a call for taxonomic research , 2011 .

[16]  Colleen M. Zeitz,et al.  Some concrete advantages of abstraction: how experts' representations facilitate reasoning , 1997 .

[17]  George C Velmahos,et al.  Cognitive task analysis for teaching technical skills in an inanimate surgical skills laboratory. , 2004, American journal of surgery.

[18]  Gavriel Salvendy,et al.  Percentage of procedural knowledge acquired as a function of the number of experts from whom knowledge is acquired for diagnosis, debugging, and interpretation tasks , 1994, Int. J. Hum. Comput. Interact..

[19]  Gavriel Salvendy,et al.  The cognitive task analysis methods for job and task design: review and reappraisal , 2004, Behav. Inf. Technol..

[20]  Joan M. Ryder,et al.  Integrating cognitive task analysis into instructional systems development , 1993 .

[21]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[22]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[23]  Jonathan D. Pfautz,et al.  Using cognitive engineering for system design and evaluation: A visualization aid for stability and support operations , 2006 .

[24]  John R. Anderson,et al.  How people learn to skip steps. , 1996 .

[25]  P. Slovic,et al.  An analysis-of-variance model for the assessment of configural cue utilization in clinical judgment. , 1968, Psychological bulletin.

[26]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[27]  H. J. Einhorn.  Expert judgment: Some necessary conditions and an example. , 1974 .

[28]  Peter Carruthers,et al.  The illusion of conscious will , 2007, Synthese.

[29]  K. D. Duncan,et al.  TASK ANALYSIS AND TRAINING DESIGN. , 1967 .

[30]  Pamela J. Hinds,et al.  Bothered by abstraction: the effect of expertise on knowledge transfer and subsequent novice performance. , 2001, The Journal of applied psychology.

[31]  N. Shadbolt,et al.  Eliciting Knowledge from Experts: A Methodological Analysis , 1995 .

[32]  B Crandall,et al.  Critical decision method: A technique for eliciting concrete assessment indicators from the intuition of NICU nurses , 1993, ANS. Advances in nursing science.

[33]  Nigel Shadbolt,et al.  Use of the Critical Decision Method to Elicit Expert Knowledge: A Case Study in the Methodology of Cognitive Task Analysis , 1998, Hum. Factors.

[34]  Nancy J. Cooke,et al.  Knowledge Elicitation , 2003 .

[35]  Jeroen J. G. van Merriënboer,et al.  Training Complex Cognitive Skills: A Four-Component Instructional Design Model for Technical Training , 1997 .

[36]  David A. Kareken,et al.  Human judgment and estimation of premorbid intellectual function. , 1994 .

[37]  서정헌,et al.  반도체 공정 overview , 2001 .

[38]  Thomas H. Hammond,et al.  Learning in Hierarchies , 2007 .

[39]  J M Abreu,et al.  Conscious and nonconscious African American stereotypes: impact on first impression and diagnostic ratings by therapists. , 1999, Journal of consulting and clinical psychology.

[40]  D. Wegner,et al.  Automaticity of Action, Psychology of , 2001 .

[41]  Pamela J. Hinds,et al.  The curse of expertise: The effects of expertise and debiasing methods on prediction of novice performance. , 1999 .

[42]  C. Atman,et al.  How people learn. , 1985, Hospital topics.

[43]  Nancy J. Cooke,et al.  Modeling human expertise in expert systems , 1992 .

[44]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[45]  J. Bransford.  How people learn , 2000 .

[46]  John R. Anderson.  ACT: A simple theory of complex cognition. , 1996 .

[47]  Richard E. Redding,et al.  Cognitive task analysis for instructional design: Applications in distance education , 1995 .

[48]  Arthur D. Fisk,et al.  Application of Automatic/Controlled Processing Theory to Training Tactical Command and Control Skills: 1. Background and Task Analytic Methodology , 1988 .

[49]  Walter Schneider,et al.  Training High-Performance Skills: Fallacies and Guidelines , 1985 .

[50]  Gary A. Klein,et al.  Applying decision requirements to user-centered design , 1997, Int. J. Hum. Comput. Stud..

[51]  Daniel L. Schwartz,et al.  A time for telling , 1998 .

[52]  John R. Anderson,et al.  Knowledge Compilation: Mechanisms for the Automatization of Cognitive Skills. , 1980 .

[53]  Kenneth A. Yates,et al.  TOWARDS A TAXONOMY OF COGNITIVE TASK ANALYSIS METHODS: A SEARCH FOR COGNITION AND TASK ANALYSIS INTERACTIONS , 2007 .

[54]  David H. Jonassen,et al.  Task Analysis Methods for Instructional Design , 1998 .

[55]  Peter Essens,et al.  COADE: A Framework for Cognitive Analysis, Design, and Evaluation. , 1995 .

[56]  Charles M. Reigeluth,et al.  Formative research on the Heuristic Task Analysis process , 2003 .

[57]  P E Johnson,et al.  What kind of expert should a system be? , 1983, The Journal of medicine and philosophy.

[58]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[59]  S. Chipman,et al.  Introduction to Cognitive Task Analysis , 2000 .

[60]  William F. Brewer,et al.  The Role of Anomalous Data in Knowledge Acquisition: A Theoretical Framework and Implications for Science Instruction , 1993 .

[61]  Leslie A. Tirapelle,et al.  The effect of cognitive task analysis based instruction on surgical skills expertise and performance , 2010 .

[62]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[63]  Joseph A. Horvath,et al.  Cognitive conceptions of expertise and their relations to giftedness. , 1998 .

[64]  M. Ferguson,et al.  Beyond behaviorism: on the automaticity of higher mental processes. , 2000, Psychological bulletin.

[65]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[66]  E. Salas,et al.  The science of training: a decade of progress. , 2001, Annual review of psychology.

[67]  M. Segers,et al.  The Relation Between Assessment Practices and Outcomes of Studies: The Case of Research on Prior Knowledge , 1999 .

[68]  Jan Maarten Schraagen,et al.  Cognitive Task Analysis and Innovation of Training: The Case of Structured Troubleshooting , 2000, Hum. Factors.

[69]  Leslie J. Briggs,et al.  Principles of Instructional Design , 1974 .

[70]  K. A. Ericsson,et al.  Protocol analysis: Verbal reports as data, Rev. ed. , 1993 .

[71]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[72]  Richard E. Clark,et al.  Motivational Challenges Experienced in Highly Complex Learning Environments , 2006 .

[73]  R. Stofflett,et al.  Representation of the conceptual change model in science teacher education , 1996 .

[74]  Roberta Calderwood,et al.  Decision models: some lessons from the field , 1991, IEEE Trans. Syst. Man Cybern..

[75]  R. Clark,et al.  Cognitive task analysis for training , 1996 .

[76]  K. Fiedler,et al.  Behavioral routines in decision making: the effects of novelty in task presentation and time pressure on routine maintenance and deviation , 1998 .

[77]  David F. Feldon,et al.  The Implications of Research on Expertise for Curriculum and Pedagogy , 2007 .

[78]  Robert M. Gagné,et al.  The Conditions of Learning: Training Applications , 1995 .

[79]  H. Levin,et al.  Cost-Effectiveness Analysis: Methods and Applications , 2000 .

[80]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[81]  Nancy J. Cooke,et al.  Varieties of knowledge elicitation techniques , 1994, Int. J. Hum. Comput. Stud..

[82]  Erik Hollnagel,et al.  Cognitive Systems Engineering: New Wine in New Bottles , 1983, Int. J. Man Mach. Stud..

[83]  Vivienne B. Carr,et al.  The acquisition of knowledge. , 1996, American journal of orthopedics.

[84]  Kenneth A. Yates,et al.  Towards a taxonomy of cognitive task analysismethods for instructional design: Interactions with cognition , 2008 .

[85]  Valerie J. Shute,et al.  State-of-the-art review of cognitive task analysis techniques , 2000 .

[86]  N. J. Cook,et al.  Constructing naive theories of motion on the fly , 1994, Memory & cognition.

[87]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[88]  Robert R. Hoffman,et al.  The Psychology of Expertise: Cognitive Research and Empirical AI , 2011 .

[89]  Geert Crombez,et al.  Automatic attitude activation and efficiency: The fourth horseman of automaticity. , 2000 .

[90]  M. David Merrill.  A Pebble‐in‐the‐Pond Model For Instructional Design , 2002 .

[91]  David H. Jonassen,et al.  Handbook of Research for educational Communications and Technology , 1997 .

[92]  E. Salas,et al.  Linking Expertise and Naturalistic Decision Making , 2001 .

[93]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[94]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[95]  Nancy J. Cooke,et al.  Role of high-level knowledge in memory for chess positions , 1993 .