Integrating cognitive task analysis into instructional systems development

Traditional methods for task analysis and training design, such as those embodied in Instructional Systems Development (ISD), decompose jobs into discrete tasks composed of specific action sequences and identify prerequisite knowledge and skills for each task. Although these methods have been effective for designing training for simple procedural skills, they offer little insight for analysis or training of jobs involving complex cognitive skills, which increasingly require training today. Because of this, cognitive considerations need to be incorporated into ISD, particularly in the task analysis phase. Recently, cognitive methods have begun to be used to conduct task analysis for training program development and human-computer system development. In this article, recent developments in cognitive task analysis are reviewed, and The Integrated Task Analysis Model (ITAM), a framework for integrating cognitive and behavioral task analysis methods within the ISD model, is presented. Discussed in detail are ITAM's three analysis stages—progressive cycles of data collection, analysis, and decision making—in three components of expertise: skills, knowledge, and mental models.

[1]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[2]  Susan Palmiter,et al.  Designing Help Using a GOMS Model: An Information Retrieval Evaluation , 1991 .

[3]  Thomas L. Seamster,et al.  Expertise in Air Traffic Control (ATC): What is it, and how Can we Train for It? , 1992 .

[4]  Bob Wielinga,et al.  Use of Models in the Interpretation of Verbal Data , 1987 .

[5]  Wayne Zachary,et al.  A Cognitively-Based Functional Taxonomy of Decision Support Techniques , 1986, SGCH.

[6]  Alexander J. Romiszowski,et al.  Designing Instructional Systems , 1980 .

[7]  Joan M. Ryder,et al.  Cognitive Task Analysis of Expertise in Air Traffic Control , 1993 .

[8]  Gerhard P. Deffner,et al.  Evaluation of Concurrent Thinking Aloud Using Eye-tracking Data , 1990 .

[9]  Barbara L. McCombs,et al.  The Instructional Systems Development (ISD) Model: A Review of Those Factors Critical to Its Successful Implementation. , 1986 .

[10]  Chris Roth,et al.  Cognitive Task Analysis for the Real(-time) World , 1990 .

[11]  Andrea A. diSessa,et al.  Unlearning Aristotelian Physics: A Study of Knowledge-Based Learning , 1982, Cogn. Sci..

[12]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[13]  John R. Wilson,et al.  Mental Models: Theory and Application in Human Factors , 1989 .

[14]  Jens Rasmussen,et al.  Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[15]  John D. Bransford,et al.  Teaching Thinking and Problem Solving. , 1986 .

[16]  David H. Jonassen,et al.  Handbook of Task Analysis Procedures , 1989 .

[17]  Barbara Means,et al.  Cognitive task analysis as a basis for tutor development: Articulating abstract knowledge representations. , 1988 .

[18]  Robert M. Gagné,et al.  The Conditions of Learning and Theory of Instruction , 1985 .

[19]  David Meister,et al.  Behavioral Analysis and Measurement Methods , 1985 .

[20]  Brian R. Gaines,et al.  An Interactive Knowledge-Elicitation Technique Using Personal Construct Technology , 1987 .

[21]  Benjamin Kuipers,et al.  Knowledge Acquisition by Analysis of Verbatim Protocols , 1987 .

[22]  James D. Hollan,et al.  Cognitive science and military training. , 1986 .

[23]  John C. Chen,et al.  Effects of Mental Models of a Computer-Aided Instruction System on the Acquisition of Cognitive Skills , 1990 .

[24]  Robert K. Branson,et al.  The Interservice Procedures for Instructional Systems Development. , 1978 .

[25]  Donald A. Norman,et al.  Analogical Processes in Learning , 1980 .

[26]  M. Chi,et al.  The Nature of Expertise , 1988 .

[27]  Richard E. Redding Taking Cognitive Task Analysis into the Field: Bridging the Gap from Research to Application , 1990 .

[28]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[29]  A. D. Fisk,et al.  Training Consistent Task Components: Application of Automatic and Controlled Processing Theory to Industrial Task Training , 1987, Human factors.

[30]  Ralph E. Wileman,et al.  The Neglected Phase of Instructional Design. , 1983 .

[31]  Barbara Y. White,et al.  Qualitative models and intelligent learning environments , 1987 .

[32]  Richard E. Redding Perspectives on Cognitive Task-Analysis: The State of the State of the Art , 1989 .

[33]  Lawrence Lipsitz An Interview with Robert M. Gagne: Developments in Learning Psychology; Implications for Instructional Design; and Effects of Computer Technology on Instructional Design and Development. , 1982 .

[34]  James E. McDonald,et al.  The Application of Psychological Scaling Techniques to Knowledge Elicitation for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[35]  Moshe Naveh-Benjamin,et al.  Inferring students' cognitive structures and their development using the "ordered tree technique." , 1986 .

[36]  P. Johnson-Laird Mental models , 1989 .

[37]  J. Greeno,et al.  The cognitive skill of teaching. , 1986 .

[38]  Christine M. Mitchell,et al.  Operator Modeling: Conceptual and Methodological Distinctions , 1987 .

[39]  M. David Merrill,et al.  Limitations of First Generation Instructional Design , 1990 .

[40]  Heinz Mandl,et al.  Learning Issues for Intelligent Tutoring Systems , 1988, Cognitive Science.

[41]  K. A. Ericsson,et al.  Toward a general theory of expertise : prospects and limits , 1991 .

[42]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[43]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[44]  Wayne Zachary,et al.  COGNET and BATON: an integrated approach to embedding user models in complex systems , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[45]  William E. Montague,et al.  The Instructional Quality Inventory (IQI): A Formative Evaluation Tool for Instructional Systems Development. , 1983 .

[46]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[47]  David Woods,et al.  Situation Awareness: A Critical But Ill-Defined Phenomenon , 1991 .

[48]  Gerhard Fischer,et al.  Enhancing incremental learning processes with knowledge-based systems , 1988 .

[49]  K. Biolsi,et al.  Techniques for representing expert knowledge. , 1991 .

[50]  Dee H. Andrews,et al.  A comparative analysis of models of instructional design , 1980 .

[51]  R. Glaser,et al.  Foundations in learning research. , 1987 .

[52]  Joan M. Ryder,et al.  Training Development for Complex Cognitive Tasks , 1987 .

[53]  Daniel G. Bobrow,et al.  SOME PRINCIPLES OF MEMORY SCHEMATA , 1975 .

[54]  Thomas L. Seamster,et al.  Analysis of En Route Air Traffic Controller Team Communication and Controller Resource Management (CRM) , 1992 .

[55]  Susan Palmiter,et al.  Designing Help Systems Using the GOMS Model: An Information Retrieval Evaluation , 1989 .

[56]  James O. Carey,et al.  The systematic design of instruction , 1978 .

[57]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[58]  Arthur C. Graesser,et al.  A question-answering methodology for exploring a user's acquisition and knowledge of a computer environment , 1990 .

[59]  Leslie Johnson,et al.  Knowledge Elicitation Involving Teachback Interviewing , 1987 .

[60]  Renée Elio,et al.  Modeling Novice-to-Expert Shifts in Problem-Solving Strategy and Knowledge Organization , 1990, Cogn. Sci..

[61]  Harold F. O'Neil Procedures for instructional systems development , 1979 .

[62]  Harold S. Blackman Overview: The Use of Think Aloud Verbal Protocols for the Identification of Mental Models , 1988 .

[63]  A. D. Fisk,et al.  Examination of the Role of “Higher-Order” Consistency in Skill Development , 1988, Human factors.

[64]  John G. Gammack Different Techniques and Different Aspects on Declarative Knowledge , 1987 .

[65]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[66]  D. Gentner Mental Models , 1983 .

[67]  Richard E. Redding,et al.  Development of a Part-Task, CBI Trainer Based upon a Cognitive Task Analysis , 1990 .

[68]  Wayne W. Zachary,et al.  Decision Support Systems: Designing to Extend the Cognitive Limits , 1988 .

[69]  John D. Bransford,et al.  Teaching thinking and problem solving: Research foundations. , 1986 .

[70]  Arthur D. Fisk,et al.  Application of Automatic/Controlled Processing Theory to Training Tactical Command and Control Skills: 1. Background and Task Analytic Methodology , 1988 .

[71]  Valerie J. Shute,et al.  Taxonomy of Learning Skills , 1988 .

[72]  Walter Schneider,et al.  Training High-Performance Skills: Fallacies and Guidelines , 1985 .

[73]  Nancy M. Cooke,et al.  A formal methodology for acquiring and representing expert knowledge , 1986, Proceedings of the IEEE.

[74]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[75]  Harold P. van Cott From Control Systems to Knowledge Systems , 1984 .

[76]  Arthur D. Fisk,et al.  Training Consistent Components of Tasks: Developing an Instructional System Based on Automatic/Controlled Processing Principles , 1989 .

[77]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[78]  Saul Amarel,et al.  On the Representation of Problems and Goal-Directed Procedures for Computers , 1970 .