Effects of training on short- and long-term skill retention in a complex multiple-task environment

The paper reports the results of an experiment on the performance and retention of a complex task. This was a computer-based simulation of the essential elements of a spacecraft's life support system. It allowed the authors to take a range of measures, including primary and secondary task performance, system intervention and information sampling strategies, mental model structure, and subjective operator state. The study compared the effectiveness of two methods of training, based on low level (procedure-based) and high level (system-based) understanding. Twenty-five participants were trained extensively on the task, then given a 1-h testing session. A second testing session was carried out 8 months after the first (with no intervening practice) with 17 of the original participants. While training had little effect on control performance, there were considerable effects on system management strategies, as well as in structure of operator's mental model. In the second testing session, the anticipated general performance decrement did not occur, though for complex faults there was an increase in selectivity towards the primary control task. The relevance of the findings for training and skill retention in real work environments is discussed in the context of a model of compensatory control.

[1]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[2]  G. R. J. Hockey.  Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework , 1997, Biological Psychology.

[3]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[4]  D. Berry,et al.  Negative Correlations between Control Performance and Verbalizable Knowledge: Indicators for Implicit Learning in Process Control Tasks? , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[5]  Scott Henninger.  Book review: Cognitive Engineering in Complex Dynamic Worlds. Edited by E. Hollnagel, G. Mancini, & D. Woods (Academic Press) , 1990, SGAR.

[6]  John Patrick,et al.  Training: Research and practice. , 1992 .

[7]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[8]  Marshall J. Farr,et al.  The Long-Term Retention of Knowledge and Skills: A Cognitive And Instructional Perspective , 1987 .

[9]  Rapid Thermal Multiprocessor,et al.  Supervisory Control of a , 1993 .

[10]  A. Colley,et al.  Acquisition and performance of cognitive skills , 1989 .

[11]  D. Broadbent,et al.  Implicit and explicit knowledge in the control of complex systems , 1986 .

[12]  David D. Woods,et al.  Commentary: Cognitive Engineering in Complex and Dynamic Worlds , 1988, Int. J. Man Mach. Stud..

[13]  K. D. Duncan,et al.  Diagnosis of Plant Failures from a Control Panel: A Comparison of Three Training Methods , 1977 .

[14]  William B. Rouse,et al.  Review and Evaluation of Empirical Research in Troubleshooting , 1985 .

[15]  D G Wastell,et al.  Skill maintenance in extended spaceflight: a human factors analysis of space and analogue work environments. , 1996, Acta astronautica.

[16]  Winston Bennett,et al.  Factors That Influence Skill Decay and Retention: A Quantitative Review and Analysis , 1998 .

[17]  Joseph D. Hagman,et al.  Retention of Military Tasks: A Review , 1983 .

[18]  Andrew M. Rose,et al.  Acquisition and Retention of Skills , 1989 .

[19]  Véronique De Keyser,et al.  How Can Computer-Based Visual Displays Aid Operators? , 1987, Int. J. Man Mach. Stud..

[20]  J Sauer,et al.  Multiple-task performance on a computer-simulated life support system during a space mission simulation. , 1999, Acta astronautica.

[21]  Marshall J. Farr,et al.  The Long-Term Retention of Knowledge and Skills , 1987 .

[22]  J Sauer,et al.  Maintenance of complex performance during a 135-day spaceflight simulation. , 1999, Aviation, space, and environmental medicine.

[23]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[24]  J Sauer,et al.  Performance evaluation in analogue space environments: adaptation during an 8-month Antarctic wintering-over expedition. , 1999, Aviation, space, and environmental medicine.

[25]  Jan Wirstad,et al.  On knowledge structures for process operators , 1988 .

[26]  J Sauer,et al.  A conceptual framework for designing micro-worlds for complex work domains: a case study of the Cabin Air Management System. , 2000, Computers in human behavior.

[27]  David Woods,et al.  Human factors challenges in process control: The case of nuclear power plants. , 1987 .

[28]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[29]  Nancy J. Cooke,et al.  Toward an on-line knowledge assessment methodology: Building on the relationship between knowing and doing , 1996 .

[30]  D. Woods,et al.  Automation Surprises , 2001 .

[31]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[32]  Jürgen S. Sauer,et al.  Effects of Sleep Deprivation and User Interface on Complex Performance: A Multilevel Analysis of Compensatory Control , 1998, Hum. Factors.

[33]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[34]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[35]  Jean-Michel Hoc,et al.  Rapidité du processus contrôlé et planification dans un micro-monde dynamique , 1994 .

[36]  John Patrick,et al.  Training and transfer of fault-finding skill , 1988 .