THE EFFECTS OF AUTOMATION AND TASK DIFFICULTY ON CREW COORDINATION, WORKLOAD, AND PERFORMANCE.

Director: Glynn D. Coates, Ph.D. The purposes of this research were two-fold: (1) to assess the reliability and utility of the Aircrew Coordination Observation and Evaluation scales in describing crew coordination behaviors exhibited during flight and (2) to investigate the effects of automation on crew coordination, workload, and performance. Two levels of automation (i.e., presence or absence of an autopilot) and two levels of task difficulty (i.e., presence or absence of wind and turbulence) were combined to yield a 2 x 2 design. Twentyfour two-person crews performed in both levels of automation and one of two levels of task difficulty. The results of the reliability assessment demonstrated that the training procedures and behavioral summary scale anchors that were developed produced adequate levels of interrater reliability in this investigation. The results of the crew coordination analyses revealed differences in the frequency and quality of crew coordination behaviors between levels of automation. Ratings of crew coordination were also shown to be related to performance. The results also indicated that although crews in the automated condition reported less workload, only one of the three measures of flight performance was improved. In addition, under high task difficulty, problem solving performance was worse in the automated condition

[1]  Harry W. Orlady,et al.  Flight deck automation: Promises and realities , 1989 .

[2]  Daniel Leo McGuinness,et al.  Automation and the worker , 1954 .

[3]  W. D. Reynard,et al.  Dimensions of the information transfer problem. [human performance] , 1981 .

[4]  Earl L. Wiener,et al.  Beyond the Sterile Cockpit , 1985 .

[5]  R. Curtis Graeber.  Long-Range Operations in the Glass Cockpit: Vigilance, Boredom, and Sleepless Nights , 1989 .

[6]  Alan H Roscoe.  Flight Deck Automation and Pilot Workload , 1989 .

[7]  M. Eugene Merchant.  Human factors facilitating the implementation of automation , 1982 .

[8]  Christopher D. Wickens,et al.  The Impact of Automation on Error Detection: Some Results from a Visual Discrimination Task , 1987 .

[9]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[10]  E L Wiener,et al.  Application of Vigilance Research: Rare, Medium, or Well Done? , 1987, Human factors.

[11]  Harold E. Price,et al.  The Allocation of Functions in Systems , 1985 .

[12]  J. Sorenson,et al.  Task Demands, Group Interaction and Group Performance' , 1971 .

[13]  W. L. Miles,et al.  Advanced Commercial Cockpit Concepts , 1982 .

[14]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[15]  Susan G. Straus,et al.  Crew Structure, Automation and Communication: Interaction of Social and Technological Factors on Complex Systems Performance , 1989 .

[16]  W. O. Galitz,et al.  Human factors in office automation , 1980 .

[17]  Arye R. Ephrath,et al.  Detection by Pilots of System Failures during Instrument Landings , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  Barry H. Kantowitz,et al.  Human workload in aviation , 1988 .

[19]  Earl L. Wiener.  Management of Human Error by Design , 1987 .

[20]  Wanda J. Campbell,et al.  The Evolution of Teamwork Skills: An Empirical Assessment with Implications for Training , 1987 .

[21]  H C Foushee,et al.  The role of communications, socio-psychological, and personality factors in the maintenance of crew coordination. , 1982, Aviation, space, and environmental medicine.

[22]  S G Hart,et al.  Pilot Errors as a Source of Workload , 1984, Human factors.

[23]  G E Briggs,et al.  Team versus individual training, training task fidelity, and task organization effects on transfer performance by three-man teams. , 1965, The Journal of applied psychology.

[24]  J. J. Speyer.  Towards Design-Induced Error Tolerance , 1989 .

[25]  G. Briggs,et al.  Stimulus and response fidelity in team training. , 1966, The Journal of applied psychology.

[26]  Cathy C. Clothier.  Behavioral interactions across various aircraft types - Results of systematic observations of line operations and simulations , 1991 .

[27]  R C Williges,et al.  Role of verbal communication in teamwork. , 1966, The Journal of applied psychology.

[28]  Thomas G. Gunn.  The Mechanization of Design and Manufacturing. , 1982 .

[29]  R G Mortimer,et al.  AVIATION SAFETY RESEARCH. , 1993 .

[30]  H. P. Smith,et al.  A simulator study of the interaction of pilot workload with errors, vigilance, and decisions , 1979 .

[31]  Alfred J. Farina,et al.  EFFECTIVENESS OF INTEGRATED FLIGHT SIMULATOR TRAINING IN PROMOTING B-52 CREW COORDINATION , 1962 .

[32]  Gavriel Salvendy,et al.  Technical and human aspects of computer-aided manufacturing. , 1987 .

[33]  Earl L. Wiener,et al.  Human factors of advanced technology (glass cockpit) transport aircraft , 1989 .

[34]  Paul S. Goodman,et al.  Research on the Social Impaots of Robotics: Issues and Some Evidence , 1984 .

[35]  W A Johnston,et al.  Transfer of team skills as a function of type of training. , 1966, The Journal of applied psychology.

[36]  G. L. Babcock,et al.  Information Transfer and the Changing Role of the Pilot , 1982 .

[37]  Raja Parasuraman,et al.  Effects of shifts in the level of automation on operator performance , 1991 .

[38]  H. H. Rosenbrock,et al.  Robots and People , 1982 .

[39]  David C. Nagel,et al.  Pilots of the Future: Human or Computer? , 1985, Computer.

[40]  Eduardo Salas,et al.  A Comparison of Two Types of Training Interventions on Team Communication Performance , 1990 .

[41]  J. Cannon-Bowers,et al.  Aircrew coordination—Achieving teamwork in the cockpit. , 1992 .

[42]  J. W. McDaniel,et al.  Rules for fighter cockpit automation , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[43]  Donald A. Norman,et al.  Cognitive science in the cockpit , 1993 .

[44]  John R Turney,et al.  Targets for Team Skills Training. , 1981 .

[45]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[46]  Christopher D. Wickens,et al.  Aircrew Performance as a Function of Automation and Crew Composition: A Simulator Study , 1989 .

[47]  G E Briggs,et al.  Team-training effectiveness under various conditions. , 1965, The Journal of applied psychology.

[48]  Joseph L. Zeller,et al.  An Evaluation of Crew Coordination and Performance During a Simulated UH-60 Helicopter Mission , 1992 .

[49]  Robert L. Helmreich,et al.  Group interaction and flight crew performance , 1988 .

[50]  L. Bainbridge.  Ironies of Automation , 1982 .

[51]  A. H. Roscoe,et al.  The Impact of New Technology on Pilot Workload , 1986 .

[52]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[53]  James R. Gannett.  The Pilot and the Flight Management System , 1982 .

[54]  Lawrence K. Williams,et al.  The Impact of Numerically Controlled Equipment on Factory Organization , 1964 .

[55]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[56]  Robert Blauner,et al.  Alienation and Freedom , 1965 .

[57]  G E Briggs,et al.  Influence of a change in system criteria on team performance. , 1966, The Journal of applied psychology.

[58]  Robert G Kinkade,et al.  The Effect of Team Size and Intermember Communication on Decision-Making Performance , 1959 .

[59]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[60]  Marty R. Rockway,et al.  Cockpit resource management skills enhance combat mission performance in a B-52 simulator , 1989 .

[61]  R. E. Curry,et al.  Human factors of flight-deck automation: report on a NASA-industry workshop , 1983 .

[62]  Arthur S Blaiwes,et al.  Measurement of Team Behaviors in a Navy Environment , 1986 .

[63]  Thomas B. Sheridan.  Automation, Authority and Angst — Revisited , 1991 .

[64]  Amy L. Schwartz,et al.  Application of the Airbus Workload Model to the Study of Errors and Automation , 1989 .

[65]  L. Young.  On adaptive manual control. , 1969, Ergonomics.

[66]  T B ROBY,et al.  Considerations in the analysis of group tasks. , 1958, Psychological bulletin.

[67]  E. P. Farrell.  Interfacing with New Technology in the Modern Flight Deck - The Airline Pilots' View , 1987 .

[68]  David Woods,et al.  Human factors challenges in process control: The case of nuclear power plants. , 1987 .

[69]  Andrew J. Tattersall,et al.  The Maintenance of Vigilance during Automated Monitoring , 1989 .

[70]  Eduardo Salas,et al.  Toward a Definition of Teamwork: An Analysis of Critical Team Behaviors , 1989 .

[71]  Sandra G. Hart.  Research papers and publications (1981-1987): Workload research program , 1987 .

[72]  William B. Rouse,et al.  Studies of planning behavior of aircraft pilots in normal, abnormal, and emergency situations , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[73]  William Foote Whyte,et al.  Men at work , 1974 .

[74]  Ronald A. Hess,et al.  A Qualitative Model of Human Interaction with Complex Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.