Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload

In this article we review and assess human-centered level of automation (LOA), an alternate approach to traditional, technology-centered design of automation in dynamic-control systems. The objective of human-controlled LOA is to improve human-machine performance by taking into account both operator and technological capabilities. Automation literature has shown that traditional automation can lead to problems in operator situation awareness (SA) due to the out-of-the (control) loop performance problem, which may lead to a negative impact on overall systems performance. Herein we address a standing paucity of research into LOA to deal with these problems. Various schemes of generic control system function allocations were developed to establish a LOA taxonomy. The functions allocated to a human operator, a computer, or both, included monitoring system variables, generating process plans, selecting an “optimal” plan and implementing the plan. Five different function allocation schemes, or LOAs, were empirically investigated as to their usefulness for enhancing telerobot system performance and operator SA, as well as reducing workload. Human participants participated in experimental trials involving a high fidelity, interactive simulation of a telerobot performing nuclear materials handling at the various LOAs. Automation failures were attributed to various simulated system deficiencies necessitating operator detection and correction to return to functioning at an automated mode. Operator performance at each LOA, and during the failure periods, was evaluated. Operator SA was measured using the Situation Awareness Global Assessment Technique, and perceived workload was measured using the NASA-Task Load Index. Results demonstrated improvements in human-machine system performance at higher LOAs (levels involving greater computer control of system functions) along with lower operator subjective workload. However, under the same conditions, operator SA was reduced for certain types of system problems and reaction time to, and performance during, automation failures was substantially lower. Performance during automation failure was best when participants had been functioning at lower, intermediate LOAs (levels involving greater human control of system functions). © 2000 John Wiley & Sons, Inc.

[1]  Mica R. Endsley,et al.  The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits , 1987 .

[2]  David B Kaber The effect of level of automation and adaptive automation on performance in dynamic control environments , 1996 .

[3]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[4]  E Edwards HUMAN FACTORS IN AVIATION I , 1985 .

[5]  Mica R. Endsley,et al.  Towards a New Paradigm for Automation: Designing for Situation Awareness , 1995 .

[6]  Paul Milgram,et al.  Telerobotic control using augmented reality , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[7]  Robert J. Anderson,et al.  Autonomous, teleoperated, and shared control of robot systems , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[8]  John V. Draper,et al.  Teleoperators for advanced manufacturing: Applications and human factors challenges , 1995 .

[9]  David C. Nagel,et al.  Human factors in aviation , 1988 .

[10]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[11]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[12]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[13]  Neville Moray,et al.  Monitoring behavior and supervisory control , 1986 .

[14]  Thomas B. Sheridan,et al.  Monitoring Behavior and Supervisory Control , 1976 .

[15]  David B. Kaber,et al.  Telepresence , 1998, Hum. Factors.

[16]  Charles E. Billings,et al.  Human-centered aircraft automation: A concept and guidelines , 1991 .

[17]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[18]  Earl L. Wiener 13 – Cockpit Automation , 1988 .

[19]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[20]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[21]  C. Wickens Engineering psychology and human performance, 2nd ed. , 1992 .