Levels of Automation in Human Factors Models for Automation Design: Why We Might Consider Throwing the Baby Out With the Bathwater

This paper responds to Kaber’s reflections on the empirical grounding and design utility of the levels-of-automation (LOA) framework. We discuss the suitability of the existing human performance data for supporting design decisions in complex work environments. We question why human factors design guidance seems wedded to a model of questionable predictive value. We challenge the belief that LOA frameworks offer useful input to the design and operation of highly automated systems. Finally, we seek to expand the design space for human–automation interaction beyond the familiar human factors constructs. Taken together, our positions paint LOA frameworks as abstractions suffering a crisis of confidence that Kaber’s remedies cannot restore.

[1]  Robert B. Fuld.  The fiction of function allocation, revisited , 2000, Int. J. Hum. Comput. Stud..

[2]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[3]  B. Rouse William,et al.  Adaptive Aiding for Human/Computer Control , 1988 .

[4]  N. Lau,et al.  Ecological Interface Design in the Nuclear Domain: An Application to the Secondary Subsystems of a Boiling Water Reactor Plant Simulator , 2008, IEEE Transactions on Nuclear Science.

[5]  David B. Kaber,et al.  Issues in Human–Automation Interaction Modeling: Presumptive Aspects of Frameworks of Types and Levels of Automation , 2018 .

[6]  Nadine B. Sarter,et al.  Supporting Decision Making and Action Selection under Time Pressure and Uncertainty: The Case of In-Flight Icing , 2001, Hum. Factors.

[7]  David Woods,et al.  1. How to make automated systems team players , 2002 .

[8]  Greg A Jamieson,et al.  Empirical evaluation of the Process Overview Measure for assessing situation awareness in process plants , 2016, Ergonomics.

[9]  Greg A Jamieson,et al.  Situation awareness acquired from monitoring process plants – the Process Overview concept and measure , 2016, Ergonomics.

[10]  L. Hurlen,et al.  The plant panel : Feasibility study of an interactive large screen concept for process monitoring and operation , 2015 .

[11]  Thomas B. Sheridan,et al.  Function allocation: algorithm, alchemy or apostasy? , 2000, Int. J. Hum. Comput. Stud..

[12]  Sidney W. A. Dekker,et al.  MABA-MABA or Abracadabra? Progress on Human–Automation Co-ordination , 2002, Cognition, Technology & Work.

[13]  G. Skraaning,et al.  Ecological Interface Design in the Nuclear Domain: An Empirical Evaluation of Ecological Displays for the Secondary Subsystems of a Boiling Water Reactor Plant Simulator , 2008, IEEE Transactions on Nuclear Science.

[14]  Huiyang Li,et al.  Stages and Levels of Automation in Support of Space Teleoperations , 2014, Hum. Factors.

[15]  David B. Kaber.  Reflections on Commentaries on “Issues in Human–Automation Interaction Modeling” , 2018 .

[16]  N. Jordan.  Allocation of functions between man and machines in automated systems. , 1963 .

[17]  Nadine B. Sarter,et al.  Team Play with a Powerful and Independent Agent: Operational Experiences and Automation Surprises on the Airbus A-320 , 1997, Hum. Factors.

[18]  Mary L. Cummings,et al.  Operator scheduling strategies in supervisory control of multiple UAVs , 2007 .

[19]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[20]  Harold E. Price,et al.  The Allocation of Functions in Systems , 1985 .

[21]  Huiyang Li,et al.  Human Performance Consequences of Stages and Levels of Automation , 2014, Hum. Factors.

[22]  Catherine M. Burns,et al.  Evaluation of Ecological Interface Design for Nuclear Process Control: Situation Awareness Effects , 2008, Hum. Factors.

[23]  Raja Parasuraman,et al.  Automation in Future Air Traffic Management: Effects of Decision Aid Reliability on Controller Performance and Mental Workload , 2005, Hum. Factors.

[24]  P. Bullemer,et al.  The MPC elucidator: a case study in the design for human-automation interaction , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[25]  Heath A. Ruff,et al.  Effect of Level of Automation on Unmanned Aerial Vehicle Routing Task , 2009 .

[26]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[27]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[28]  Greg A Jamieson,et al.  Inter-rater reliability of query/probe-based techniques for measuring situation awareness , 2014, Ergonomics.

[29]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .