The Impact of Automation Reliability and Operator Fatigue on Performance and Reliance

Reliability of automation is known to influence operator reliance on automation. What is less understood is how the influence of reliability and the effects of operator fatigue might interact. The present study investigated the impact of automation reliability on accuracy and reliance and how this impact changes with level of fatigue during simulated multiple unmanned aerial vehicle (UAV) operation. Participants (N = 131) completed a two-hour simulated multi-UAV mission assisted by an automated decision making aid of either high or low reliability. A decrease in subjective task engagement and performance over time marked the induction of passive fatigue by the mission. Participants were more trusting in the high reliability condition than in the low reliability condition. Finally, reliance decreased with time at any reliability, but a significant interaction between reliability and time on task indicated that the decrease was of smaller magnitude when the automation was reliable.

[1]  G. Robert J. Hockey,et al.  Performance in a Complex Multiple-Task Environment during a Laboratory-Based Simulation of Occasional Night Work , 2003, Hum. Factors.

[2]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[3]  S. Gregor,et al.  Measuring Human-Computer Trust , 2000 .

[4]  Christopher D. Wickens,et al.  Humans: Still Vital After All These Years of Automation , 2008, Hum. Factors.

[5]  Peter A. Hancock,et al.  ACTIVE AND PASSIVE FATIGUE STATES , 2001 .

[6]  Raymond E King,et al.  Psychological Attributes Critical to the Performance of MQ-1 Predator and MQ-9 Reaper U.S. Air Force Sensor Operators , 2010 .

[7]  Heath A. Ruff,et al.  Video Game Experience and Gender as Predictors of Performance and Stress During Supervisory Control of Multiple Unmanned Aerial Vehicles , 2015 .

[8]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[9]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[10]  Gerald Matthews,et al.  The Handbook of Operator Fatigue , 2012 .

[11]  Heath A. Ruff,et al.  Automation-Level Transference Effects in Simulated Multiple Unmanned Aerial Vehicle Control , 2011 .

[12]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[13]  Joel S. Warm,et al.  Vigilance, Workload, and Stress , 2018 .

[14]  M R Rosekind,et al.  Managing fatigue in operational settings 2: An integrated approach. , 1997, Hospital topics.

[15]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[16]  Peter A. Hancock,et al.  An Overview of Operator Fatigue , 2017 .

[17]  Mary L. Cummings,et al.  The Impact of Intelligent Aiding for Multiple Unmanned Aerial Vehicle Schedule Management , 2007 .

[18]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.

[19]  Catherine Neubauer,et al.  Fatigue and Voluntary Utilization of Automation in Simulated Driving , 2012, Hum. Factors.

[20]  Edward M. Hitchcock,et al.  Active and passive fatigue in simulated driving: discriminating styles of workload regulation and their safety impacts. , 2013, Journal of experimental psychology. Applied.

[21]  Mary L. Cummings,et al.  Boredom and Distraction in Multiple Unmanned Vehicle Supervisory Control , 2013, Interact. Comput..