Human Performance Consequences of Automated Decision Aids

Two experiments are reported that investigate to what extent performance consequences of automated aids are dependent on the distribution of functions between human and automation and on the experience an operator has with an aid. In the first experiment, performance consequences of three automated aids for the support of a supervisory control task were compared. Aids differed in degree of automation (DOA). Compared with a manual control condition, primary and secondary task performance improved and subjective workload decreased with automation support, with effects dependent on DOA. Performance costs include return-to-manual performance issues that emerged for the most highly automated aid and effects of complacency and automation bias, respectively, which emerged independent of DOA. The second experiment specifically addresses how automation bias develops over time and how this development is affected by prior experience with the system. Results show that automation failures entail stronger effects than positive experience (reliably working aid). Furthermore, results suggest that commission errors in interaction with automated aids can depend on three sorts of automation bias effects: (a) withdrawal of attention in terms of incomplete cross-checking of information, (b) active discounting of contradictory system information, and (c) inattentive processing of contradictory information analog to a “looking-but-not-seeing” effect.

[1]  Toshiyuki Inagaki,et al.  Attention and complacency , 2000 .

[2]  Christopher D. Wickens,et al.  Stages and Levels of Automation: An Integrated Meta-analysis , 2010 .

[3]  Daniel R. Ilgen,et al.  Not All Trust Is Created Equal: Dispositional and History-Based Trust in Human-Automation Interactions , 2008, Hum. Factors.

[4]  Douglas A. Wiegmann,et al.  Automation Failures on Tasks Easily Performed by Operators Undermines Trust in Automated Aids , 2003 .

[5]  K. Mosier,et al.  Human Decision Makers and Automated Decision Aids: Made for Each Other? , 1996 .

[6]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[8]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[9]  N. Sarter,et al.  Supporting decision-making and action selection under time pressure and uncertainty: The case of inflight icing , 2001 .

[10]  Jürgen S. Sauer,et al.  Effects of Sleep Deprivation and User Interface on Complex Performance: A Multilevel Analysis of Compensatory Control , 1998, Hum. Factors.

[11]  V. KuratoriumOFFISe.,et al.  A Case Study for Using a Cognitive Model of Learned Carelessness in Cognitive Engineering , 2005 .

[12]  Thomas B. Sheridan,et al.  Function allocation: algorithm, alchemy or apostasy? , 2000, Int. J. Hum. Comput. Stud..

[13]  Dietrich Manzey,et al.  Misuse of automated decision aids: Complacency, automation bias and the impact of training experience , 2008, Int. J. Hum. Comput. Stud..

[14]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.

[15]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[16]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[17]  Raja Parasuraman,et al.  Display Integration Enhances Information Sampling and Decision Making in Automated Fault Management in a Simulated Spaceflight Micro-World , 2002, Aviation, space, and environmental medicine.

[18]  Dietrich Manzey,et al.  Misuse of Diagnostic Aids in Process Control: The Effects of Automation Misses on Complacency and Automation Bias , 2008 .

[19]  P. Hancock,et al.  Human Mental Workload , 1988 .

[20]  Christopher D. Wickens,et al.  Pilots' Monitoring Strategies and Performance on Automated Flight Decks: An Empirical Study Combining Behavioral and Eye-Tracking Data , 2007, Hum. Factors.

[21]  Raja Parasuraman,et al.  Effects of Imperfect Automation on Decision Making in a Simulated Command and Control Task , 2007, Hum. Factors.

[22]  Andreas Lüdtke,et al.  A Case Study for Using a Cognitive Model of Learned Carelessness in Cognitive Engineering , 2005 .

[23]  Nadine B. Sarter,et al.  Supporting Decision Making and Action Selection under Time Pressure and Uncertainty: The Case of In-Flight Icing , 2001, Hum. Factors.

[24]  Ann M. Bisantz,et al.  The impact of cognitive feedback on judgment performance and trust with decision aids , 2008 .

[25]  Daniel G. Morrow,et al.  Expertise Differences in Attentional Strategies Related to Pilot Decision Making , 2008, Hum. Factors.

[26]  Christopher D. Wickens,et al.  Empirical Study Combining Behavioral and Eye-Tracking Data Pilots ' Monitoring Strategies and Performance on Automated Flight Decks : An , 2007 .

[27]  Cees J. H. Midden,et al.  The effects of errors on system trust, self-confidence, and the allocation of control in route planning , 2003, Int. J. Hum. Comput. Stud..

[28]  I. Rock,et al.  Inattentional blindness: Perception without attention. , 1998 .

[29]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[30]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[31]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[32]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[33]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[34]  David B. Kaber,et al.  The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task , 2004 .

[35]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.