False Alerts in Air Traffic Control Conflict Alerting System: Is There a “Cry Wolf” Effect?

Objective: The aim is to establish the extent to which the high false-alarm rate of air traffic control midair conflict alerts is responsible for a “cry wolf” effect—where true alerts are not responded to and all alerts are delayed in their response. Background: Some aircraft collisions have been partly attributed to the cry wolf effect, and in other domains (health care and systems monitoring), there is a causal connection between false-alarm rate and cry wolf behavior. We hypothesized that a corresponding relationship exists in air traffic control (ATC). Method: Aircraft track and alert system behavior data surrounding 495 conflict alerts were analyzed to identify true and false alerts, trajectory type, and controller behavior. Forty-five percent of the alerts were false, ranging from 0.28 to 0.58. Results: Although centers with more false alerts contributed to more nonresponses, there was no evidence that these were nonresponses to true alerts or that response times were delayed in those centers. Instead, controllers showed desirable anticipatory behavior by issuing trajectory changes prior to the alert. Those trajectory pairs whose conflicts were more difficult to visualize induced more reliance on, and less compliance with, the alerting system. Conclusion: The high false-alarm rate does not appear to induce cry wolf behavior in the context of en route ATC conflict alerts. Application: There is no need to substantially modify conflict alert algorithms, but the conflict alert system may be modified to address difficult-to-visualize conflicts.

[1]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[2]  Neville A. Stanton,et al.  Alarm-initiated activities: an analysis of alarm handlingby operators using text-based alarm systems in supervisory control systems , 1995 .

[3]  Ferne Friedman-Berg,et al.  Nuisance Alerts in Operational ATC Environments: Classification and Frequencies , 2008 .

[4]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[5]  S. Breznitz Cry Wolf: The Psychology of False Alarms , 1984 .

[6]  John A. Swets,et al.  System operator response to warnings of danger: A laboratory investigation of the effects of the predictive value of a warning on human response time. , 1995 .

[7]  David Woods,et al.  The alarm problem and directed attention in dynamic fault management , 1995 .

[8]  Christopher D. Wickens,et al.  The benefits of imperfect diagnostic automation: a synthesis of the literature , 2007 .

[9]  Mariea C. Dunn,et al.  Behavioural implications of alarm mistrust as a function of task workload , 2000, Ergonomics.

[10]  Joachim Meyer,et al.  Why Better Operators Receive Worse Warnings , 2002, Hum. Factors.

[11]  David M. Schultz,et al.  False Alarms and Close Calls: A Conceptual Model of Warning Accuracy , 2007 .

[12]  F. Jacob Seagull,et al.  Organizational-historical analysis of the "failure to respond to alarm" problems , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Ferne Friedman-Berg,et al.  Human Factors Analysis of Safety Alerts in Air Traffic Control. , 2007 .

[14]  Douglas A. Wiegmann,et al.  Automation Failures on Tasks Easily Performed by Operators Undermines Trust in Automated Aids , 2003 .

[15]  Joachim Meyer,et al.  Conceptual Issues in the Study of Dynamic Hazard Warnings , 2004, Hum. Factors.

[16]  Penelope M. Sanderson,et al.  Anesthesia Alarms in Context: An Observational Study , 2001, Hum. Factors.

[17]  David Shinar,et al.  New Alternative Methods of Analyzing Human Behavior in Cued Target Acquisition , 2003, Hum. Factors.

[18]  Christopher D. Wickens,et al.  Flight to the Future: Human Factors in Air Traffic Control Edited by Christopher D. Wickens, Anne S. Mavor, & James P. McGee 1997, 368 pages, $44.95. Washington, DC: National Academy Press ISBN 0-309-05637-3 , 1997 .

[19]  Joachim Meyer,et al.  Effects of Warning Validity and Proximity on Responses to Warnings , 2001, Hum. Factors.

[20]  Christopher D Wickens,et al.  Effects of conflict alerting system reliability and task difficulty on pilots' conflict detection with cockpit display of traffic information , 2007, Ergonomics.

[21]  Juliana Goh,et al.  Pilot Dependence on Imperfect Diagnostic Automation in Simulated UAV Flights: An Attentional Visual Scanning Analysis. , 2005 .

[22]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[23]  James P. Bliss,et al.  Investigation of Alarm-Related Accidents and Incidents in Aviation , 2003 .

[24]  Christopher D. Wickens,et al.  Automation Reliability in Unmanned Aerial Vehicle Control: A Reliance-Compliance Model of Automation Dependence in High Workload , 2006, Hum. Factors.

[25]  Raja Parasuraman,et al.  Human-Computer Monitoring , 1987 .

[26]  Christopher D. Wickens,et al.  The Future of Air Traffic Control: Human Operators and Automation , 1998 .

[27]  Christopher D. Wickens,et al.  Auditory Preemption versus Multiple Resources: Who Wins in Interruption Management? , 2005 .

[28]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[29]  S. Lawless Crying wolf: False alarms in a pediatric intensive care unit , 1994, Critical care medicine.

[30]  Christopher D. Wickens,et al.  Display Dimensionality and Conflict Geometry Effects on Maneuver Preferences for Resolving In-Flight Conflicts , 2008, Hum. Factors.

[31]  Catherine M. Burns Towards proactive monitoring in the petrochemical industry , 2006 .

[32]  Christopher D. Wickens,et al.  On the Independence of Compliance and Reliance: Are Automation False Alarms Worse Than Misses? , 2007, Hum. Factors.

[33]  Stephen Rice Examining Single- and Multiple-Process Theories of Trust in Automation , 2009, The Journal of general psychology.

[34]  James K. Kuchar,et al.  A review of conflict detection and resolution modeling methods , 2000, IEEE Trans. Intell. Transp. Syst..

[35]  Robert D. Sorkin,et al.  FORUM: Why are people turning off our alarms? , 1988 .

[36]  Joachim Meyer,et al.  Defining and measuring physicians' responses to clinical reminders , 2009, J. Biomed. Informatics.

[37]  Board on Human-Systems Integration The Future of Air Traffic Control: Human Operators and Automation , 1998 .

[38]  Monica N. Lees,et al.  The influence of distraction and driving context on driver response to imperfect collision warning systems , 2007, Ergonomics.