Using Computational Cognitive Modeling to Diagnose Possible Sources of Aviation Error

We present a computational model of a closed-loop, pilot-aircraft-visual scene-taxiway system created to shed light on possible sources of taxi error. The creation of the cognitive aspects of the model with ACT-R (Adaptive Control of Thought-Rational) required us to conduct studies with subject matter experts to identify the experiential adaptations pilots bring to taxiing. Five decision strategies were found, ranging from cognitively intensive but precise to fast and frugal but robust. We provide evidence for the model by comparing its behavior to a National Aeronautics and Space Administration Ames Research Center simulation of Chicago O'Hare surface operations. Decision horizons were highly variable; the model selected the most accurate strategy given the time available. We found a signature in the simulation data of the use of globally robust heuristics to cope with short decision horizons as revealed by the errors occurring most frequently at atypical taxiway geometries or clearance routes. These data provided empirical support for the model.

[1]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[2]  Scott A. Shappell,et al.  Human Factors Analysis of Postaccident Data: Applying Theoretical Taxonomies of Human Error , 1997 .

[3]  Jens Rasmussen,et al.  What can be Learned from Human Error Reports , 1980 .

[4]  Alex Kirlik,et al.  Modes in Human-Machine Systems: Constructs, Representation, and Classification , 1999 .

[5]  Alex Kirlik,et al.  MODES IN HUMAN-MACHINE SYSTEMS: REVIEW, CLASSIFICATION, AND APPLICATION , 1999 .

[6]  Ann M. Bisantz,et al.  Measuring the Fit between Human Judgments and Automated Alerting Algorithms: A Study of Collision Detection , 2003, Hum. Factors.

[7]  Alex Kirlik,et al.  Supervisory control in a dynamic and uncertain environment: a process model of skilled human-environment interaction , 1993, IEEE Trans. Syst. Man Cybern..

[8]  Robert L. Helmreich,et al.  Group interaction and flight crew performance , 1988 .

[9]  J. Shaoul.  Human Error , 1973, Nature.

[10]  Anthony D. Andre,et al.  Integration of Cockpit Displays for Surface Operations: The Final Stage of a Human-Centered Design Approach , 2000 .

[11]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[12]  Victor H. L. Cheng,et al.  A study of aircraft taxi performance for enhancing airport surface traffic control , 2001, IEEE Trans. Intell. Transp. Syst..

[13]  Anthony D. Andre,et al.  Taxiway Navigation and Situation Awareness (T-NASA) System: Problem, Design Philosophy, and Description of an Integrated Display Suite for Low-Visibility Airport Surface Operations , 1996 .

[14]  Christopher D. Wickens,et al.  A Computational Model of Attention/Situation Awareness , 2002 .

[15]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[16]  Jens Rasmussen,et al.  Cognitive engineering, a new profession? , 1988 .

[17]  D. Wiegmann,et al.  Pilots ’ Decisions to Continue Visual Flight Rules ( VFR ) Flight into Adverse Weather : Effects of Distance Traveled and Flight Experience , 2001 .

[18]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[19]  Stephen Deutsch,et al.  Modeling Human Error in a Real-World Teamwork Environment , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[20]  David Woods,et al.  Behind human error : cognitive systems, computers, and hindsight : state-of-the-art report , 1994 .

[21]  Kevin M. Corker,et al.  Increasing Aviation Safety Using Human Performance Modeling Tools : An Air Man-machine Integration Design and Analysis System Application , 2000 .

[22]  Terry Connolly,et al.  Action as a Fast and Frugal Heuristic , 1999, Minds and Machines.

[23]  Alex Kirlik,et al.  The Ecological Expert: acting to create information to guide action , 1998, Proceedings Fourth Annual Symposium on Human Interaction with Complex Systems.

[24]  Erik Hollnagel.  Looking for errors of omission and commission or The Hunting of the Snark revisited , 2000, Reliab. Eng. Syst. Saf..

[25]  A. Smith,et al.  Development of Airport Surface Required Navigation Performance (RNP) , 1999 .

[26]  Henning Andersen,et al.  Tasks, errors, and mental models , 1988 .

[27]  Dario D. Salvucci.  Predicting the effects of in-car interface use on driver performance: an integrated model approach , 2001, Int. J. Hum. Comput. Stud..

[28]  Nadine B. Sarter,et al.  Automation Management Strategies: Pilot Preferences and Operational Experiences , 2000 .

[29]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method , 1998 .

[30]  Becky L. Hooey,et al.  A Post-Hoc Analysis of Navigation Errors During Surface Operations: Identification of Contributing Factors and Mitigating Solutions , 2002 .