Assessing V and V Processes for Automation with Respect to Vulnerabilities to Loss of Airplane State Awareness

Automation has contributed substantially to the sustained improvement of aviation safety by minimizing the physical workload of the pilot and increasing operational efficiency. Nevertheless, in complex and highly automated aircraft, automation also has unintended consequences. As systems become more complex and the authority and autonomy (A&A) of the automation increases, human operators become relegated to the role of a system supervisor or administrator, a passive role not conducive to maintaining engagement and airplane state awareness (ASA). The consequence is that flight crews can often come to over rely on the automation, become less engaged in the human-machine interaction, and lose awareness of the automation mode under which the aircraft is operating. Likewise, the complexity of the system and automation modes may lead to poor understanding of the interaction between a mode of automation and a particular system configuration or phase of flight. These and other examples of mode confusion often lead to mismanaging the aircraft"TM"s energy state or the aircraft deviating from the intended flight path. This report examines methods for assessing whether, and how, operational constructs properly assign authority and autonomy in a safe and coordinated manner, with particular emphasis on assuring adequate airplane state awareness by the flight crew and air traffic controllers in off-nominal and/or complex situations.

[1]  Mihriban Whitmore,et al.  NASA-STD-3001, Space Flight Human-System Standard and the Human Integration Design Handbook , 2012 .

[2]  John Rushby,et al.  Using model checking to help discover mode confusions and other automation surprises , 2002, Reliab. Eng. Syst. Saf..

[3]  Thomas D. Hardiman,et al.  A Comparative Analysis of Sagat and Sart for Evaluations of Situation Awareness , 1998 .

[4]  Amy R. Pritchett,et al.  A simulation engine to predict multi-agent work in complex, dynamic, heterogeneous systems , 2011, 2011 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[5]  David Woods,et al.  Situation Awareness: A Critical But Ill-Defined Phenomenon , 1991 .

[6]  Alice Park,et al.  Loss of Control on Approach Colgan Air, Inc., Operating as Continental Connection Flight 3407 Bombardier DHC-8-400, N200WQ Clarence Center, New York February 12, 2009 , 2010, SIGGRAPH '10.

[7]  A. H. Roscoe,et al.  A Subjective Rating Scale for Assessing Pilot Workload in Flight: A decade of Practical Use , 1990 .

[8]  Robert B. Fuld On system validity, quasi-experiments, and safety: a critique of NUREG/CR-6393 , 2007 .

[9]  C. Wickens,et al.  Situation Awareness, Mental Workload, and Trust in Automation: Viable, Empirically Supported Cognitive Engineering Constructs , 2008 .

[10]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[11]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[12]  Everett Palmer Murphi busts an altitude: a Murphi analysis of an automation surprise , 1999, Gateway to the New Millennium. 18th Digital Avionics Systems Conference. Proceedings (Cat. No.99CH37033).

[13]  K. Abbott,et al.  The interfaces between flightcrews and modern flight deck systems , 1996 .

[14]  Amy R. Pritchett,et al.  Simulation to Assess Safety in Complex Work Environments , 2013 .

[15]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[16]  Cody H. Fleming,et al.  Safety assurance in NextGen and complex transportation systems , 2013 .

[17]  Allen Newell,et al.  The Prospects for Psychological Science in Human-Computer Interaction , 1985, Hum. Comput. Interact..

[18]  Michael A. Vidulich,et al.  Testing a Subjective Metric of Situation Awareness , 1991 .

[19]  Mary L. Cummings,et al.  Human Factors Analysis of Predator B Crash , 2008 .

[20]  Amy R. Pritchett,et al.  Simulating situated work , 2011, 2011 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).