Measuring the Impact of NextGen Operating Concepts for Separation Assurance on Pilot Situation Awareness and Workload

We determined the effect of NextGen concepts of operation for separation assurance on pilot situation awareness and workload using an online probe technique. We also evaluated the probe technique for sensitivity, diagnosticity, and validity with respect to different NextGen separation assurance operating concepts. These concepts allocated responsibility for conflict detection and resolution to either pilots, air traffic controllers, or an automated, ground-based, conflict detection and resolution agent. Probe queries were developed to fit in 1 of 3 categories: traffic conflicts, aircraft or airspace status, or commands and communications. We determined that pilot situation awareness of conflict information was highest when the pilot was responsible for separation assurance; workload was minimally affected. Moreover, the changes in pilot awareness of task-specific information can be determined using this online probe technique. Evidence for the reliability and validity of our probe technique is also provided.

[1]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Anthony Tang,et al.  A Simulation Evaluation of a Human-Centered Approach to Flight Deck Procedures and Automation for en Route Free Maneuvering , 2005 .

[3]  Kim-Phuong L. Vu,et al.  Situation Awareness, Workload, and Performance in Midterm Nextgen: Effect of Dynamic Variations in Aircraft Equipage Levels , 2011 .

[4]  Christopher D. Wickens,et al.  Humans: Still Vital After All These Years of Automation , 2008, Hum. Factors.

[5]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[6]  Guy H. Walker,et al.  Distributed Situation Awareness: Theory, Measurement and Application to Teamwork , 2009 .

[7]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[8]  Steven J. Landry.  Effectiveness of 3D cockpit displays of weather on pilot performance in NextGen airspace , 2012 .

[9]  Kim-Phuong L. Vu,et al.  Situation Awareness, Workload, and Performance in Midterm Nextgen: Effect of Variations in Aircraft Equipage Levels Between Scenarios , 2011 .

[10]  Shimon Y. Nof,et al.  Cultural Factors in Systems Design: Decision Making and Action , 2011 .

[11]  Kim-Phuong L. Vu,et al.  Impact of Conflict Avoidance Responsibility Allocation on Pilot Workload in a Distributed Air Traffic Management System , 2010 .

[12]  Kim-Phuong L. Vu,et al.  Predicting Perceived Situation Awareness of Low Altitude Aircraft in Terminal Airspace Using Probe Questions , 2007, HCI.

[13]  Kenneth R. Allendoerfer,et al.  Effect of Free Flight Conditions on Controller Performance, Workload, and Situation Awareness , 1997 .

[14]  J. Mercer,et al.  Distributed air/ground traffic management: results of preliminary human-in-the-loop simulation , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[15]  Lynne Martin,et al.  Functional Allocation for Ground-Based Automated Separation Assurance in NextGen , 2010 .

[16]  Parimal Kopardekar,et al.  Shared-Separation : Empirical Results and Theoretical Implications , 2001 .

[17]  Steven J. Landry,et al.  Separation Assurance and Collision Avoidance Concepts for the Next Generation Air Transportation System , 2009, HCI.

[18]  Guy H. Walker,et al.  Human Factors Methods: A Practical Guide for Engineering and Design , 2012 .

[19]  Joel Lachter,et al.  Pilot Performance in Trajectory-Based Operations Under Concepts of Operation That Vary Separation Responsibility Across Pilots, Air Traffic Controllers, and Automation , 2012, Int. J. Hum. Comput. Interact..

[20]  Kim-Phuong L. Vu,et al.  Assessing the Situation Awareness of Pilots Engaged in Self Spacing , 2008 .

[21]  Kim-Phuong L. Vu,et al.  Mechanisms for the acquisition of situation awareness in situated agents , 2012 .

[22]  Vernol Battiste,et al.  Development and Integration of a Human-Centered Volumetric Cockpit Situation Display for Distributed Air-Ground Operations , 2005 .

[23]  Robert W. Proctor,et al.  Human factors in simple and complex systems , 1993 .

[24]  Parimal Kopardekar,et al.  Distributed Air/Ground Traffic Management - Technology and Concept Demonstration Report , 2002 .

[25]  Raja Parasuraman,et al.  Transitioning to Future Air Traffic Management: Effects of Imperfect Automation on Controller Attention and Performance , 2010, Hum. Factors.

[26]  Raja Parasuraman,et al.  The Role of the Air Traffic Controller in Future Air Traffic Management: An Empirical Study of Active Control versus Passive Monitoring , 2001, Hum. Factors.

[27]  Raja Parasuraman,et al.  Automation in Future Air Traffic Management: Effects of Decision Aid Reliability on Controller Performance and Mental Workload , 2005, Hum. Factors.

[28]  Carol A. Manning,et al.  AIRCRAFT IMPORTANCE AND ITS RELEVANCE TO SITUATION AWARENESS , 1998 .

[29]  Francis T. Durso,et al.  En Route Operational Errors and Situational Awareness , 1998 .

[30]  Lynne Martin,et al.  Toward Automated Air Traffic Control—Investigating a Fundamental Paradigm Shift in Human/Systems Interaction , 2012, Int. J. Hum. Comput. Interact..

[31]  Rudollph A. Aquilina.  Airspace Systems Program - NextGen Concepts and Technology Development (CTD) Project NextGen Systems Analysis, Integration, and Evaluation (SAIE) Project , 2012 .

[32]  Thomas Prevot.  Exploring the Many Perspectives of Distributed Air Traffic Management: The Multi Aircraft Control System MACS , 2002 .

[33]  Debra Jones,et al.  Situation Awareness Measurement and the Situation Awareness Global Assessment Technique , 2004 .

[34]  Andrew R. Dattel,et al.  Does Situation Awareness Add to the Validity of Cognitive Tests? , 2006, Hum. Factors.

[35]  Pamela S Della Rocco,et al.  Air Traffic Control Specialist Decision Making and Strategic Planning – A Field Survey , 2001 .

[36]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.