Evaluating NextGen Closely Space Parallel Operations Concepts with Validated Human Performance Models

ii Executive Summary The objectives of the current research are to: develop valid human performance models (HPMs) of approach and land operations; use these models to evaluate the impact of NextGen Closely Spaced Parallel Operations (CSPO) on pilot performance; and draw conclusions regarding flight deck displays and pilot roles and responsibilities for NextGen CSPO concepts. This research represents the results of the first, of a two-year effort, in which the specific goals were to develop and validate baseline HPMs of current-day RNAV and NextGen CSPO approaches and conduct 'what-if " manipulations of off-nominal scenarios. Using NASA's Man Machine Integration Design and Analysis System v5 (MIDAS v5), a high-fidelity model of a two-pilot commercial crew flying current-day area navigation (RNAV) approach and land operations was developed. The model, containing over 970 individual pilot tasks, was based on cognitive task analyses and cognitive walkthroughs conducted with commercial pilots and air traffic controllers. The current-day RNAV model was validated using a methodical, multi-dimensional approach. The model inputs, including the task trace and input parameters, were validated using focus group sessions comprised of a total of 8 commercial pilots with glass-cockpit aircraft and RNAV flying experience. The pilot-centric scenario-based cognitive walkthrough approach captured the context of operations from 10,000' to Touchdown and enabled pilots to assess the modeled tasks and identify tasks that were missing, or in the wrong sequence. The pilots also completed quantitative rating scales, which were used to validate the model input parameters for workload and visual attention. The model was refined based on the results of this input validation process. Next the model outputs, workload and visual attention, of the refined model were statistically compared to existing human-in-the-loop data. The workload model output correlated with a comparable Human-in-the-Loop (HITL) study with r 2 of .54 for overall workload. The individual workload dimensions also correlated positively with the HITL study with r 2 ranging from .55 to .94. Visual percent dwell time correlated with three HITL studies (r 2 = .99). These validation results provide confidence that the model validly represents pilot performance. Next, the validated baseline RNAV model was extended to represent the Very Closely Space Parallel Approach (VCSPA) concept developed and evaluated at NASA Ames Research Center. Two operational implementations of the VCSPA concept were evaluated: 1) VCSPA 800', with a 800' ceiling and manual flight after a DH of 650' and 2) VCSPA 200' with a 200' ceiling …

[1]  Gordon H. Robinson,et al.  Dynamics of the Eye and Head during Movement between Displays: A Qualitative and Quantitative Guide for Designers , 1979 .

[2]  Brian F. Gore,et al.  Man–machine Integration Design and Analysis System (MIDAS) v5: Augmentations, Motivations, and Directions for Aeronautics Applications , 2011 .

[3]  Brian Gore.  Human Performance: Evaluating the Cognitive Aspects , 2008 .

[4]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[5]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[6]  J H McCracken,et al.  Analyses of Selected LHX Mission Functions: Implications for Operator Workload and System Automation Goals , 1984 .

[7]  Brian F. Gore,et al.  A Computational Implementation of a Human Attention Guiding Mechanism in MIDAS v5 , 2009, HCI.

[8]  Diane K Mitchell,et al.  Mental Workload and ARL Workload Modeling Tools. , 2000 .

[9]  B. F. Gore.  An Emergent Behavior Model of Complex Human-System Performance: An Aviation Surface-Related Application , 2002 .

[10]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[11]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[12]  Gwendolyn E. Campbell,et al.  HBR Validation: Integrating Lessons Learned From Multiple Academic Disciplines, Applied Communities, and the AMBR Project , 2006 .

[13]  Beverly M. Huey,et al.  Human Performance Models for Computer-Aided Engineering , 1990 .

[14]  R. Haber,et al.  The psychology of visual perception , 1973 .

[15]  C. Wickens,et al.  SYNTHETIC VISION SYSTEMS: FLIGHTPATH TRACKING, SITUATION AWARENESS, AND VISUAL SCANNING IN AN INTEGRATED HAZARD DISPLAY , 2005 .

[16]  G. R. J. Hockey,et al.  Applied Attention Theory , 2009 .

[17]  Becky L. Hooey,et al.  Advancing the State of the Art of Human Performance Models to Improve Aviation Safety , 2007 .

[18]  Christopher D. Wickens,et al.  Attentional Models of Multitask Pilot Performance Using Advanced Display Technology , 2003, Hum. Factors.

[19]  Christopher D. Wickens,et al.  Imperfect Automation in Unmanned Aerial Vehicle Flight Control , 2003 .

[20]  Leo Gugerty.  Evidence from a Partial Report Task for Forgetting in Dynamic Spatial Memory , 1998, Hum. Factors.

[21]  David B. Hamilton,et al.  Task Analysis/Workload (TAWL) (User's Guide). Version 4.0 , 1990 .

[22]  Kevin M. Corker,et al.  System Interaction in Free Flight: A Modeling Tool Cross-Comparison , 1999 .

[23]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[24]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[25]  Savita Verma,et al.  PRELIMINARY GUIDELINES ON FLIGHT DECK PROCEDURES FOR VERY CLOSELY SPACED PARALLEL APPROACHES , 2008 .

[26]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[27]  Christopher D. Wickens,et al.  ANALYSIS OF PILOTS' MONITORING AND PERFORMANCE ON AN AUTOMATED FLIGHT DECK , 2001 .

[28]  Kevin A. Gluck,et al.  Modeling Human Behavior With Integrated Cognitive Architectures : Comparison, Evaluation, and Validation , 2006 .