Learning the Task Management Space of an Aircraft Approach Model

Validating models of airspace operations is a particular challenge. These models are often aimed at finding and exploring safety violations, and aim to be accurate representations of real-world behavior. However, the rules governing the behavior are quite complex: nonlinear physics, operational modes, human behavior, and stochastic environmental concerns all determine the responses of the system. In this paper, we present a study on aircraft runway approaches as modeled in Georgia Tech's Work Models that Compute (WMC) simulation. We use a new learner, Genetic-Active Learning for Search-Based Software Engineering (GALE) to discover the Pareto frontiers defined by cognitive structures. These cognitive structures organize the prioritization and assignment of tasks of each pilot during approaches. We discuss the benefits of our approach, and also discuss future work necessary to enable uncertainty quantification.

[1]  Becky L. Hooey,et al.  Requirements for a Design Rationale Capture Tool to Support NASA's Complex Systems , 2007 .

[2]  Michael C. Dorneich,et al.  Towards a Characterization of Adaptive Systems: a Framework for Researchers and System Designers , 2017 .

[3]  Robert B. Gramacy,et al.  tgp: An R Package for Bayesian Nonstationary, Semiparametric Nonlinear Regression and Design by Treed Gaussian Process Models , 2007 .

[4]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[5]  Robert Bartle,et al.  The Elements of Real Analysis , 1977, The Mathematical Gazette.

[6]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[7]  Amy R. Pritchett,et al.  A simulation engine to predict multi-agent work in complex, dynamic, heterogeneous systems , 2011, 2011 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[8]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[9]  Aravind Seshadri,et al.  A FAST ELITIST MULTIOBJECTIVE GENETIC ALGORITHM: NSGA-II , 2000 .

[10]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[11]  Charles A. Micchelli,et al.  On Spectral Learning , 2010, J. Mach. Learn. Res..

[12]  Jerome Le Ny,et al.  Feedback control of the National Airspace System to mitigate weather disruptions , 2010, 49th IEEE Conference on Decision and Control (CDC).

[13]  Nagiza F. Samatova,et al.  On FastMap and the convex hull of multivariate data: toward fast and robust dimension reduction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Yuning He,et al.  Variable-length Functional Output Prediction and Boundary Detection for an Adaptive Flight Control Simulator , 2012 .

[15]  L. Geppert,et al.  Lost Radio Contact Leaves Pilots on Their Own , 2004, IEEE Spectrum.

[16]  Alexander V. Lotov,et al.  Interactive Decision Maps: Approximation and Visualization of Pareto Frontier , 2004 .

[17]  Yuning He,et al.  Validating an Air Traffic Management Concept of Operation using Statistical Modeling , 2013 .

[18]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[19]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[20]  Amy R. Pritchett,et al.  Hybrid-system simulation for national airspace system safety analysis , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[21]  Philip E. Gill,et al.  Practical optimization , 1981 .

[22]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[23]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[24]  Tim Menzies,et al.  Applications of Simulation and AI Search: Assessing the Relative Merits of Agile vs Traditional Software Development , 2009, 2009 IEEE/ACM International Conference on Automated Software Engineering.

[25]  Eugen Tarnow,et al.  There is no capacity limited buffer in the Murdock (1962) free recall data , 2010, Cognitive Neurodynamics.

[26]  So Young Kim,et al.  Model-based metrics of human-automation function allocation in complex work environments , 2011 .

[27]  John Platt,et al.  FastMap, MetricMap, and Landmark MDS are all Nystrom Algorithms , 2005, AISTATS.

[28]  Karen M. Feigh,et al.  Modeling the Work of Humans and Automation in Complex Operations , 2013 .

[29]  H. W. Rittel,et al.  Second-generation design methods , 1984 .

[30]  John H. Blakelock,et al.  Automatic control of aircraft and missiles , 1965 .

[31]  Andreas Krause,et al.  Active Learning for Multi-Objective Optimization , 2013, ICML.

[32]  Christos Faloutsos,et al.  FastMap: a fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets , 1995, SIGMOD '95.