Data-Driven Modeling of Air Traffic Flows for Advanced Air Traffic Management

The Air Traffic Management (ATM) system enables air transportation by ensuring a safe and orderly air traffic flow. As the air transport demand has grown, ATM has become increasingly challenging, resulting in high levels of congestion, flight delays and environmental impacts. To sustain the industry growth foreseen and enable more efficient air travel, it is important to develop mechanisms for better understanding and predicting the air traffic flow behavior and performance in order to assist human decision-makers to deliver improved airspace design and traffic management solutions. This thesis presents a data-driven approach to modeling air traffic flows and analyzes its contribution to supporting system level ATM decision-making. A data analytics framework is proposed for high-fidelity characterization of air traffic flows from large-scale flight tracking data. The framework incorporates a multi-layer clustering analysis to extract spatiotemporal patterns in aircraft movement towards the identification of trajectory patterns and traffic flow patterns. The outcomes and potential impacts of this framework are demonstrated with a detailed characterization of terminal area traffic flows in three representative multi-airport (metroplex) systems of the global air transportation system: New York, Hong Kong and Sao Paulo. As a descriptive tool for systematic analysis of the flow behavior, the framework allows for cross-metroplex comparisons of terminal airspace design, utilization and traffic performance. Novel quantitative metrics are created to summarize metroplex efficiency, capacity and predictability. The results reveal several structural, operational and performance differences between the metroplexes analyzed and highlight varied action areas to improve air traffic operations at these systems. Finally, the knowledge derived from flight trajectory data analytics is leveraged to develop predictive and prescriptive models for metroplex configuration and capacity planning decision support. Supervised learning methods are used to create prediction models capable of translating weather forecasts into probabilistic forecasts of the metroplex traffic flow structure and airport capacity for strategic time horizons. To process these capacity forecasts and assist the design of traffic flow management strategies, a new optimization model for capacity allocation is developed. The proposed models are found to outperform currently used methods in predicting throughput performance at the New York airports. Moreover, 3 when used to prescribe optimal Airport Acceptance Rates in Ground Delay Programs, an overall delay reduction of up to 9.7% is achieved. Thesis Supervisor: R. John Hansman Title: T. Wilson Professor of Aeronautics and Astronautics

[1]  Remedios,et al.  COMMISSION OF THE EUROPEAN COMMUNITIES , 1601 .

[2]  Gordon F. Newell,et al.  Airport Capacity and Delays , 1979 .

[3]  韓國航空大學 航空 械工學科 美聯邦航空廳(Federal Aviation Administration)의 航空機 製作檢査 制度의 現況 , 1979 .

[4]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[5]  Eugene P. Gilbo,et al.  Airport capacity: representation, estimation, optimization , 1993, IEEE Trans. Control. Syst. Technol..

[6]  Amedeo R. Odoni,et al.  Solving Optimally the Static Ground-Holding Policy Problem in Air Traffic Control , 1993, Transp. Sci..

[7]  Amedeo R. Odoni,et al.  Strategic Flow Management for Air Traffic Control , 1993, Oper. Res..

[8]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[9]  Amedeo R. Odoni,et al.  Dynamic solution to the ground-holding problem in air traffic control , 1994 .

[10]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[11]  Dimitris Bertsimas,et al.  The Air Traffic Flow Management Problem with Enroute Capacities , 1998, Oper. Res..

[12]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[13]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[14]  Padhraic Smyth,et al.  Trajectory clustering with mixtures of regression models , 1999, KDD '99.

[15]  Dimitris Bertsimas,et al.  The Traffic Flow Management Rerouting Problem in Air Traffic Control: A Dynamic Network Flow Approach , 2000, Transp. Sci..

[16]  David Abramson,et al.  Scheduling Aircraft Landings - The Static Case , 2000, Transp. Sci..

[17]  Vu Duong,et al.  A constraint-programming formulation for dynamic airspace sectorization , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[18]  Dimitrios Gunopulos,et al.  Discovering similar multidimensional trajectories , 2002, Proceedings 18th International Conference on Data Engineering.

[19]  Amedeo R. Odoni,et al.  A Stochastic Integer Program with Dual Network Structure and Its Application to the Ground-Holding Problem , 2003, Oper. Res..

[20]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[21]  Matteo Ignaccolo,et al.  A Simulation model for airport capacity and delay analysis , 2003 .

[22]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[23]  Kapil Sheth,et al.  Aggregate Flow Model for Air-Traffic Management , 2004 .

[24]  Gerald M. Diaz,et al.  Computer-Aided Eulerian Air Traffic Flow Modeling and Predictive Control , 2004 .

[25]  Tieniu Tan,et al.  Similarity based vehicle trajectory clustering and anomaly detection , 2005, IEEE International Conference on Image Processing 2005.

[26]  Nicolai Meinshausen,et al.  Quantile Regression Forests , 2006, J. Mach. Learn. Res..

[27]  Jean-Philippe Thiran,et al.  Counting Pedestrians in Video Sequences Using Trajectory Clustering , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Craig Wanke,et al.  Predicting Sector Capacity for TFM Decision Support , 2006 .

[29]  Mark Hansen,et al.  A Dynamic Stochastic Model for the Single Airport Ground Holding Problem , 2007, Transp. Sci..

[30]  Jae-Gil Lee,et al.  Trajectory clustering: a partition-and-group framework , 2007, SIGMOD '07.

[31]  Padhraic Smyth,et al.  Probabilistic clustering of extratropical cyclones using regression mixture models , 2007 .

[32]  Mark Hansen,et al.  Scenario-based air traffic flow management: From theory to practice , 2008 .

[33]  Philippe A. Bonnefoy,et al.  Scalability of the Air Transportation System and Development of Multi-Airport Systems: A Worldwide Perspective , 2008 .

[34]  S. Rathinam,et al.  AN OPTIMIZATION MODEL FOR REDUCING AIRCRAFT TAXI TIMES AT THE DALLAS FORT WORTH INTERNATIONAL AIRPORT , 2008 .

[35]  A. Bayen,et al.  Multicommodity Eulerian-Lagrangian Large-Capacity Cell Transmission Model for En Route Traffic , 2008 .

[36]  M. Drew Analysis of an optimal sector design method , 2008, 2008 IEEE/AIAA 27th Digital Avionics Systems Conference.

[37]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[38]  Vladimir Vovk,et al.  A tutorial on conformal prediction , 2007, J. Mach. Learn. Res..

[39]  Michael Bloem,et al.  Algorithms for Combining Airspace Sectors , 2009 .

[40]  Adric Eckstein,et al.  Automated flight track taxonomy for measuring benefits from performance based navigation , 2009, 2009 Integrated Communications, Navigation and Surveillance Conference.

[41]  Cynthia Barnhart,et al.  The Global Airline Industry , 2009 .

[42]  Chris Brinton,et al.  Airspace Sectorization by Dynamic Density , 2009 .

[43]  Min Xue,et al.  Airspace Sector Redesign Based on Voronoi Diagrams , 2008, J. Aerosp. Comput. Inf. Commun..

[44]  John-Paul Clarke,et al.  Contrast and Comparison of Metroplex Operations An Air Traffic Management Study of Atlanta, Los Angeles, New York, and Miami , 2009 .

[45]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[46]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[47]  M. Robinson,et al.  The Route Availability Planning Tool (RAPT): Evaluation of Departure Management Decision Support in New York during the 2008 Convective Weather Season* , 2009 .

[48]  Frank Rehm,et al.  Clustering of Flight Tracks , 2010 .

[49]  Joseph S. B. Mitchell,et al.  Geometric algorithms for optimal airspace design and air traffic controller workload balancing , 2008, JEAL.

[50]  David Gianazza,et al.  Forecasting workload and airspace configuration with neural networks and tree search methods , 2010, Artif. Intell..

[51]  Hamsa Balakrishnan,et al.  Algorithms for Scheduling Runway Operations Under Constrained Position Shifting , 2010, Oper. Res..

[52]  R. John Hansman,et al.  Capacity Improvement Potential for the New York Metroplex System , 2010 .

[53]  Ilia Nouretdinov,et al.  Prediction with Confidence Based on a Random Forest Classifier , 2010, AIAI.

[54]  Joseph S. B. Mitchell Flow Conforming Operational Airspace Sector Design , 2010 .

[55]  Joshua Zhexue Huang,et al.  Mining Trajectory Corridors Using Fréchet Distance and Meshing Grids , 2010, PAKDD.

[56]  Rikard Laxhammar,et al.  Conformal prediction for distribution-independent anomaly detection in streaming vessel data , 2010, StreamKDD '10.

[57]  Inseok Hwang,et al.  Graph-Based Algorithm for Dynamic Airspace Configuration , 2010 .

[58]  Yoon C. Jung,et al.  Managing departure aircraft release for efficient airport surface operations , 2010 .

[59]  Joseph S. B. Mitchell,et al.  Algorithmic Traffic Abstraction and its Application to NextGen Generic Airspace , 2010 .

[60]  Eric Feron,et al.  Trajectory Clustering and an Application to Airspace Monitoring , 2010, IEEE Transactions on Intelligent Transportation Systems.

[61]  Lara Cook,et al.  A probabilistic airport capacity model for improved ground delay program planning , 2011, 2011 IEEE/AIAA 30th Digital Avionics Systems Conference.

[62]  John-Paul Clarke,et al.  Runway Operations Optimization in the Presence of Uncertainties , 2011 .

[63]  Amedeo R. Odoni,et al.  An Integer Optimization Approach to Large-Scale Air Traffic Flow Management , 2011, Oper. Res..

[64]  Amedeo R. Odoni,et al.  Optimal Selection of Airport Runway Configurations , 2011, Oper. Res..

[65]  Siddhartha Bhattacharyya,et al.  Confidence in predictions from random tree ensembles , 2011, 2011 IEEE 11th International Conference on Data Mining.

[66]  Mark Hansen,et al.  Generating Probabilistic Capacity Profiles from weather forecast: A design-of-experiment approach , 2011 .

[67]  Daniel Murphy,et al.  Predicting Runway Configurations at Airports , 2012 .

[68]  Laureano F. Escudero,et al.  On air traffic flow management with rerouting. Part II: Stochastic case , 2012, Eur. J. Oper. Res..

[69]  Hamsa Balakrishnan,et al.  Identification of Robust Terminal-Area Routes in Convective Weather , 2012, Transp. Sci..

[70]  John-Paul Clarke,et al.  Evaluating Concepts for Operations in Metroplex Terminal Area Airspace , 2012 .

[71]  Laureano F. Escudero,et al.  On air traffic flow management with rerouting. Part I: Deterministic case , 2012, Eur. J. Oper. Res..

[72]  Karla Hoffman,et al.  Estimating domestic US airline cost of delay based on European model , 2013 .

[73]  Michael O. Ball,et al.  Consensus-Building Mechanism for Setting Service Expectations in Air Traffic Flow Management , 2013 .

[74]  Olatz Arbelaitz,et al.  An extensive comparative study of cluster validity indices , 2013, Pattern Recognit..

[75]  Aki Vehtari,et al.  GPstuff: Bayesian modeling with Gaussian processes , 2013, J. Mach. Learn. Res..

[76]  Hamsa Balakrishnan,et al.  Characterization and prediction of air traffic delays , 2014 .

[77]  Hamsa Balakrishnan,et al.  Dynamic Control of Airport Departures: Algorithm Development and Field Evaluation , 2014, IEEE Transactions on Intelligent Transportation Systems.

[78]  Henrik Boström,et al.  Regression conformal prediction with random forests , 2014, Machine Learning.

[79]  Bala G. Chandran,et al.  Optimal Large-Scale Air Traffic Flow Management , 2014 .

[80]  Yonggang Wen,et al.  Toward Scalable Systems for Big Data Analytics: A Technology Tutorial , 2014, IEEE Access.

[81]  Eric Feron,et al.  Data-Based Modeling and Optimization of En Route Traffic , 2014 .

[82]  Carlos Müller,et al.  Control-based optimization approach for aircraft scheduling in a terminal area with alternative arrival routes , 2015 .

[83]  K. Mease,et al.  Strategic Air Traffic Planning with Frechet Distance Aggregation and Rerouting , 2015 .

[84]  Hamsa Balakrishnan,et al.  Predicting Airport Runway Configuration: A Discrete-Choice Modeling Approach , 2015 .

[85]  Hamsa Balakrishnan,et al.  Data-Driven Modeling of the Airport Configuration Selection Process , 2015, IEEE Transactions on Human-Machine Systems.

[86]  Hani S. Mahmassani,et al.  Spatial and Temporal Characterization of Travel Patterns in a Traffic Network Using Vehicle Trajectories , 2015 .

[87]  Dimitris Bertsimas,et al.  The Analytics Edge , 2016 .

[88]  Paul U. Lee,et al.  Integrated Demand Management: Coordinating Strategic and Tactical Flow Scheduling Operations , 2016 .

[89]  Yi Liu,et al.  Incorporating Predictability Into Cost Optimization for Ground Delay Programs , 2016, Transp. Sci..

[90]  Paul U. Lee,et al.  Analysis of the Capacity Potential of Current Day and Novel Configurations for New York's John F. Kennedy Airport , 2016 .

[91]  Mykel J. Kochenderfer,et al.  Probabilistic Airport Acceptance Rate Prediction , 2016 .

[92]  Rong Wen,et al.  Spatio-temporal route mining and visualization for busy waterways , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[93]  Michael P. Matthews,et al.  Heterogeneous Convective Weather Forecast Translation into Airspace Permeability with Prediction Intervals , 2016 .

[94]  Jessica Fuerst,et al.  Airport Systems Planning Design And Management , 2016 .

[95]  Cynthia Barnhart,et al.  Airline-Driven Performance-Based Air Traffic Management: Game Theoretic Models and Multicriteria Evaluation , 2016, Transp. Sci..

[96]  Jacob Bryan Avery Data-driven modeling of the airport runway configuration selection process using maximum likelihood discrete-choice models , 2016 .

[97]  Arnab Majumdar,et al.  Robust identification of air traffic flow patterns in Metroplex terminal areas under demand uncertainty , 2017 .

[98]  James C. Jones,et al.  Predicting Airport Capacity in the Presence of Winds , 2017 .

[99]  A. Bombelli,et al.  Analysis of convective weather impact on pre-departure routing of flights from Fort Worth Center to New York Center , 2017 .

[100]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[101]  Kenneth D. Mease,et al.  Automated Route Clustering for Air Traffic Modeling , 2017 .

[102]  M. Ball,et al.  Service Level Expectation Setting for Air Traffic Flow Management : Practical Challenges and Benefits Assessment , 2017 .

[103]  Yashovardhan Sushil Chati Statistical modeling of aircraft engine fuel burn , 2018 .

[104]  Chiwei Yan,et al.  Airline-Driven Ground Delay Programs: A Benefits Assessment , 2018 .

[105]  Naomi S. Altman,et al.  Quantile regression , 2019, Nature Methods.