A comparative analysis of models for predicting delays in air traffic networks

In this paper, we compare the performance of different approaches to predicting delays in air traffic networks. We consider three classes of models: A recently-developed aggregate model of the delay network dynamics, which we will refer to as the Markov Jump Linear System (MJLS), classical machine learning techniques like Classification and Regression Trees (CART), and three candidate Artificial Neural Network (ANN) architectures. We show that prediction performance can vary significantly depending on the choice of model/algorithm, and the type of prediction (for example, classification vs. regression). We also discuss the importance of selecting the right predictor variables, or features, in order to improve the performance of these algorithms. The models are evaluated using operational data from the National Airspace System (NAS) of the United States. The ANN is shown to be a good algorithm for the classification problem, where it attains an average accuracy of nearly 94% in predicting whether or not delays on the 100 most-delayed links will exceed 60 min, looking two hours into the future. The MJLS model, however, is better at predicting the actual delay levels on different links, and has a mean prediction error of 4.7 min for the regression problem, for a 2 hr horizon. MJLS is also better at predicting outbound delays at the 30 major airports, with a mean error of 6.8 min, for a 2 hr prediction horizon. The effect of temporal factors, and the spatial distribution of current delays, in predicting future delays are also compared. The MJLS model, which is specifically designed to capture aggregate air traffic dynamics, leverages on these factors and outperforms the ANN in predicting the future spatial distribution of delays. In this manner, a tradeoff between model simplicity and prediction accuracy is revealed. Keywordsdelay prediction; network delays; machine learning; artificial neural networks; data mining

[1]  Martin T. Hagan,et al.  Neural network design , 1995 .

[2]  N. K. Bose,et al.  Neural Network Fundamentals with Graphs, Algorithms and Applications , 1995 .

[3]  Hamsa Balakrishnan,et al.  A Network-Based Model for Predicting Air Traffic Delays , 2012 .

[4]  José J. Ramasco,et al.  Systemic delay propagation in the US airport network , 2013, Scientific Reports.

[5]  Pablo Fleurquin,et al.  Data-driven modeling of systemic delay propagation under severe meteorological conditions , 2013, 1308.0438.

[6]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[7]  Hamsa Balakrishnan,et al.  Characterization and prediction of air traffic delays , 2014 .

[8]  Fabrizio Lillo,et al.  Modelling the air transport with complex networks: A short review , 2013, The European Physical Journal Special Topics.

[9]  Zebulon James Hanley Delay characterization and prediction in major U.S. airline networks , 2015 .

[10]  Hamsa Balakrishnan,et al.  Clusters and communities in air traffic delay networks , 2016, 2016 American Control Conference (ACC).

[11]  M. Ball,et al.  Estimating Flight Departure Delay Distributions—A Statistical Approach With Long-Term Trend and Short-Term Pattern , 2008 .

[12]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[13]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[14]  H. Balakrishnan,et al.  Deconstructing Delay Dynamics An air traffic network example , 2016 .

[15]  Hamsa Balakrishnan,et al.  Stability of networked systems with switching topologies , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[16]  Young Jin Kim,et al.  A deep learning approach to flight delay prediction , 2016, 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC).

[17]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[18]  Amedeo R. Odoni,et al.  Modelling delay propagation within an airport network , 2013 .

[19]  Gano B. Chatterji,et al.  ANALYSIS OF AIRCRAFT ARRIVAL AND DEPARTURE DELAY CHARACTERISTICS , 2002 .

[20]  Alexander Klein,et al.  Airport delay prediction using weather-impacted traffic index (WITI) model , 2010, 29th Digital Avionics Systems Conference.

[21]  Peter Belobaba,et al.  Analysis of the potential for delay propagation in passenger airline networks , 2008 .

[22]  Kathryn B. Laskey,et al.  Estimation of Delay Propagation in the National Aviation System Using Bayesian Networks , 2005 .

[23]  Lance Sherry,et al.  Total Delay Impact Study , 2010 .