Graph to sequence learning with attention mechanism for network-wide multi-step-ahead flight delay prediction

Abstract The primary objective of this study is to predict network-wide multi-step-ahead flight delay. A novel graph-to-sequence learning architecture with attention mechanism (AG2S-Net) is developed to predict the multi-step-ahead hourly departure and arrival delay of the entire network. The proposed AG2S-Net consists of a graph convolution neural network, a bi-LSTM neural network, and a sequence-to-sequence framework with embedded attention mechanism. Five-year flight data of 75 airports and 242 links are collected from the National Airspace System to illustrate the procedure. First, K-means clustering algorithm is applied to classify the hourly flight delay states of the entire network into four typical delay patterns, which are further used as explanatory variables in prediction model. Then, the network-wide multi-step-ahead flight delay prediction model is built with the proposed AG2S-Net. The result indicates that the model achieves better performance on large-scale airports than small-scale airports. The delay pattern variables and weather variables can greatly improve the prediction performance. In addition, compared with several benchmark methods, the AG2S-Net performs the best for all three airport types in terms of the lowest RMSE and MAE values. Finally, the graph network analysis further reveals that the proposed AG2S-Net can capture the hidden correlations between airports without links and collect information from more airports in the same community to enhance the prediction performance. The results of this study could provide insightful suggestions for aviation authorities and airport regulators to develop effective air traffic control strategies for alleviating flight delays and improving operation efficiency of the entire network.

[1]  G. Box,et al.  Distribution of Residual Autocorrelations in Autoregressive-Integrated Moving Average Time Series Models , 1970 .

[2]  Chuan Ding,et al.  Parallel Architecture of Convolutional Bi-Directional LSTM Neural Networks for Network-Wide Metro Ridership Prediction , 2019, IEEE Transactions on Intelligent Transportation Systems.

[3]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[4]  Yinhai Wang,et al.  Multistep speed prediction on traffic networks: A deep learning approach considering spatio-temporal dependencies , 2019, Transportation Research Part C: Emerging Technologies.

[5]  Ronald Wesonga,et al.  Parameterized framework for the analysis of probabilities of aircraft delay at an airport , 2012 .

[6]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[7]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[8]  Navoneel Chakrabarty,et al.  Flight Arrival Delay Prediction Using Gradient Boosting Classifier , 2018, Advances in Intelligent Systems and Computing.

[9]  Chao Liu,et al.  Flight Delay Prediction Using Deep Convolutional Neural Network Based on Fusion of Meteorological Data , 2020, Neural Processing Letters.

[10]  Jie Yang,et al.  Flight Delay Prediction Based on Aviation Big Data and Machine Learning , 2020, IEEE Transactions on Vehicular Technology.

[11]  Cheng-Lung Wu,et al.  Modelling the delay propagation effects of multiple resource connections in an airline network using a Bayesian network model , 2019, Transportation Research Part E: Logistics and Transportation Review.

[12]  Alan Marsden,et al.  Assessing strategic flight schedules at an airport using machine learning-based flight delay and cancellation predictions , 2020 .

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[15]  Ying Xia,et al.  Traffic Flow Forecasting Method based on Gradient Boosting Decision Tree , 2017 .

[16]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[17]  Rosa María Arnaldo Valdés,et al.  Assessment of airport arrival congestion and delay: Prediction and reliability , 2019, Transportation Research Part C: Emerging Technologies.

[18]  B. Ye,et al.  A Methodology for Predicting Aggregate Flight Departure Delays in Airports Based on Supervised Learning , 2020 .

[19]  Eduardo S. Ogasawara,et al.  An analysis of Brazilian flight delays based on frequent patterns , 2016 .

[20]  Jie Bao,et al.  A spatiotemporal deep learning approach for citywide short-term crash risk prediction with multi-source data. , 2019, Accident; analysis and prevention.

[21]  Kevin Heaslip,et al.  Inferring transportation modes from GPS trajectories using a convolutional neural network , 2018, ArXiv.

[22]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[23]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[24]  W. Y. Szeto,et al.  Multi-step-ahead traffic speed forecasting using multi-output gradient boosting regression tree , 2019, J. Intell. Transp. Syst..

[25]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[26]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[27]  Der-Horng Lee,et al.  Sequence to sequence learning with attention mechanism for short-term passenger flow prediction in large-scale metro system , 2019, Transportation Research Part C: Emerging Technologies.

[28]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[29]  Hamsa Balakrishnan,et al.  Characterization and prediction of air traffic delays , 2014 .

[30]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[31]  Bin Yu,et al.  Flight delay prediction for commercial air transport: A deep learning approach , 2019, Transportation Research Part E: Logistics and Transportation Review.

[32]  Lei Lin,et al.  Predicting Station-level Hourly Demands in a Large-scale Bike-sharing Network: A Graph Convolutional Neural Network Approach , 2017, Transportation Research Part C: Emerging Technologies.

[33]  Weijun Pan,et al.  A deep learning approach to predict the spatial and temporal distribution of flight delay in network , 2019, J. Intell. Fuzzy Syst..

[34]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.