SGDAN—A Spatio-Temporal Graph Dual-Attention Neural Network for Quantified Flight Delay Prediction

There has been a lot of research on flight delays. But it is more useful and difficult to estimate the departure delay time especially three hours before the scheduled time of departure, from which passengers can reasonably plan their travel time and the airline and airport staff can schedule flights more reasonably. In this paper, we develop a Spatio-temporal Graph Dual-Attention Neural Network (SGDAN) to learn the departure delay time for each flight with real-time conditions at three hours before the scheduled time of departure. Specifically, it first models the air traffic network as graph sequences, what is, using a heterogeneous graph to model a flight and its adjacent flights with the same departure or arrival airport in a special time interval, and using a sequence to model the flight and its previous flights that share the same aircraft. The main contributions of this paper are using heterogeneous graph-level attention to learn the influence between the flight and its adjacent flight together with sequence-level attention to learn the influence between the flight and its previous flight in the flight sequence. With aggregating features from the learned influence from both graph-level and sequence-level attention, SGDAN can generate node embedding to estimate the departure delay time. Experiments on a real-world large-scale data set show that SGDAN produces better results than state-of-the-art models in the accurate flight delay time estimation task.

[1]  Hao Ma,et al.  GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs , 2018, UAI.

[2]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[3]  Jie Zhang,et al.  Semi-supervised Learning on Graphs with Generative Adversarial Nets , 2018, CIKM.

[4]  Ludovica Adacher,et al.  Airport Ground Movement Problem: Minimization of Delay and Pollution Emission , 2018, IEEE Transactions on Intelligent Transportation Systems.

[5]  Haiyan Chen,et al.  An Airport Scene Delay Prediction Method Based on LSTM , 2018, ADMA.

[6]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[7]  Mark Hansen,et al.  Deconstructing delay: A non-parametric approach to analyzing delay changes in single server queuing systems , 2013 .

[8]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[9]  Karla Hoffman,et al.  Optimum Airport Capacity Utilization under Congestion Management: A Case Study of New York LaGuardia Airport , 2008 .

[10]  Donald F. Towsley,et al.  Diffusion-Convolutional Neural Networks , 2015, NIPS.

[11]  Yoshua Bengio,et al.  GMNN: Graph Markov Neural Networks , 2019, ICML.

[12]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[13]  Hamsa Balakrishnan,et al.  Characterization and prediction of air traffic delays , 2014 .

[14]  Yu Zhang,et al.  Delay causality network in air transport systems , 2018, Transportation Research Part E: Logistics and Transportation Review.

[15]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[16]  M. Ball,et al.  Estimating Flight Departure Delay Distributions—A Statistical Approach With Long-Term Trend and Short-Term Pattern , 2008 .

[17]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[18]  Lance Sherry,et al.  Accuracy of reinforcement learning algorithms for predicting aircraft taxi-out times: A case-study of Tampa Bay departures , 2010 .

[19]  Jie Yang,et al.  Flight Delay Prediction Based on Aviation Big Data and Machine Learning , 2020, IEEE Transactions on Vehicular Technology.

[20]  Jonathan Masci,et al.  Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[22]  Cao Xiao,et al.  FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling , 2018, ICLR.

[23]  Shirui Pan,et al.  DAGCN: Dual Attention Graph Convolutional Networks , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[24]  Guan Gui,et al.  Generalized Flight Delay Prediction Method Using Gradient Boosting Decision Tree , 2020, 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring).

[25]  Young Jin Kim,et al.  A deep learning approach to flight delay prediction , 2016, 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC).

[26]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[27]  B. Ye,et al.  A Methodology for Predicting Aggregate Flight Departure Delays in Airports Based on Supervised Learning , 2020 .

[28]  Jaegul Choo,et al.  ST-GRAT: A Novel Spatio-temporal Graph Attention Networks for Accurately Forecasting Dynamically Changing Road Speed , 2020, CIKM.

[29]  Mayara Condé Rocha Murça,et al.  Identification, Characterization, and Prediction of Traffic Flow Patterns in Multi-Airport Systems , 2019, IEEE Transactions on Intelligent Transportation Systems.

[30]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[31]  Carlos J. Costa,et al.  Factors influencing charter flight departure delay , 2020 .

[32]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[33]  Hao Liu,et al.  Spatio-Temporal Dual Graph Attention Network for Query-POI Matching , 2020, SIGIR.

[34]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[35]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[36]  Weiwei Wu,et al.  Enhanced delay propagation tree model with Bayesian Network for modelling flight delay propagation , 2018 .

[37]  Gano B. Chatterji,et al.  ANALYSIS OF AIRCRAFT ARRIVAL AND DEPARTURE DELAY CHARACTERISTICS , 2002 .

[38]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[39]  Zhen Cui,et al.  Dual-Attention Graph Convolutional Network , 2019, ACPR.

[40]  Amy Kim.  The impacts of changing flight demands and throughput performance on airport delays through the Great Recession , 2016 .

[41]  Tao Feng,et al.  Comparative analysis on propagation effects of flight delays: a case study of China airlines , 2018 .