Aircraft Trajectory Prediction using LSTM Neural Network with Embedded Convolutional Layer

The development of convective weather avoidance algorithm is crucial for aviation operations and it is also a key objective of the next generation air traffic management system. This paper proposes a novel network architecture that embeds convolutional layers into long short-time memory (LSTM) cells to predict the trajectory, based on the convective weather condition along the flight plan before the aircraft takeoff. The data used in the experiments are history flight track data, the last on-file flight plan, and the time-dependent convective weather map. The history flight data are taken from NASA Sherlock database and the weather data used in this paper is the Echo Top (ET) convective weather product from Corridor Integrated Weather System (CIWS). The experiment is conducted using three months history data over the period from Nov 1, 2018 through Feb 5, 2019 with the flights from John F. Kennedy International Airport (JFK) to Los Angeles International Airport (LAX) but the methodology can be applied to the flights between any arbitrary two airports. Interpolation is performed on flight plans and real history tracks to fix the fold number of LSTM cell and also reduce computation complexity. The training loss is defined as the standard Mean Squared Error (MSE) of the predicted tracks and the real history tracks. Adam optimizer is used for backpropagation. Learning from the real historical flight data, the out-of-sample test shows that 47.0\% of the predicted flight tracks are able to reduce the deviation compared to the last on-file flight plan. The overall variance is reduced by 12.3\%.

[1]  David McNally,et al.  Operational Evaluatioin of Dynamic Weather Routes at American Airlines , 2013 .

[2]  D. J. Brudnicki,et al.  USER REQUEST EVALUATION TOOL (URET) CONFLICT PROBE PERFORMANCE AND BENEFITS ASSESSMENT , 2004 .

[3]  H. Erzberger,et al.  Automated conflict resolution, arrival management, and weather avoidance for air traffic management , 2012 .

[4]  Mark Hansen,et al.  Predicting Aircraft Trajectories: A Deep Generative Convolutional Recurrent Neural Networks Approach , 2018, ArXiv.

[5]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[6]  Yongming Liu,et al.  Information Fusion for National Airspace System Prognostics , 2018 .

[7]  Christopher D. Manning,et al.  Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models , 2016, ACL.

[8]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[9]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Yoshua Bengio,et al.  Attention-Based Models for Speech Recognition , 2015, NIPS.

[11]  Max Mulder,et al.  A Machine Learning Approach to Trajectory Prediction , 2013 .

[12]  Edward H Phillips.  FREE FLIGHT POSES MULTIPLE CHALLENGES , 1996 .

[13]  Mirella Lapata,et al.  Long Short-Term Memory-Networks for Machine Reading , 2016, EMNLP.

[14]  Subhashini Venugopalan,et al.  Translating Videos to Natural Language Using Deep Recurrent Neural Networks , 2014, NAACL.

[15]  Heinz Erzberger,et al.  Conflict probability estimation for free flight , 1997 .

[16]  Quoc V. Le,et al.  Addressing the Rare Word Problem in Neural Machine Translation , 2014, ACL.

[17]  Kapil Sheth,et al.  DYNAMIC WEATHER ROUTES : A WEATHER AVOIDANCE SYSTEM FOR NEAR-TERM TRAJECTORY-BASED OPERATIONS , 2022 .

[18]  Banavar Sridhar,et al.  Airspace Complexity and its Application in Air Traffic Management , 1998 .

[19]  Heather M. Arneson.  Sherlock Data Warehouse , 2018 .

[20]  David McNally,et al.  Dynamic Weather Routes: Two Years of Operational Testing at American Airlines , 2015 .

[21]  Yongming Liu,et al.  Aircraft dynamics simulation using a novel physics-based learning method , 2019, Aerospace Science and Technology.

[22]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[23]  Harry N. Swenson,et al.  Design and Operational Evaluation of the Traffic Management Advisor at the Ft. Worth Air Route Traffic Control Center , 1997 .

[24]  Michelle M. Eshow,et al.  Architecture and capabilities of a data warehouse for ATM research , 2014, 2014 IEEE/AIAA 33rd Digital Avionics Systems Conference (DASC).

[25]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[26]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[27]  Yoshua Bengio,et al.  End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results , 2014, ArXiv.

[28]  Hanan Samet,et al.  Aircraft Trajectory Prediction Made Easy with Predictive Analytics , 2016, KDD.

[29]  Michael Beigl,et al.  A Seq2Seq learning approach for modeling semantic trajectories and predicting the next location , 2018, SIGSPATIAL/GIS.

[30]  M. Robinson,et al.  2 EN ROUTE WEATHER DEPICTION BENEFITS OF THE NEXRAD VERTICALLY INTEGRATED LIQUID WATER PRODUCT UTILIZED BY THE CORRIDOR INTEGRATED WEATHER SYSTEM , 2002 .

[31]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[32]  John E. Robinson,et al.  OPERATIONAL TEST RESULTS OF THE PASSIVE FINAL APPROACH SPACING TOOL , 1997 .

[33]  James E. Evans,et al.  Corridor Integrated Weather System , 2006 .

[34]  Yuhao Wang,et al.  Aircraft Trajectory Prediction and Risk Assessment Using Bayesian Updating , 2019 .

[35]  John Lygeros,et al.  Model Based Aircraft Trajectory Prediction during Takeoff , 2006 .

[36]  J. Evans,et al.  MULTI-RADAR INTEGRATION TO IMPROVE EN ROUTE AVIATION OPERATIONS IN SEVERE CONVECTIVE WEATHER , 2002 .

[37]  Bowen Zhou,et al.  SummaRuNNer: A Recurrent Neural Network Based Sequence Model for Extractive Summarization of Documents , 2016, AAAI.

[38]  Weiyi Liu,et al.  Probabilistic Trajectory Prediction and Conflict Detection for Air Traffic Control , 2011 .

[39]  Yongming Liu,et al.  Physics-based Learning for Aircraft Dynamics Simulation , 2018, Annual Conference of the PHM Society.

[40]  Heinz Erzberger,et al.  Algorithms for control of arrival and departure traffic in terminal airspace , 2016, Proceedings of the Institution of Mechanical Engineers. Part G, Journal of aerospace engineering.