Machine learning based multi-index prediction of aviation turbulence over the Asia-Pacific

Abstract In-flight turbulence is recognized as a major safety hazard for the global aviation system, capable of causing serious injuries to crew and passengers as well as structural damage to the aircraft. Its prediction at 1 to 2 days ahead mainly relies on numerical weather prediction (NWP) models, which suffer from various practical and inherent deficiencies. This paper applies the XGBoost algorithm in generating skillful aviation turbulence forecasts through optimal combination of a collection of conventional “turbulence indices” produced by an NWP model. Verification over a 1-year period against over 16000 aircraft pilot reports demonstrated consistent superior performance of the machine-learning based MIC over the Asia-Pacific region, with median gains in skill score between 3% to 17% compared to constituent turbulence indices when taken individually.

[1]  Ulrich Balss,et al.  Spin-up time research on the weather research and forecasting model for atmospheric delay mitigations of electromagnetic waves , 2016 .

[2]  Pierre Gentine,et al.  Could Machine Learning Break the Convection Parameterization Deadlock? , 2018, Geophysical Research Letters.

[3]  Noah D. Brenowitz,et al.  Prognostic Validation of a Neural Network Unified Physics Parameterization , 2018, Geophysical Research Letters.

[4]  Robert Sharman,et al.  An Integrated Approach to Mid- and Upper-Level Turbulence Forecasting , 2006 .

[5]  Paola Cinnella,et al.  Data-Free and Data-Driven RANS Predictions with Quantified Uncertainty , 2018 .

[6]  J. Templeton.  Evaluation of machine learning algorithms for prediction of regions of high Reynolds averaged Navier Stokes uncertainty , 2015 .

[7]  W. Briggs.  Statistical Methods in the Atmospheric Sciences , 2007 .

[8]  Yanghui Wu,et al.  A XGBoost Model with Weather Similarity Analysis and Feature Engineering for Short-Term Wind Power Forecasting , 2019, Applied Sciences.

[9]  Karthik Duraisamy,et al.  Turbulence Modeling in the Age of Data , 2018, Annual Review of Fluid Mechanics.

[10]  Larry B. Cornman,et al.  Description and Derived Climatologies of Automated In Situ Eddy-Dissipation-Rate Reports of Atmospheric Turbulence , 2014 .

[11]  Manoj Joshi,et al.  Intensification of winter transatlantic aviation turbulence in response to climate change , 2013 .

[12]  Minzhu Xie,et al.  XGBFEMF: An XGBoost-Based Framework for Essential Protein Prediction , 2018, IEEE Transactions on NanoBioscience.

[13]  Rui Ferreira Neves,et al.  Combining Principal Component Analysis, Discrete Wavelet Transform and XGBoost to trade in the financial markets , 2019, Expert Syst. Appl..

[14]  Barry E. Schwartz,et al.  The Quantitative Use of PIREPs in Developing Aviation Weather Guidance Products , 1996 .

[15]  Stanley G. Benjamin,et al.  100 Years of Progress in Forecasting and NWP Applications , 2019, Meteorological Monographs.

[16]  K. Hon.  Predicting Low-Level Wind Shear Using 200-m-Resolution NWP at the Hong Kong International Airport , 2020, Journal of Applied Meteorology and Climatology.

[17]  P. O'Gorman,et al.  Using Machine Learning to Parameterize Moist Convection: Potential for Modeling of Climate, Climate Change, and Extreme Events , 2018, Journal of Advances in Modeling Earth Systems.

[18]  Anand Pratap Singh,et al.  New Approaches in Turbulence and Transition Modeling Using Data-driven Techniques , 2015 .

[19]  Qiusheng Li,et al.  A rare winter thunderstorm event near Hong Kong , 2020, Atmósfera.

[20]  Wayne L Golding.  Turbulence and Its Impact on Commercial Aviation , 2002 .

[21]  Robert Sharman,et al.  An Investigation of Turbulence Generation Mechanisms above Deep Convection , 2003 .

[22]  Gary P. Ellrod,et al.  An Objective Clear-Air Turbulence Forecasting Technique: Verification and Operational Use , 1992 .

[23]  John K. Williams,et al.  Using random forests to diagnose aviation turbulence , 2013, Machine Learning.

[24]  H. Chun,et al.  Evaluations of Upper-Level Turbulence Diagnostics Performance Using the Graphical Turbulence Guidance (GTG) System and Pilot Reports (PIREPs) over East Asia , 2011 .

[25]  K. Hon.  Tropical cyclone track prediction using a large-area WRF model at the Hong Kong Observatory , 2020 .

[26]  Xuan-Nam Bui,et al.  Novel Soft Computing Model for Predicting Blast-Induced Ground Vibration in Open-Pit Mines Based on Particle Swarm Optimization and XGBoost , 2019, Natural Resources Research.

[27]  Yan Zhang,et al.  Diagnosis and Classification of Typhoon-Associated Low-Altitude Turbulence Using HKO-TDWR Radar Observations and Machine Learning , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Peter Bauer,et al.  The quiet revolution of numerical weather prediction , 2015, Nature.

[29]  Jinlong Wu,et al.  Physics-informed machine learning approach for augmenting turbulence models: A comprehensive framework , 2018, Physical Review Fluids.

[30]  James D. Doyle,et al.  Large-Amplitude Mountain Wave Breaking over Greenland , 2005 .

[31]  J. Templeton,et al.  Reynolds averaged turbulence modelling using deep neural networks with embedded invariance , 2016, Journal of Fluid Mechanics.

[32]  Pak Wai Chan,et al.  Quick Access Recorder Data Analysis Software for Windshear and Turbulence Studies , 2010 .

[33]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[34]  H. Chun,et al.  Statistics and Possible Sources of Aviation Turbulence over South Korea , 2011 .

[35]  Jianming Xu,et al.  Application of the XGBoost Machine Learning Method in PM2.5 Prediction: A Case Study of Shanghai , 2020 .

[36]  J. Knox,et al.  Application of the Lighthill–Ford Theory of Spontaneous Imbalance to Clear-Air Turbulence Forecasting , 2008 .

[37]  Terrain-Induced Turbulence Intensity during Tropical Cyclone Passage as Determined from Airborne, Ground-Based, and Remote Sensing Sources , 2014 .

[38]  Marzuki Sinambela,et al.  Machine learning approach for turbulence forecasting using support vector machine , 2020, IOP Conference Series: Materials Science and Engineering.

[39]  E. Lindborg.  Can the atmospheric kinetic energy spectrum be explained by two-dimensional turbulence? , 1999, Journal of Fluid Mechanics.

[40]  Karthik Duraisamy,et al.  Machine Learning-augmented Predictive Modeling of Turbulent Separated Flows over Airfoils , 2016, ArXiv.

[41]  D. Muñoz‐Esparza,et al.  Aviation Turbulence Forecasting at Upper Levels with Machine Learning Techniques Based on Regression Trees , 2020, Journal of Applied Meteorology and Climatology.