Forecasting Different Types of Convective Weather: A Deep Learning Approach

A deep learning objective forecasting solution for severe convective weather (SCW) including short-duration heavy rain (HR), hail, convective gusts (CG), and thunderstorms based on numerical weather prediction (NWP) data was developed. We first established the training datasets as follows. Five years of severe weather observations were utilized to label the NCEP final (FNL) analysis data. A large number of labeled samples for each type of weather were then selected for model training. The local temperature, pressure, humidity, and winds from 1000 to 200 hPa, as well as dozens of convective physical parameters, were taken as predictors in our model. A six-layer convolutional neural network (CNN) model was then built and trained to obtain optimal model weights. After that, the trained model was used to predict SCW based on the Global Forecast System (GFS) forecast data as input. The performances of the CNN model and other traditional methods were compared. The results show that the deep learning algorithm had a higher classification accuracy on HR and hail than support vector machine, random forests, and other traditional machine learning algorithms. The objective forecasts by use of the deep learning algorithm also showed better forecasting skills than the subjective forecasts by the forecasters. The threat scores (TSs) of thunderstorm, HR, hail, and CG were increased by 16.1%, 33.2%, 178%, and 55.7%, respectively. The deep learning forecast model is currently used in the National Meteorological Center of China to provide guidance for the operational SCW forecasting over China.

[1]  S. E. Haupt,et al.  Storm-Based Probabilistic Hail Forecasting with Machine Learning Applied to Convection-Allowing Ensembles , 2017 .

[2]  Travis M. Smith,et al.  Machine Learning for Real-Time Prediction of Damaging Straight-Line Convective Wind , 2017 .

[3]  Agostino Manzato,et al.  Sounding-derived indices for neural network based short-term thunderstorm and rainfall forecasts , 2007 .

[4]  B. M. Lewis,et al.  OBJECTIVE PREDICTION OF FIVE-DAY MEAN TEMPERATURES DURING WINTER , 1959 .

[5]  Da-Lin Zhang,et al.  A 6-yr Cloud-to-Ground Lightning Climatology and Its Relationship to Rainfall over Central and Eastern China , 2015 .

[6]  Pabitra Mitra,et al.  Early Prediction of Extreme Rainfall Events: A Deep Learning Approach , 2016, ICDM.

[7]  M. W Gardner,et al.  Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciences , 1998 .

[8]  Amy McGovern,et al.  Machine Learning Enhancement of Storm-Scale Ensemble Probabilistic Quantitative Precipitation Forecasts , 2014 .

[9]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[10]  Masakazu Matsugu,et al.  Subject independent facial expression recognition with robust face detection using a convolutional neural network , 2003, Neural Networks.

[11]  Tao Shiyan Ingredients-Based Heavy Rainfall Forecasting , 2010 .

[12]  Stan Matwin,et al.  Machine Learning for the Detection of Oil Spills in Satellite Radar Images , 1998, Machine Learning.

[13]  Bartosz Krawczyk,et al.  Learning from imbalanced data: open challenges and future directions , 2016, Progress in Artificial Intelligence.

[14]  Lei Han,et al.  A Machine Learning Nowcasting Method based on Real-time Reanalysis Data , 2016, ArXiv.

[15]  Jianhua Sun,et al.  A 5-yr Climatology of Severe Convective Wind Events over China , 2017 .

[16]  James Correia,et al.  Day-Ahead Hail Prediction Integrating Machine Learning with Storm-Scale Numerical Weather Models , 2015, AAAI.

[17]  Philip S. Yu,et al.  PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs , 2017, NIPS.

[18]  Zheng Yongguang Operational System of Severe Convective Weather Comprehensive Monitoring , 2013 .

[19]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Charles A. Doswell,et al.  Severe Convective Storms , 2001 .

[22]  Jason Sanders,et al.  CUDA by example: an introduction to general purpose GPU programming , 2010 .

[23]  M. Pavolonis,et al.  An Empirical Model for Assessing the Severe Weather Potential of Developing Convection , 2014 .

[24]  Padraig Cunningham,et al.  The problem of bias in training data in regression problems in medical decision support , 2002, Artif. Intell. Medicine.

[25]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[26]  Caren Marzban,et al.  A Neural Network for Damaging Wind Prediction , 1998 .

[27]  David J. Kriegman,et al.  Automated annotation of coral reef survey images , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[29]  Yu Xiaoding Ingredients Based Forecasting Methodology , 2011 .

[30]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[31]  Agostino Manzato,et al.  Hail in Northeast Italy: A Neural Network Ensemble Forecast Using Sounding-Derived Indices , 2013 .

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Stanley G. Benjamin,et al.  CONVECTIVE-SCALE WARN-ON-FORECAST SYSTEM: A vision for 2020 , 2009 .

[34]  Michaël Gharbi,et al.  Convolutional neural network for earthquake detection and location , 2017, Science Advances.

[35]  Zhiyong Meng,et al.  General Features of Squall Lines in East China , 2013 .

[36]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Gregory R. Herman,et al.  Money Doesn't Grow on Trees, but Forecasts Do: Forecasting Extreme Precipitation with Random Forests , 2018 .

[38]  Sutapa Chaudhuri,et al.  Convective energies in forecasting severe thunderstorms with one hidden layer neural net and variable learning rate back propagation algorithm , 2010 .

[39]  Jianhua Sun,et al.  An Analysis of Cloud-to-Ground Lightning in China during 2010–13 , 2015 .

[40]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[41]  Wei Zhang,et al.  Application of Multi-channel 3D-cube Successive Convolution Network for Convective Storm Nowcasting , 2017, 2019 IEEE International Conference on Big Data (Big Data).

[42]  Peter Sheridan,et al.  Current gust forecasting techniques, developments and challenges , 2018, Advances in Science and Research.

[43]  Caren Marzban,et al.  A Neural Network for Tornado Prediction Based on Doppler Radar-Derived Attributes , 1996 .

[44]  Jerzy W. Grzymala-Busse,et al.  An Approach to Imbalanced Data Sets Based on Changing Rule Strength , 2004, Rough-Neural Computing: Techniques for Computing with Words.

[45]  C. Doswell,et al.  Flash Flood Forecasting: An Ingredients-Based Methodology , 1996 .

[46]  Lior Wolf,et al.  A Dynamic Convolutional Layer for short rangeweather prediction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Agostino Manzato,et al.  The Use of Sounding-Derived Indices for a Neural Network Short-Term Thunderstorm Forecast , 2005 .

[48]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[49]  Yongguang Zheng,et al.  Statistical characteristics of environmental parameters for warm season short-duration heavy rainfall over central and eastern China , 2015, Journal of Meteorological Research.

[50]  Peter S. Ray,et al.  Mesoscale Meteorology and Forecasting , 1986 .