Nowcasting thunderstorm hazards using machine learning: the impact of data sources on performance

Abstract. In order to aid feature selection in thunderstorm nowcasting, we present an analysis of the utility of various sources of data for machine-learning-based nowcasting of hazards related to thunderstorms. We considered ground-based radar data, satellite-based imagery and lightning observations, forecast data from numerical weather prediction (NWP) and the topography from a digital elevation model (DEM), ending up with 106 different predictive variables. We evaluated machine-learning models to nowcast radar reflectivity (representing precipitation), lightning occurrence, and the 45 dBZ radar echo top height that can be used as an indicator of hail, producing predictions for lead times up to 60 min. The study was carried out in an area in the northeast United States, where observations from the Geostationary Operational Environmental Satellite 16 are available and can be used as a proxy for the upcoming Meteosat Third Generation capabilities in Europe. The benefits of the data sources were evaluated using two complementary approaches: using feature importance reported by the machine learning model based on gradient boosted trees, and by repeating the analysis using all possible combinations of the data sources. The two approaches sometimes yielded seemingly contradictory results, as the feature importance reported by the gradient boosting algorithm sometimes disregards certain features that are still useful in the absence of more powerful predictors, while at times it overstates the importance of other features. We found that the radar data is overall the most important predictor, the satellite imagery is beneficial for all of the studied predictands, and the lightning data is very useful for nowcasting lightning but of limited use for the other hazards. The benefits of the NWP data are more limited over the nowcast period, and we did not find evidence that the nowcast benefits from the DEM data.

[1]  Dirk Heizenreder,et al.  NowCastMIX: Automatic Integrated Warnings for Severe Convection on Nowcasting Time Scales at the German Weather Service , 2018, Weather and Forecasting.

[2]  Michael Abrams,et al.  ASTER Global Digital Elevation Model (GDEM) and ASTER Global Water Body Dataset (ASTWBD) , 2020, Remote. Sens..

[3]  Jonathan J. Helmus,et al.  The Python ARM Radar Toolkit (Py-ART), a Library for Working with Weather Radar Data in the Python Programming Language , 2016 .

[4]  Arnold Tafferner,et al.  Cb-TRAM: Tracking and monitoring severe convection from onset over rapid development to mature phase using multi-channel Meteosat-8 SEVIRI data , 2008 .

[5]  William H. Heiss,et al.  Nexrad - Next generation weather radar (WSR-88D) , 1990 .

[6]  Juanzhen Sun,et al.  Nowcasting Thunderstorms: A Status Report , 1998 .

[7]  Dit-Yan Yeung,et al.  Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model , 2017, NIPS.

[8]  F. Rachidi,et al.  Nowcasting lightning occurrence from commonly available meteorological parameters using machine learning techniques , 2019, npj Climate and Atmospheric Science.

[9]  Charles A. Doswell,et al.  Climatology of Nontornadic Severe Thunderstorm Events in the United States , 1985 .

[10]  Robert A. Clark,et al.  Vertically Integrated Liquid Water—A New Analysis Tool , 1972 .

[11]  Jeff W. Brogden,et al.  Multi-Radar Multi-Sensor (MRMS) Quantitative Precipitation Estimation: Initial Operating Capabilities , 2016 .

[12]  Tobias Scheffer,et al.  RainNet v1.0: a convolutional neural network for radar-based precipitation nowcasting , 2020, Geoscientific Model Development.

[13]  Reinhold Steinacker,et al.  Automatic Tracking of Convective Cells and Cell Complexes from Lightning and Radar Data , 2000 .

[14]  Travis M. Smith,et al.  Machine Learning for Real-Time Prediction of Damaging Straight-Line Convective Wind , 2017 .

[15]  Yoshihide Sekimoto,et al.  Convcast: An embedded convolutional LSTM based architecture for precipitation nowcasting using satellite data , 2020, PloS one.

[16]  T. Schmit,et al.  ABI Legacy Atmospheric Profiles and Derived Products from the GOES-R Series , 2020 .

[17]  Kristin M. Calhoun,et al.  Multi-Radar Multi-Sensor (MRMS) Severe Weather and Aviation Products: Initial Operating Capabilities , 2016 .

[18]  Daniele Nerini,et al.  Using a 10-Year Radar Archive for Nowcasting Precipitation Growth and Decay: A Probabilistic Machine Learning Approach , 2019, Weather and Forecasting.

[19]  Jan Handwerker,et al.  Cell tracking with TRACE3D—a new algorithm , 2002 .

[21]  J. Mecikalski,et al.  Random Forest Model to Assess Predictor Importance and Nowcast Severe Storms using High-Resolution Radar–GOES Satellite–Lightning Observations , 2021 .

[22]  Cesare Furlanello,et al.  Precipitation Nowcasting with Orographic Enhanced Stacked Generalization: Improving Deep Learning Predictions on Extreme Events , 2020, Atmosphere.

[23]  Sebastian Schemm,et al.  Nowcasting Foehn Wind Events Using the AdaBoost Machine Learning Algorithm , 2017 .

[24]  Amy McGovern,et al.  Deep Learning on Three-Dimensional Multiscale Data for Next-Hour Tornado Prediction , 2020, Monthly Weather Review.

[25]  A. Waldvogel,et al.  Criteria for the Detection of Hail Cells , 1979 .

[26]  Tie-Yan Liu,et al.  LightGBM: A Highly Efficient Gradient Boosting Decision Tree , 2017, NIPS.

[27]  Alois Knoll,et al.  Gradient boosting machines, a tutorial , 2013, Front. Neurorobot..

[28]  Kendall E. Atkinson An introduction to numerical analysis , 1978 .

[29]  Stanley A. Changnon Relationships between thunderstorms and cloud-to-ground lightning in the United States , 1993 .

[30]  G. Villarini,et al.  Lagrangian Analyses of Rainfall Structure and Evolution for Organized Thunderstorm Systems in the Urban Corridor of the Northeastern United States , 2015 .

[31]  Arnold Neumaier,et al.  Introduction to Numerical Analysis , 2001 .

[32]  J. Mecikalski,et al.  Forecasting Convective Initiation by Monitoring the Evolution of Moving Cumulus in Daytime GOES Imagery , 2004 .

[33]  Jan Hoffmann,et al.  Entwicklung und Anwendung von statistischen Vorhersage-Interpretationsverfahren für Gewitternowcasting und Unwetterwarnungen unter Einbeziehung von Fernerkundungsdaten , 2008 .

[34]  Wayne M. MacKenzie,et al.  Cloud-Top Properties of Growing Cumulus prior to Convective Initiation as Measured by Meteosat Second Generation. Part I: Infrared Fields , 2010 .

[35]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[36]  M. Dixon,et al.  TITAN: Thunderstorm Identification, Tracking, Analysis, and Nowcasting—A Radar-based Methodology , 1993 .

[37]  Urs Germann,et al.  Experiences with >50,000 Crowdsourced Hail Reports in Switzerland , 2019, Bulletin of the American Meteorological Society.

[38]  U. Germann,et al.  Pysteps: an open-source Python library for probabilistic precipitation nowcasting (v1.0) , 2019, Geoscientific Model Development.

[39]  Ulrich Hamann,et al.  PyTroll An Open-Source, Community-Driven Python Framework to Process Earth Observation Satellite Data , 2018 .

[40]  Jan Szturc,et al.  Application of machine learning to large hail prediction - The importance of radar reflectivity, lightning occurrence and convective parameters derived from ERA5 , 2019, Atmospheric Research.

[41]  G. Galli,et al.  Nowcasting thunderstorms in the Alpine region using a radar based adaptive thresholding scheme , 2004 .

[42]  S. Goodman,et al.  Lightning Detection: GOES-R Series Geostationary Lightning Mapper , 2020 .

[43]  John K. Williams,et al.  Probabilistic 0–1-h Convective Initiation Nowcasts that Combine Geostationary Satellite Observations and Numerical Weather Prediction Model Data , 2015 .

[44]  Yongguang Zheng,et al.  A Deep Learning Network for Cloud-to-Ground Lightning Nowcasting with Multisource Data , 2020, Journal of Atmospheric and Oceanic Technology.