Development and Interpretation of a Neural Network-Based Synthetic Radar Reflectivity Estimator Using GOES-R Satellite Observations

The objective of this research is to develop techniques for assimilating GOES-R Series observations in precipitating scenes for the purpose of improving short-term convective-scale forecasts of high impact weather hazards. Whereas one approach is radiance assimilation, the information content of GOES-R radiances from its Advanced Baseline Imager (ABI) saturates in precipitating scenes, and radiance assimilation does not make use of lightning observations from the GOES Lightning Mapper (GLM). Here, a convolutional neural network (CNN) is developed to transform GOES-R radiances and lightning into synthetic radar reflectivity fields to make use of existing radar assimilation techniques. We find that the ability of CNNs to utilize spatial context is essential for this application and offers breakthrough improvement in skill compared to traditional pixel-by-pixel based approaches. To understand the improved performance, we use a novel analysis methodology that combines several techniques, each providing different insights into the network's reasoning. Channel withholding experiments and spatial information withholding experiments are used to show that the CNN achieves skill at high reflectivity values from the information content in radiance gradients and the presence of lightning. The attribution method, layer-wise relevance propagation, demonstrates that the CNN uses radiance and lightning information synergistically, where lightning helps the CNN focus on which neighboring locations are most important. Synthetic inputs are used to quantify the sensitivity to radiance gradients, showing that sharper gradients produce a stronger response in predicted reflectivity. Finally, geostationary lightning observations are found to be uniquely valuable for their ability to pinpoint locations of strong radar echoes.

[1]  Wojciech Samek,et al.  Methods for interpreting and understanding deep neural networks , 2017, Digit. Signal Process..

[2]  B. N. Meisner,et al.  The Relationship between Large-Scale Convective Rainfall and Cold Cloud over the Western Hemisphere during 1982-84 , 1987 .

[3]  K. Cummins,et al.  Negative first stroke leader characteristics in cloud‐to‐ground lightning over land and ocean , 2017 .

[4]  J. Otkin,et al.  Assimilation of All-Sky SEVIRI Infrared Brightness Temperatures in a Regional-Scale Ensemble Data Assimilation System , 2019, Monthly Weather Review.

[5]  Takemasa Miyoshi,et al.  Assimilating Every‐10‐minute Himawari‐8 Infrared Radiances to Improve Convective Predictability , 2019, Journal of Geophysical Research: Atmospheres.

[6]  Steven D. Miller,et al.  Cloud-Base Height Estimation from VIIRS. Part II: A Statistical Algorithm Based on A-Train Satellite Data , 2017 .

[7]  Andrew Glaws,et al.  Adversarial super-resolution of climatological wind and solar data , 2020, Proceedings of the National Academy of Sciences.

[8]  S. Rutledge,et al.  Evaluating Geostationary Lightning Mapper Flash Rates Within Intense Convective Storms , 2020, Journal of Geophysical Research: Atmospheres.

[9]  S. Miller,et al.  Short-term solar irradiance forecasting via satellite/model coupling , 2017, Solar Energy.

[10]  Statistical Methods in the Atmospheric Sciences , 2019 .

[11]  S. Liang,et al.  GOES-R Advanced Baseline Imager (ABI) Algorithm Theoretical Basis Document For , 2010 .

[12]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[13]  Mark S. Veillette,et al.  Creating Synthetic Radar Imagery Using Convolutional Neural Networks , 2018, Journal of Atmospheric and Oceanic Technology.

[14]  Ming Hu,et al.  Satellite Radiance Data Assimilation within the Hourly Updated Rapid Refresh , 2017 .

[15]  D. Stensrud,et al.  Simultaneous Assimilation of Radar and All-Sky Satellite Infrared Radiance Observations for Convection-Allowing Ensemble Analysis and Prediction of Severe Thunderstorms , 2019, Monthly Weather Review.

[16]  S. Miller,et al.  Geostationary Lightning Mapper and Earth Networks Lightning Detection Over the Contiguous United States and Dependence on Flash Characteristics , 2019, Journal of Geophysical Research: Atmospheres.

[17]  Christopher J. Schultz,et al.  Preliminary Development and Evaluation of Lightning Jump Algorithms for the Real-Time Detection of Severe Weather , 2009 .

[18]  David J. Stensrud,et al.  Assimilating All-Sky Infrared Radiances from GOES-16 ABI Using an Ensemble Kalman Filter for Convection-Allowing Severe Thunderstorms Prediction , 2018, Monthly Weather Review.

[19]  G. Grell,et al.  A North American Hourly Assimilation and Model Forecast Cycle: The Rapid Refresh , 2016 .

[20]  Andre Araujo,et al.  Computing Receptive Fields of Convolutional Neural Networks , 2019, Distill.

[21]  Kristin M. Calhoun,et al.  Multi-Radar Multi-Sensor (MRMS) Severe Weather and Aviation Products: Initial Operating Capabilities , 2016 .

[22]  William J. Koshak,et al.  The GOES-R GeoStationary Lightning Mapper (GLM) , 2012 .

[23]  Siddharth Samsi,et al.  Distributed Deep Learning for Precipitation Nowcasting , 2019, 2019 IEEE High Performance Extreme Computing Conference (HPEC).

[24]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[25]  Tobias Scheffer,et al.  RainNet v1.0: a convolutional neural network for radar-based precipitation nowcasting , 2020, Geoscientific Model Development.

[26]  Imme Ebert-Uphoff,et al.  Evaluation, Tuning, and Interpretation of Neural Networks for Working with Images in Meteorological Applications , 2020 .

[27]  Nils Gustafsson,et al.  Survey of data assimilation methods for convective‐scale numerical weather prediction at operational centres , 2018 .

[28]  Dennis J. Boccippio,et al.  Thermodynamic Conditions Favorable to Superlative Thunderstorm Updraft, Mixed Phase Microphysics and Lightning Flash Rate , 2005 .

[29]  R. A. Scofield,et al.  The role of orographic and parallax corrections on real time high resolution satellite rainfall rate distribution , 2002 .

[30]  Masahiro Kazumori,et al.  All‐sky satellite data assimilation at operational weather forecasting centres , 2018 .

[31]  Elise V. Schultz,et al.  Insight into the Kinematic and Microphysical Processes that Control Lightning Jumps , 2015 .

[32]  Y. Sawada,et al.  Comparison of assimilating all‐sky and clear‐sky infrared radiances from Himawari‐8 in a mesoscale system , 2019, Quarterly Journal of the Royal Meteorological Society.

[33]  S. Rutledge,et al.  Microphysical and Kinematic Processes Associated With Anomalous Charge Structures in Isolated Convection , 2018, Journal of geophysical research. Atmospheres : JGR.

[34]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[35]  Dusanka Zupanski,et al.  A Prototype WRF-Based Ensemble Data Assimilation System for Dynamically Downscaling Satellite Precipitation Observations , 2011 .

[36]  E. Zipser,et al.  Differences in size spectra of electrified storms over land and ocean , 2015 .

[37]  D. Boccippio Lightning Scaling Relations Revisited , 2002 .

[38]  T. Schmit,et al.  Use of Geostationary Super Rapid Scan Satellite Imagery by the Storm Prediction Center , 2016 .

[39]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[40]  Amy McGovern,et al.  Making the Black Box More Transparent: Understanding the Physical Implications of Machine Learning , 2019, Bulletin of the American Meteorological Society.

[41]  Timothy J. Schmit,et al.  A Closer Look at the ABI on the GOES-R Series , 2017 .

[42]  Paul J. Roebber,et al.  Visualizing Multiple Measures of Forecast Quality , 2009 .

[43]  Han Li,et al.  A Convection Nowcasting Method Based on Machine Learning , 2020, Advances in Meteorology.

[44]  D. Rind,et al.  A simple lightning parameterization for calculating global lightning distributions , 1992 .

[45]  William L. Smith,et al.  Assimilation of GOES-16 Radiances and Retrievals into the Warn-on-Forecast System , 2020, Monthly Weather Review.

[46]  Patrick Minnis,et al.  Simultaneous Radar and Satellite Data Storm-Scale Assimilation Using an Ensemble Kalman Filter Approach for 24 May 2011 , 2015 .

[47]  Alexander Binder,et al.  Unmasking Clever Hans predictors and assessing what machines really learn , 2019, Nature Communications.

[48]  G. Jedlovec,et al.  Limb Correction of MODIS and VIIRS Infrared Channels for the Improved Interpretation of RGB Composites , 2016 .