Accurate and Clear Precipitation Nowcasting with Consecutive Attention and Rain-map Discrimination

Precipitation nowcasting is an important task for weather forecasting. Many recent works aim to predict the high rainfall events more accurately with the help of deep learning techniques, but such events are relatively rare. The rarity is often addressed by formulations that re-weight the rare events. Somehow such a formulation carries a side effect of making"blurry"predictions in low rainfall regions and cannot convince meteorologists to trust its practical usability. We fix the trust issue by introducing a discriminator that encourages the prediction model to generate realistic rain-maps without sacrificing predictive accuracy. Furthermore, we extend the nowcasting time frame from one hour to three hours to further address the needs from meteorologists. The extension is based on consecutive attentions across different hours. We propose a new deep learning model for precipitation nowcasting that includes both the discrimination and attention techniques. The model is examined on a newly-built benchmark dataset that contains both radar data and actual rain data. The benchmark, which will be publicly released, not only establishes the superiority of the proposed model, but also is expected to encourage future research on precipitation nowcasting.

[1]  Dit-Yan Yeung,et al.  Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model , 2017, NIPS.

[2]  Fan Zhang,et al.  MultiResolution Attention Extractor for Small Object Detection , 2020, ArXiv.

[3]  Seung-Ik Lee,et al.  Small Object Detection using Context and Attention , 2019, 2021 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[4]  I. Zawadzki,et al.  Scale-Dependence of the Predictability of Precipitation from Continental Radar Images. Part I: Description of the Methodology , 2002 .

[5]  Hakan Bilen,et al.  Self-Supervised Learning of Interpretable Keypoints From Unlabelled Videos , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Hsuan-Tien Lin,et al.  Benchmarking Tropical Cyclone Rapid Intensification with Satellite Images and Attention-Based Deep Models , 2019, ECML/PKDD.

[7]  Travis M. Smith,et al.  An Objective Method of Evaluating and Devising Storm-Tracking Algorithms , 2010 .

[8]  Cesare Furlanello,et al.  Precipitation Nowcasting with Orographic Enhanced Stacked Generalization: Improving Deep Learning Predictions on Extreme Events , 2020, Atmosphere.

[9]  Fei Cheng,et al.  Object detection based on an adaptive attention mechanism , 2020, Scientific Reports.

[10]  S. J. Weiss,et al.  Assessing Advances in the Assimilation of Radar Data and Other Mesoscale Observations within a Collaborative Forecasting-Research Environment , 2010 .

[11]  I. Jolliffe,et al.  Equitability Revisited: Why the ''Equitable Threat Score'' Is Not Equitable , 2010 .

[12]  Jian Zhang,et al.  An Operational Multi-Radar Multi-Sensor QPE System in Taiwan , 2020, Bulletin of the American Meteorological Society.

[13]  Kao-Shen Chung,et al.  Improving Radar Echo Lagrangian Extrapolation Nowcasting by Blending Numerical Model Wind Information: Statistical Performance of 16 Typhoon Cases , 2020 .

[14]  Sa-Kwang Song,et al.  Computer Vision in Precipitation Nowcasting: Applying Image Quality Assessment Metrics for Training Deep Neural Networks , 2019, Atmosphere.

[15]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[16]  I. Zawadzki,et al.  Scale Dependence of the Predictability of Precipitation from Continental Radar Images. Part II: Probability Forecasts , 2004 .

[17]  Antonio Torralba,et al.  Generating Videos with Scene Dynamics , 2016, NIPS.

[18]  Juanzhen Sun,et al.  Use of NWP for Nowcasting Convective Precipitation: Recent Progress and Challenges , 2014 .

[19]  Min-Gyu Park,et al.  Predicting Future Frames Using Retrospective Cycle GAN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  M. Dixon,et al.  TITAN: Thunderstorm Identification, Tracking, Analysis, and Nowcasting—A Radar-based Methodology , 1993 .

[21]  Robert M. Rabin,et al.  Multiscale storm identification and forecast , 2003 .

[22]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.