Short‐Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks

Author(s): Akbari Asanjan, A; Yang, T; Hsu, K; Sorooshian, S; Lin, J; Peng, Q | Abstract: ©2018. American Geophysical Union. All Rights Reserved. Short-term Quantitative Precipitation Forecasting is important for flood forecasting, early flood warning, and natural hazard management. This study proposes a precipitation forecast model by extrapolating Cloud-Top Brightness Temperature (CTBT) using advanced Deep Neural Networks, and applying the forecasted CTBT into an effective rainfall retrieval algorithm to obtain the Short-term Quantitative Precipitation Forecasting (0–6 hr). To achieve such tasks, we propose a Long Short-Term Memory (LSTM) and the Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN), respectively. The precipitation forecasts obtained from our proposed framework, (i.e., LSTM combined with PERSIANN) are compared with a Recurrent Neural Network (RNN), Persistency method, and Farneback optical flow each combined with PERSIANN algorithm and the numerical model results from the first version of Rapid Refresh (RAPv1.0) over three regions in the United States, including the states of Oregon, Oklahoma, and Florida. Our experiments indicate better statistics, such as correlation coefficient and root-mean-square error, for the CTBT forecasts from the proposed LSTM compared to the RNN, Persistency, and the Farneback method. The precipitation forecasts from the proposed LSTM and PERSIANN framework has demonstrated better statistics compared to the RAPv1.0 numerical forecasts and PERSIANN estimations from RNN, Persistency, and Farneback projections in terms of Probability of Detection, False Alarm Ratio, Critical Success Index, correlation coefficient, and root-mean-square error, especially in predicting the convective rainfalls. The proposed method shows superior capabilities in short-term forecasting over compared methods, and has the potential to be implemented globally as an alternative short-term forecast product.

[1]  Hermann Ney,et al.  LSTM Neural Networks for Language Modeling , 2012, INTERSPEECH.

[2]  Kuolin Hsu,et al.  Rainfall frequency analysis for ungauged regions using remotely sensed precipitation information , 2018, Journal of Hydrology.

[3]  Dan Wang,et al.  A quantitative comparison of precipitation forecasts between the storm-scale numerical weather prediction model and auto-nowcast system in Jiangsu, China , 2016 .

[4]  Soroosh Sorooshian,et al.  Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information , 2017 .

[5]  S. Sorooshian,et al.  Evaluation of satellite-retrieved extreme precipitation rates across the central United States , 2011 .

[6]  S. Sorooshian,et al.  A Microwave Infrared Threshold Technique to Improve the GOES Precipitation Index , 1999 .

[7]  Mekonnen Gebremichael,et al.  Evaluation of satellite rainfall estimates over Ethiopian river basins , 2010 .

[8]  R. Treadon,et al.  A Tutorial on Lateral Boundary Conditions as a Basic and Potentially Serious Limitation to Regional Numerical Weather Prediction , 1997 .

[9]  A. Barros,et al.  Localized Precipitation Forecasts from a Numerical Weather Prediction Model Using Artificial Neural Networks , 1998 .

[10]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[11]  Juanzhen Sun,et al.  Use of NWP for Nowcasting Convective Precipitation: Recent Progress and Challenges , 2014 .

[12]  Michael I. Jordan.  Serial Order: A Parallel Distributed Processing Approach , 1997 .

[13]  Charles A. Doswell,et al.  Precipitation Forecasting Using a Neural Network , 1999 .

[14]  Zbyněk Sokol,et al.  Nowcasting of deep convective clouds and heavy precipitation: Comparison study between NWP model simulation and extrapolation , 2017 .

[15]  Quan J. Wang,et al.  Evaluation of numerical weather prediction model precipitation forecasts for short-term streamflow forecasting purpose , 2013 .

[16]  John M. Wallace,et al.  Diurnal Variations in Precipitation and Thunderstorm Frequency over the Conterminous United States , 1975 .

[17]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[18]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[19]  Marcus Liwicki,et al.  Scene labeling with LSTM recurrent neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Jian Zhang,et al.  National mosaic and multi-sensor QPE (NMQ) system description, results, and future plans , 2011 .

[21]  Robert J. Joyce,et al.  The estimation of global monthly mean rainfall using infrared satellite data: The GOES precipitation index (GPI) , 1994 .

[22]  Auroop R. Ganguly,et al.  Distributed Quantitative Precipitation Forecasting Using Information from Radar and Numerical Weather Prediction Models , 2003 .

[23]  Kuolin Hsu,et al.  Quantitative Precipitation Nowcasting: A Lagrangian Pixel-Based Approach , 2012 .

[24]  B. Ritter,et al.  A comprehensive radiation scheme for numerical weather prediction models with potential applications in climate simulations , 1992 .

[25]  Loris Foresti,et al.  Development and verification of a real-time stochastic precipitation nowcasting system for urban hydrology in Belgium , 2015 .

[26]  Yang Hong,et al.  Comparison of PERSIANN and V7 TRMM Multi-satellite Precipitation Analysis (TMPA) products with rain gauge data over Iran , 2013 .

[27]  S. Mullen,et al.  Short-Range Ensemble Forecasts of Precipitation during the Southwest Monsoon , 2002 .

[28]  Zachary Chase Lipton.  A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[29]  K. Mo,et al.  Interannual Variability of the U.S. Summer Precipitation Regime with Emphasis on the Southwestern Monsoon. , 1998 .

[30]  J. McGinley,et al.  Improving QPE and Very Short Term QPF: An Initiative for a Community-Wide Integrated Approach , 2007 .

[31]  Soroosh Sorooshian,et al.  An enhanced artificial neural network with a shuffled complex evolutionary global optimization with principal component analysis , 2017, Inf. Sci..

[32]  PAUL J. WERBOS,et al.  Generalization of backpropagation with application to a recurrent gas market model , 1988, Neural Networks.

[33]  Les E. Atlas,et al.  Recurrent neural networks and robust time series prediction , 1994, IEEE Trans. Neural Networks.

[34]  Kuolin Hsu,et al.  Self‐organizing linear output map (SOLO): An artificial neural network suitable for hydrologic modeling and analysis , 2002 .

[35]  Soroosh Sorooshian,et al.  Evaluating the streamflow simulation capability of PERSIANN-CDR daily rainfall products in two river basins on the Tibetan Plateau , 2016 .

[36]  Travis M. Smith,et al.  An Automated Technique to Quality Control Radar Reflectivity Data , 2007 .

[37]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[38]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[39]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[40]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[41]  Kuolin Hsu,et al.  Evaluation of a new satellite‐based precipitation data set for climate studies in the Xiang River basin, southern China , 2017 .

[42]  Witold F. Krajewski,et al.  Rainfall forecasting in space and time using a neural network , 1992 .

[43]  S. Sorooshian,et al.  Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks , 1997 .

[44]  Robert G. Fovell,et al.  Consensus Clustering of U.S. Temperature and Precipitation Data , 1997 .

[45]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[46]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[47]  Kuolin Hsu,et al.  PERSIANN-MSA: A Precipitation Estimation Method from Satellite-Based Multispectral Analysis , 2009 .

[48]  Quan J. Wang,et al.  Post-processing rainfall forecasts from numerical weather prediction models for short-term streamflow forecasting , 2013 .

[49]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[50]  Jürgen Schmidhuber,et al.  Recurrent nets that time and count , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[51]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[52]  B. Golding.  Nimrod: a system for generating automated very short range forecasts , 1998 .

[53]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[54]  G. Grell,et al.  A North American Hourly Assimilation and Model Forecast Cycle: The Rapid Refresh , 2016 .

[55]  Kuolin Hsu,et al.  Evaluation of satellite-based precipitation estimation over Iran , 2013 .

[56]  David Simonin,et al.  Performance of 4D‐Var NWP‐based nowcasting of precipitation at the Met Office for summer 2012 , 2016 .

[57]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[58]  Akira Mano,et al.  Short‐term flood inundation prediction using hydrologic‐hydraulic models forced with downscaled rainfall from global NWP , 2014 .

[59]  Wei Xu,et al.  Explain Images with Multimodal Recurrent Neural Networks , 2014, ArXiv.

[60]  Robert J. Kuligowski,et al.  Experiments in Short-Term Precipitation Forecasting Using Artificial Neural Networks , 1998 .

[61]  Kuolin Hsu,et al.  Short-term quantitative precipitation forecasting using an object-based approach , 2013 .