Convcast: An embedded convolutional LSTM based architecture for precipitation nowcasting using satellite data

Nowcasting of precipitation is a difficult spatiotemporal task because of the non-uniform characterization of meteorological structures over time. Recently, convolutional LSTM has been shown to be successful in solving various complex spatiotemporal based problems. In this research, we propose a novel precipitation nowcasting architecture ‘Convcast’ to predict various short-term precipitation events using satellite data. We train Convcast with ten consecutive NASA’s IMERG precipitation data sets each at intervals of 30 minutes. We use the trained neural network model to predict the eleventh precipitation data of the corresponding ten precipitation sequence. Subsequently, the predicted precipitation data are used iteratively for precipitation nowcasting of up to 150 minutes lead time. Convcast achieves an overall accuracy of 0.93 with an RMSE of 0.805 mm/h for 30 minutes lead time, and an overall accuracy of 0.87 with an RMSE of 1.389 mm/h for 150 minutes lead time. Experiments on the test dataset demonstrate that Convcast consistently outperforms other state-of-the-art optical flow based nowcasting algorithms. Results from this research can be used for nowcasting of weather events from satellite data as well as for future on-board processing of precipitation data.

[1]  Sa-Kwang Song,et al.  Computer Vision in Precipitation Nowcasting: Applying Image Quality Assessment Metrics for Training Deep Neural Networks , 2019, Atmosphere.

[2]  K. T Smith,et al.  Nowcasting precipitation — a proposal for a way forward , 2000 .

[3]  F. Marzano,et al.  Artificial neural-network technique for precipitation nowcasting from satellite imagery , 2006 .

[4]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[5]  T. Miyoshi,et al.  Nowcasting with Data Assimilation: A Case of Global Satellite Mapping of Precipitation , 2016 .

[6]  Alexander Heye,et al.  Precipitation Nowcasting : Leveraging Deep Recurrent Convolutional Neural Networks , 2017 .

[7]  G. Huffman,et al.  Integrated Multi-satellitE Retrievals for GPM (IMERG) Technical Documentation , 2015 .

[8]  I. Zawadzki,et al.  Scale-Dependence of the Predictability of Precipitation from Continental Radar Images. Part I: Description of the Methodology , 2002 .

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Eyke Hüllermeier,et al.  ML-Plan: Automated machine learning via hierarchical planning , 2018, Machine Learning.

[11]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  P. Cheung,et al.  Reprint 1025 Application of optical-flow technique to significant convection nowcast for terminal areas in Hong Kong , 2012 .

[13]  Le Hoang Son,et al.  Some novel hybrid forecast methods based on picture fuzzy clustering for weather nowcasting from satellite image sequences , 2016, Applied Intelligence.

[14]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[16]  L. Li,et al.  Nowcasting of Motion and Growth of Precipitation with Radar over a Complex Orography , 1995 .

[17]  S. Sorooshian,et al.  Early Examples from the Integrated Multi-Satellite Retrievals for GPM (IMERG) , 2014 .

[18]  I. Douglas,et al.  Unjust waters: climate change, flooding and the urban poor in Africa , 2008 .

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[20]  Longbing Cao,et al.  Training deep neural networks on imbalanced data sets , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[21]  Zhao-Liang Li,et al.  A new methodology for pixel-quantitative precipitation nowcasting using a pyramid Lucas Kanade optical flow approach , 2015 .

[22]  S. Mecklenburg,et al.  Improving the nowcasting of precipitation in an Alpine region with an enhanced radar echo tracking algorithm. , 2000 .

[23]  I. Zawadzki,et al.  Predictability of Precipitation from Continental Radar Images. Part IV: Limits to Prediction. , 2006 .

[24]  G. Ayzel,et al.  Optical flow models as an open benchmark for radar-based precipitation nowcasting (rainymotion v0.1) , 2018, Geoscientific Model Development.

[25]  Michael R. Rasmussen,et al.  Assimilation of radar‐based nowcast into a HIRLAM NWP model , 2015 .

[26]  Luc Van Gool,et al.  Fast Optical Flow Using Dense Inverse Search , 2016, ECCV.

[27]  Wang-chun Woo,et al.  Operational Application of Optical Flow Techniques to Radar-Based Rainfall Nowcasting , 2017 .

[28]  Neill E. Bowler,et al.  Development of a precipitation nowcasting algorithm based upon optical flow techniques , 2004 .

[29]  Sa-Kwang Song,et al.  DeepRain: ConvLSTM Network for Precipitation Prediction using Multichannel Radar Data , 2017, ArXiv.

[30]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.