Prediction of Short-Time Cloud Motion Using a Deep-Learning Model

A cloud image can provide significant information, such as precipitation and solar irradiation. Predicting short-time cloud motion from images is the primary means of making intra-hour irradiation forecasts for solar-energy production and is also important for precipitation forecasts. However, it is very challenging to predict cloud motion (especially nonlinear motion) accurately. Traditional methods of cloud-motion prediction are based on block matching and the linear extrapolation of cloud features; they largely ignore nonstationary processes, such as inversion and deformation, and the boundary conditions of the prediction region. In this paper, the prediction of cloud motion is regarded as a spatiotemporal sequence-forecasting problem, for which an end-to-end deep-learning model is established; both the input and output are spatiotemporal sequences. The model is based on gated recurrent unit (GRU)- recurrent convolutional network (RCN), a variant of the gated recurrent unit (GRU), which has convolutional structures to deal with spatiotemporal features. We further introduce surrounding context into the prediction task. We apply our proposed Multi-GRU-RCN model to FengYun-2G satellite infrared data and compare the results to those of the state-of-the-art method of cloud-motion prediction, the variational optical flow (VOF) method, and two well-known deep-learning models, namely, the convolutional long short-term memory (ConvLSTM) and GRU. The Multi-GRU-RCN model predicts intra-hour cloud motion better than the other methods, with the largest peak signal-to-noise ratio and structural similarity index. The results prove the applicability of the GRU-RCN method for solving the spatiotemporal data prediction problem and indicate the advantages of our model for further applications.

[1]  B. Soden,et al.  Robust Responses of the Hydrological Cycle to Global Warming , 2006 .

[2]  Erik Valdemar Cuevas Jiménez,et al.  Block-matching algorithm based on differential evolution for motion estimation , 2014, Eng. Appl. Artif. Intell..

[3]  Subhasis Mitra,et al.  Novel approach to identify good tracer clouds from a sequence of satellite images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[4]  J. Mecikalski,et al.  Application of Satellite-Derived Atmospheric Motion Vectors for Estimating Mesoscale Flows , 2005 .

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  I. Ahmad,et al.  Satellite precipitation product: Applicability and accuracy evaluation in diverse region , 2020 .

[7]  T. Hoff,et al.  Short-term irradiance variability: Preliminary estimation of station pair correlation as a function of distance , 2012 .

[8]  Zhiguo Cao,et al.  DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jan Kleissl,et al.  Cloud speed sensor , 2013 .

[11]  Jan Kleissl,et al.  Solar irradiance forecasting using a ground-based sky imager developed at UC San Diego , 2014 .

[12]  Mihai Datcu,et al.  Special focus on deep learning in remote sensing image processing , 2020, Science China Information Sciences.

[13]  J. Kleissl,et al.  Intra-hour forecasting with a total sky imager at the UC San Diego solar energy testbed , 2011 .

[14]  J. Kleissl,et al.  Cloud motion vectors from a network of ground sensors in a solar power plant , 2013 .

[15]  Jan Kleissl,et al.  Cloud speed impact on solar variability scaling – Application to the wavelet variability model , 2013 .

[16]  W. Menzel,et al.  Cloud Tracking with Satellite Imagery: From the Pioneering Work of Ted Fujita to the Present , 2001 .

[17]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[18]  Stefan Lessmann,et al.  A comparative study of LSTM neural networks in forecasting day-ahead global horizontal irradiance with satellite data , 2018 .

[19]  Serge J. Belongie,et al.  Cloud motion and stability estimation for intra-hour solar forecasting , 2015 .

[20]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[21]  Antonio Turiel,et al.  Multiscale techniques for the detection of precipitation using thermal IR satellite images , 2005, IEEE Geoscience and Remote Sensing Letters.

[22]  D. Randall,et al.  Geographical and Seasonal Variability of Cloud‐Radiative Feedbacks on Precipitation , 2019, Journal of Geophysical Research: Atmospheres.

[23]  Zhiwei Li,et al.  Deep learning based cloud detection for remote sensing images by the fusion of multi-scale convolutional features , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[24]  Snehlata Shakya,et al.  Characterising and predicting the movement of clouds using fractional-order optical flow , 2019, IET Image Process..

[25]  A. Hammer,et al.  Short-term forecasting of solar radiation: a statistical approach using satellite data , 1999 .

[26]  Jan Kleissl,et al.  Robust cloud motion estimation by spatio-temporal correlation analysis of irradiance data , 2018 .

[27]  Richard Perez,et al.  Modeling PV fleet output variability , 2012 .

[28]  Luiz A. T. Machado,et al.  Forecast and Tracking the Evolution of Cloud Clusters (ForTraCC) Using Satellite Infrared Imagery: Methodology and Validation , 2008 .

[29]  Yugang Niu,et al.  Hourly day-ahead solar irradiance prediction using weather forecasts by LSTM , 2018 .

[30]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  M. Allen,et al.  Corrigendum: Constraints on future changes in climate and the hydrologic cycle , 2012, Nature.

[32]  Carlos F.M. Coimbra,et al.  Cloud-tracking methodology for intra-hour DNI forecasting , 2014 .