Sky Image forecasting with Generative Adversarial Networks for cloud coverage prediction

This work focuses on the problem of sky image prediction using Generative Adversarial Networks (GANs). Sky images observation is used for cloud coverage short-term forecasting and therefore by predicting the future frames of a sky image sequence, a better estimate of the available solar resource for renewables could be achieved. For this purpose, a Deep Convolutional Neural Network (CNN) topology is trained with an Adversarial loss in order to produce realistic future frames of the input image sequences. The prediction of future frames is incurred by two different approaches. In the first approach, a network is receiving 4 frames and predicting the next frame and in the second approach, given a sequence of 8 input images a network is predicting the next 8 frames. In order to evaluate the quality of the generated images, a criterion based on cloud coverage is proposed. This cloud coverage metric provides an objective criterion for assessing the quality of the generated sky images, especially in the presence of clouds.

[1]  Andreas Kazantzidis,et al.  Cloud observations in Switzerland using hemispherical sky cameras , 2015 .

[2]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Jan Kleissl,et al.  Solar irradiance forecasting using a ground-based sky imager developed at UC San Diego , 2014 .

[5]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[6]  Stefan Winkler,et al.  Estimation of solar irradiance using ground-based whole sky imagers , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[7]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[8]  George Economou,et al.  Cloud detection and classification with the use of whole-sky ground-based images , 2012 .

[9]  George Economou,et al.  A local binary pattern classification approach for cloud types derived from all-sky imagers , 2018, International Journal of Remote Sensing.

[10]  Chi-Keung Tang,et al.  Deep Video Generation, Prediction and Completion of Human Action Sequences , 2017, ECCV.

[11]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[12]  Carlos F.M. Coimbra,et al.  Cloud-tracking methodology for intra-hour DNI forecasting , 2014 .

[13]  Marc'Aurelio Ranzato,et al.  Video (language) modeling: a baseline for generative models of natural videos , 2014, ArXiv.

[14]  François Laviolette,et al.  Domain-Adversarial Neural Networks , 2014, ArXiv.

[15]  Yann LeCun,et al.  Deep multi-scale video prediction beyond mean square error , 2015, ICLR.

[16]  Gabriel Kreiman,et al.  Unsupervised Learning of Visual Structure using Predictive Generative Networks , 2015, ArXiv.