Cloudmaskgan: A Content-Aware Unpaired Image-To-Image Translation Algorithm for Remote Sensing Imagery

Cloud segmentation is a vital task in applications that uti-lize satellite imagery. A common obstacle in using deep learning-based methods for this task is the insufficient number of images with their annotated ground truths. This work presents a content-aware unpaired image-to-image translation algorithm. It generates synthetic images with different land cover types from original images, while preserving the locations and the intensity values of the cloud pixels. Therefore, no manual annotation of ground truth in these images is required. The visual and numerical evaluations of the generated images by the proposed method prove that their quality is better than that of competitive algorithms.

[1]  J. Cihlar,et al.  An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images , 2002 .

[2]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  C. Woodcock,et al.  Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images , 2015 .

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Zhiguo Jiang,et al.  A Cloud Detection Method for Landsat 8 Images Based on PCANet , 2018, Remote. Sens..

[6]  Parvaneh Saeedi,et al.  A Cloud Detection Algorithm for Remote Sensing Images Using Fully Convolutional Neural Networks , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[7]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[8]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[9]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Cordelia Schmid,et al.  How good is my GAN? , 2018, ECCV.

[11]  Bernt Schiele,et al.  Generative Adversarial Text to Image Synthesis , 2016, ICML.

[12]  Antonio Torralba,et al.  Generating Videos with Scene Dynamics , 2016, NIPS.

[13]  Gaofeng Meng,et al.  Efficient cloud detection in remote sensing images using edge-aware segmentation network and easy-to-hard training strategy , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[14]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[16]  Gustau Camps-Valls,et al.  A Deep Network Approach to Multitemporal Cloud Detection , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[17]  Jan Kautz,et al.  Multimodal Unsupervised Image-to-Image Translation , 2018, ECCV.

[18]  Heng Tao Shen,et al.  Unpaired Image-to-Image Translation from Shared Deep Space , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Zhe Zhu,et al.  Object-based cloud and cloud shadow detection in Landsat imagery , 2012 .

[21]  Parvaneh Saeedi,et al.  Cloud-Net: An End-To-End Cloud Detection Algorithm for Landsat 8 Imagery , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Francis Tuluri,et al.  Simulation and prediction of hurricane Lili during landfall over the central gulf states using MM5 modeling system and satellite data , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[23]  Zhenwei Shi,et al.  Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.