Cloud Detection from RGB Color Remote Sensing Images with Deep Pyramid Networks

Cloud detection from remotely observed data is a critical pre-processing step for various remote sensing applications. In particular, this problem becomes even harder for RGB color images, since there is no distinct spectral pattern for clouds, which is directly separable from the Earth surface. In this paper, we adapt a deep pyramid network (DPN) to tackle this problem. For this purpose, the network is enhanced with a pre-trained parameter model at the encoder layer. Moreover, the method is able to obtain accurate pixel-level segmentation and classification results from a set of noisy labeled RGB color images. In order to demonstrate the superiority of the method, we collect and label data with the corresponding cloud/non-cloudy masks acquired from low-orbit Gokturk-2 and RASAT satellites. The experimental results validates that the proposed method outperforms several baselines even for hard cases (e.g. snowy mountains) that are perceptually difficult to distinguish by human eyes.

[1]  Zhe Zhu,et al.  Object-based cloud and cloud shadow detection in Landsat imagery , 2012 .

[2]  Liangpei Zhang,et al.  Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model , 2014 .

[3]  Paolo Gamba,et al.  Automatic Delineation of Clouds and Their Shadows in Landsat and CBERS (HRCC) Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Gozde Bozdagi Akar,et al.  EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Zhe Zhu,et al.  Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: An algorithm designed specifically for monitoring land cover change , 2014 .

[7]  Justin Braaten,et al.  Automated cloud and cloud shadow identification in Landsat MSS imagery for temperate ecosystems , 2015 .

[8]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Pierre Alliez,et al.  High-Resolution Semantic Labeling with Convolutional Neural Networks , 2016 .

[11]  Mustafa Teke,et al.  SATELLITE IMAGE PROCESSING WORKFLOW FOR RASAT ANDGÖKTÜRK-2 , 2016 .

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Gustau Camps-Valls,et al.  Cloud masking and removal in remote sensing image time series , 2017 .

[14]  Zhenwei Shi,et al.  Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Yan Wang,et al.  Automatic Recognition of Cloud Images by Using Visual Saliency Features , 2015, IEEE Geoscience and Remote Sensing Letters.

[16]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[17]  S. Goward,et al.  Characterization of the Landsat-7 ETM Automated Cloud-Cover Assessment (ACCA) Algorithm , 2006 .

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.