P_Segnet and NP_Segnet: New Neural Network Architectures for Cloud Recognition of Remote Sensing Images

In recent years, remote sensing images have played an important role in environmental monitoring, weather forecasting, and agricultural planning. However, remote sensing images often contain a large number of cloud layers. These clouds can cover a large amount of surface information. Therefore, an increasing number of cloud recognition methods have been proposed to reduce the impact of cloud cover. There are many difficulties in traditional cloud recognition methods. For example, the threshold method based on spectral features improves the accuracy of cloud detection, but it often leads to omission or misjudgment in cloud detection and depends on prior knowledge. To improve the accuracy and efficiency of cloud recognition, we use deep learning to address cloud recognition problems in remote sensing imagery. We propose a series of methods from the acquisition and production of training datasets to neural network training and cloud recognition applications. This paper describes a realization of cloud recognition of remote sensing imagery based on SegNet architecture. We have proposed two architectures named P_SegNet and NP_SegNet, which are modified from SegNet. Some parallel structures were also employed into the SegNet architecture to improve the accuracy of cloud recognition. Due to these changes, this paper also discusses the impact of the symmetry network structure on the final accuracy. Our proposed method was compared with the well-known fully convolutional neural network (FCNN) approach. The results have demonstrated the feasibility and practicality of using deep learning approach for cloud recognition in remote sensing images.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Yg,et al.  Dropout as a Bayesian Approximation : Insights and Applications , 2015 .

[3]  Zhiguo Cao,et al.  DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Albert Y. Zomaya,et al.  pipsCloud: High performance cloud computing for remote sensing big data management and processing , 2018, Future Gener. Comput. Syst..

[5]  Andrew Y. Ng,et al.  Parsing Natural Scenes and Natural Language with Recursive Neural Networks , 2011, ICML.

[6]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling , 2015, CVPR 2015.

[7]  Roberto Cipolla,et al.  Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding , 2015, BMVC.

[8]  Gary Jedlovec Automated Detection of Clouds in Satellite Imagery , 2009 .

[9]  P. Gong,et al.  Object-based Detailed Vegetation Classification with Airborne High Spatial Resolution Remote Sensing Imagery , 2006 .

[10]  Zhe Zhu,et al.  Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: An algorithm designed specifically for monitoring land cover change , 2014 .

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Feng Zhang,et al.  CloudNet: Ground‐Based Cloud Classification With Deep Convolutional Neural Network , 2018, Geophysical Research Letters.

[13]  Wei Jie,et al.  A cloud-based remote sensing data production system , 2017, Future Gener. Comput. Syst..

[14]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[15]  Sven Behnke,et al.  Fast Semantic Segmentation of RGB-D Scenes with GPU-Accelerated Deep Neural Networks , 2014, KI.

[16]  Jun Sun,et al.  Cloud and Cloud Shadow Detection Using Multilevel Feature Fused Segmentation Network , 2018, IEEE Geoscience and Remote Sensing Letters.

[17]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[18]  Albert Y. Zomaya,et al.  A Parallel File System with Application-Aware Data Layout Policies for Massive Remote Sensing Image Processing in Digital Earth , 2015, IEEE Transactions on Parallel and Distributed Systems.

[19]  Zhe Zhu,et al.  Object-based cloud and cloud shadow detection in Landsat imagery , 2012 .

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  范荣双 Fan Rongshuang,et al.  Cloud Detection of ZY-3 Satellite Remote Sensing Images Based on Deep Learning , 2018 .

[22]  Zhang Ce,et al.  A review of cloud detection methods in remote sensing images , 2017 .

[23]  D. Flanders,et al.  Preliminary evaluation of eCognition object-based software for cut block delineation and feature extraction , 2003 .

[24]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[25]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Liu Zhi-gang,et al.  Cloud Detection of MODIS Satellite Images Based on Dynamical Cluster , 2007 .

[27]  Albert Y. Zomaya,et al.  Spatiotemporal Fusion of MODIS and Landsat-7 Reflectance Images via Compressed Sensing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[28]  LI Xing-shan,et al.  A Method for Detecting Cloud in Satellite Remote Sensing Image Based on Texture , 2007 .

[29]  Chen Hong-shun Cloud Detection of MODIS Data Based on FCM , 2009 .

[30]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Xian-Jun Gao,et al.  [Real-time automatic cloud detection during the process of taking aerial photographs]. , 2014, Guang pu xue yu guang pu fen xi = Guang pu.

[32]  Yu Liu,et al.  An Improved Cloud Classification Algorithm for China’s FY-2C Multi-Channel Images Using Artificial Neural Network , 2009, Sensors.