Cloud/snow recognition for multispectral satellite imagery based on a multidimensional deep residual network

ABSTRACT Cloud/snow recognition technology for multispectral satellite imagery plays an important role in resource investigation, natural disasters, and environmental pollution. Traditional feature based classification methods cannot make full use of the effective features and multispectral optical parameters of satellite imagery; the precision of cloud/snow recognition is not good enough. Although deep convolution neural network (CNN) can extract features effectively, it faces training gradient diffusion and model degradation, which lead to a low accuracy in classification. In order to solve this problem, an improved deep residual network with multidimensional input is proposed for the cloud/snow recognition. The multidimensional deep residual network (M-ResNet) can effectively extract the image features and spectral information of satellite imagery. The multispectral satellite imagery is divided into cloud/snow-free, cloud only, snow only and cloud/snow mixed using the proposed method. The experimental results of HuanJing-1A/1B (HJ-1A/1B) satellite imagery in China show that the M-ResNet performs a good distinction for the four kinds of images. The accuracy of the classification is higher than support vector machine (SVM), random forest, convolution neural networks, and multi-grained cascaded forest (GcForest).

[1]  S. Vasuki,et al.  Improved segmentation and change detection of multi-spectral satellite imagery using graph cut based clustering and multiclass SVM , 2017, Multimedia Tools and Applications.

[2]  Ji Feng,et al.  Deep Forest: Towards An Alternative to Deep Neural Networks , 2017, IJCAI.

[3]  Zengfu Wang,et al.  Video Superresolution via Motion Compensation and Deep Residual Learning , 2017, IEEE Transactions on Computational Imaging.

[4]  Deren Li,et al.  Cloud Detection for High-Resolution Satellite Imagery Using Machine Learning and Multi-Feature Fusion , 2016, Remote. Sens..

[5]  Jun Qin,et al.  SVM-based soft classification of urban tree species using very high-spatial resolution remote-sensing imagery , 2016 .

[6]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[9]  Jürgen Schmidhuber,et al.  Highway Networks , 2015, ArXiv.

[10]  Marko Radulovic,et al.  Gray-Level Co-Occurrence Matrix Texture Analysis of Breast Tumor Images in Prognosis of Distant Metastasis Risk , 2015, Microscopy and Microanalysis.

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[14]  Yudong Tian,et al.  A new approach to satellite-based estimation of precipitation over snow cover , 2014 .

[15]  Sun Le.  Feature extraction based on combined textural features from panchromatic cloud and snow region , 2014 .

[16]  W. Paul Menzel,et al.  Impact of the Aqua MODIS Band 6 Restoration on Cloud/Snow Discrimination , 2013 .

[17]  Ding Haiyan,et al.  Automatic Identification of Cloud and Snow based on Fractal Dimension , 2013 .

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Stefan Dech,et al.  Remote sensing of snow – a review of available methods , 2012 .

[20]  Qing Li,et al.  Chinese HJ-1A/B satellites and data characteristics , 2010 .

[21]  Liu Haijiang,et al.  Monitoring sandy desertification of Otindag Sandy Land based on multi-date remote sensing images , 2008 .

[22]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[23]  Ying Qing-jun,et al.  Research on Distinguishing between Cloud and Snow with NOAA Images , 2002 .

[24]  Matthew T. Freedman,et al.  Artificial convolution neural network techniques and applications for lung nodule detection , 1995, IEEE Trans. Medical Imaging.

[25]  Philip A. Durkee,et al.  Snow/Cloud Discrimination with Multispectral Satellite Measurements , 1990 .