Cloud Detection for High-Resolution Satellite Imagery Using Machine Learning and Multi-Feature Fusion

The accurate location of clouds in images is prerequisite for many high-resolution satellite imagery applications such as atmospheric correction, land cover classifications, and target recognition. Thus, we propose a novel approach for cloud detection using machine learning and multi-feature fusion based on a comparative analysis of typical spectral, textural, and other feature differences between clouds and backgrounds. To validate this method, we tested it on 102 Gao Fen-1(GF-1) and Gao Fen-2(GF-2) satellite images. The overall accuracy of our multi-feature fusion method for cloud detection was more than 91.45%, and the Kappa coefficient for all the tested images was greater than 80%. The producer and user accuracy were also higher at 93.67% and 95.67%, respectively; both of these values were higher than the values for the other tested feature fusion methods. Our results show that this novel multi-feature approach yields better accuracy than other feature fusion methods. In post-processing, we applied an object-oriented method to remove the influence of highly reflective ground objects and further improved the accuracy. Compared to traditional methods, our new method for cloud detection is accurate, exhibits good scalability, and produces consistent results when mapping clouds of different types and sizes over various land surfaces that contain natural vegetation, agriculture land, built-up areas, and water bodies.

[1]  M. Burge,et al.  Digital Image Processing , 2016, Texts in Computer Science.

[2]  Xian Wu,et al.  Evaluation of semivariogram features for object-based image classification , 2015, Geo spatial Inf. Sci..

[3]  Giles M. Foody,et al.  The effect of mis-labeled training data on the accuracy of supervised image classification by SVM , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[4]  Emre Baseski,et al.  Texture and color based cloud detection , 2015, 2015 7th International Conference on Recent Advances in Space Technologies (RAST).

[5]  Xiangyun Hu,et al.  Bag-of-Words and Object-Based Classification for Cloud Extraction From Satellite Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  C. Woodcock,et al.  Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images , 2015 .

[7]  Yun Chen,et al.  Sub-pixel flood inundation mapping from multispectral remotely sensed images based on discrete particle swarm optimization , 2015 .

[8]  Won Hee Lee,et al.  Automatic cloud detection for high spatial resolution multi-temporal images , 2014 .

[9]  M. Joseph Hughes,et al.  Automated Detection of Cloud and Cloud Shadow in Single-Date Landsat Imagery Using Neural Networks and Spatial Post-Processing , 2014, Remote. Sens..

[10]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Adrian Fisher,et al.  Cloud and Cloud-Shadow Detection in SPOT5 HRG Imagery with Automated Morphological Feature Extraction , 2014, Remote. Sens..

[12]  Jordi Cristóbal,et al.  Enhanced land use/cover classification of heterogeneous tropical landscapes using support vector machines and textural homogeneity , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[13]  Nantheera Anantrasirichai,et al.  SVM-based texture classification in Optical Coherence Tomography , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[14]  Paolo Addesso,et al.  SVM-based cloud detection aided by contextual information , 2012, 2012 Tyrrhenian Workshop on Advances in Radar and Remote Sensing (TyWRRS).

[15]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[16]  Zhe Zhu,et al.  Object-based cloud and cloud shadow detection in Landsat imagery , 2012 .

[17]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Peter Vogt,et al.  A cloud mask methodology for high resolution remote sensing data combining information from high and medium resolution optical sensors , 2011 .

[19]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[20]  Izak Van Zyl Marais,et al.  An optimal image transform for threshold-based cloud detection using heteroscedastic discriminant analysis , 2011 .

[21]  Chengquan Huang,et al.  Automated masking of cloud and cloud shadow for forest change analysis using Landsat images , 2010 .

[22]  D. Roy,et al.  Web-enabled Landsat Data (WELD): Landsat ETM+ composited mosaics of the conterminous United States , 2010 .

[23]  Ramachandra Raghavendra,et al.  Texture Based Approach for Cloud Classification Using SVM , 2009, 2009 International Conference on Advances in Recent Technologies in Communication and Computing.

[24]  Chun-Liang Chien,et al.  Automatic cloud removal from multi-temporal SPOT images , 2008, Appl. Math. Comput..

[25]  Martino Pesaresi,et al.  A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural Measure , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Hao Guan,et al.  Application of support vector machines in cloud detection using EOS/MODIS , 2008, Applied Optics and Photonics China.

[27]  Y. Ouma,et al.  Analysis of co‐occurrence and discrete wavelet transform textures for differentiation of forest and non‐forest vegetation in very‐high‐resolution optical‐sensor imagery , 2008 .

[28]  D. Lu,et al.  Detection and substitution of clouds/hazes and their cast shadows on IKONOS images , 2007 .

[29]  Christophe Latry,et al.  Cloud detection with SVM technique , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[30]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Anne Puissant,et al.  The utility of texture analysis to improve per‐pixel classification for high to very high spatial resolution imagery , 2005 .

[32]  Jon Atli Benediktsson,et al.  Exploiting spectral and spatial information in hyperspectral urban data with high resolution , 2004, IEEE Geoscience and Remote Sensing Letters.

[33]  Silas C. Michaelides,et al.  Multifeature texture analysis for the classification of clouds in satellite imagery , 2003, IEEE Trans. Geosci. Remote. Sens..

[34]  Alex M. Andrew An Introduction to Support Vector Machines and Other Kernel‐based Learning Methods , 2001 .

[35]  Mahmood R. Azimi-Sadjadi,et al.  Temporal updating scheme for probabilistic neural network with application to satellite cloud classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[36]  Iain MacLaren,et al.  Neural network based methods for cloud classification on AVHRR images , 2000 .

[37]  Alok Gupta,et al.  Color and texture fusion: application to aerial image segmentation and GIS updating , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[38]  Jason I. Gobat,et al.  Improved cloud detection in GOES scenes over the oceans , 1995 .

[39]  Y. Kaufman,et al.  Algorithm for automatic atmospheric corrections to visible and near-IR satellite imagery , 1988 .

[40]  P. M. Teillet,et al.  Image correction for radiometric effects in remote sensing , 1986 .

[41]  Clair L. Wyatt,et al.  Radiometric Calibration: Theory and Methods , 1978 .

[42]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[43]  Jun Zhou,et al.  Object Classification via Feature Fusion Based Marginalized Kernels , 2015, IEEE Geoscience and Remote Sensing Letters.

[44]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Imran Sarwar Bajwa,et al.  Feature Based Image Classification by using Principal Component Analysis , 2009 .

[46]  C. Brockmann,et al.  A METHOD FOR DETECTION AND CLASSIFICATION OF CLOUDS OVER WATER , 2008 .

[47]  Hao Guan,et al.  Application of support vector machines in cloud detection using EOS/MODIS , 2008, Optical Engineering + Applications.

[48]  Fen Chen,et al.  Haze Detection and Removal in Remote Sensing Images Based on Undecimated Wavelet Transform , 2007 .

[49]  Serhiy Skakun,et al.  COMPARATIVE ANALYSIS OF NEURAL NETWORKS AND STATISTICAL APPROACHES TO REMOTE SENSING IMAGE CLASSIFICATION , 2006 .

[50]  X. Zheng,et al.  OPERATIONAL METHOD OF TOTAL PRECIPITABLE WATER RETRIEVED FROM SATELLITE MULTI-CHANNELS’ INFRARED DATA , 2005 .

[51]  Li Hou,et al.  Aerial Image Classification Method Based on Fractal Theory , 2001 .

[52]  Victor E. DeBrunner,et al.  Texture-based segmentation of satellite weather imagery , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[53]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .