Unsupervised remote sensing image segmentation based on a dual autoencoder

Abstract. Aimed at solving the limitation of the traditional unsupervised segmentation method of remote sensing images that rely more on features and prior knowledge, an unsupervised remote sensing image segmentation method combined with the atrous convolution autoencoder and the bidirectional long- and short-time memory autoencoder autoencoder (BiLSTM) network is proposed. The multispectral remote senses images using the dimensional reduction capacity of the autoencoder to obtain the transverse low-dimensional spatial features of the image through the atrous convolution autoencoder, and they use the BiLSTM autoencoder to learn the longitudinal low-dimensional spectral features of the multiband sequence of the remote sensing image. The batch normalization layer is added to optimize the whole network, and the visualization method is used to dynamically train and adjust the model. The data clustering of two kinds of low-dimensional features is obtained by the softmax algorithm, and unsupervised image segmentation of the multispectral data is finally realized by fusing the clustering results. In the experiment, the original data of Landsat8 remote sensing images were clustered and segmented directly. The results show that the accuracy is up to 83.25% through the clustering of dual autoencoder network in the water information extraction, which is obviously better than the common clustering algorithm and can get better image segmentation results.

[1]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Lin Bai,et al.  Hyperspectral image classification based on spectral-spatial feature extraction , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[3]  Peijun Du,et al.  Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Zheng Niu,et al.  An evaluation of EO-1 hyperspectral Hyperion data for chlorophyll content and leaf area index estimation , 2010 .

[5]  Jon Atli Benediktsson,et al.  Generalized Differential Morphological Profiles for Remote Sensing Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Mantosh Biswas,et al.  Improved color-based K-mean algorithm for clustering of satellite image , 2017, 2017 4th International Conference on Signal Processing and Integrated Networks (SPIN).

[7]  F. Brian Eddy,et al.  Techniques and Applications , 2012 .

[8]  Jun Kong,et al.  Convolutional Neural Networks for Water Body Extraction from Landsat Imagery , 2017, Int. J. Comput. Intell. Appl..

[9]  方旭 Fang Xu,et al.  High Resolution Remote Sensing Image Classification Combining with Mean-Shift Segmentation and Fully Convolution Neural Network , 2018 .

[10]  Richard Lepage,et al.  Road Extraction From Very High Resolution Remote Sensing Optical Images Based on Texture Analysis and Beamlet Transform , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Mohamed Nadif,et al.  Spectral Clustering via Ensemble Deep Autoencoder Learning (SC-EDAE) , 2019, Pattern Recognit..

[12]  黄鸿 Huang Hong,et al.  Hyperspectral remote sensing image classification based on SDE , 2013 .

[13]  Zhenwei Shi,et al.  Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Jiang Wanshou,et al.  Optimization Approach for Multi-scale Segmentation of Remotely Sensed Imagery under k-means Clustering Guidance , 2015 .

[15]  Gholamreza Akbarizadeh,et al.  Semi-supervised Hyperspectral image classification using spatial-spectral features and superpixel-based sparse codes , 2017, 2017 Iranian Conference on Electrical Engineering (ICEE).

[16]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[17]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[18]  Wang Xiangyang New FCM Image Segmentation Based on Texture Measure and Adaptive Threshold , 2010 .

[19]  Chunhui Zhao,et al.  Spatial Logistic Regression for Support-Vector Classification of Hyperspectral Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[20]  Krishna Kant Singh,et al.  Unsupervised change detection in remote sensing images using fusion of spectral and statistical indices , 2018, The Egyptian Journal of Remote Sensing and Space Science.

[21]  Sahar A. El Rahman,et al.  Hyperspectral Imaging Classification Using ISODATA Algorithm: Big Data Challenge , 2015 .

[22]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Shutao Li,et al.  Spectral–Spatial Hyperspectral Image Classification Based on KNN , 2016 .

[24]  Lizhe Wang,et al.  A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[25]  Juha Vesanto,et al.  SOM-based data visualization methods , 1999, Intell. Data Anal..

[26]  Med Salim Bouhlel,et al.  Hyperspectral image feature selection for the fuzzy c-means spatial and spectral clustering , 2016, 2016 International Image Processing, Applications and Systems (IPAS).

[27]  Ling Feng Remote sensing image segmentation using possibilistic fuzzy c-means clustering algorithm based on spatial-information , 2011 .

[28]  Qian Wang,et al.  Study on Remote Sensing Image Segmentation Based on ACA–FCM , 2012 .

[29]  Li Dan,et al.  Method of water information extraction by improved SWI based on GF-1 satellite image , 2017 .

[30]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[31]  Xiangyang Dai,et al.  Hyperspectral Remote Sensing Image Classification Based on Convolutional Neural Network , 2018, 2018 37th Chinese Control Conference (CCC).

[32]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Liu Yang,et al.  Deep Multi-Feature Learning for Water Body Extraction from Landsat Imagery , 2018, Automatic Control and Computer Sciences.