Remote Sensing Image Semantic Segmentation Algorithm Based on Improved ENet Network

A remote sensing image semantic segmentation algorithm based on improved ENet network is proposed to improve the accuracy of segmentation. First, dilated convolution and decomposition convolution are introduced in the coding stage. They are used in conjunction with ordinary convolution to increase the receptive field of the model. Each convolution output contains a larger range of image information. Second, in the decoding stage, the image information of different scales is obtained through the upsampling operation and then through the compression, excitation, and reweighting operations of the Squeeze and Excitation (SE) module. The weight of each feature channel is recalibrated to improve the accuracy of the network. Finally, the Softmax activation function and the Argmax function are used to obtain the final segmentation result. Experiments show that our algorithm can significantly improve the accuracy of remote sensing image semantic segmentation.

[1]  Lei Guo,et al.  Remote Sensing Image Scene Classification Using Bag of Convolutional Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[2]  Gong Cheng,et al.  Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Zexuan Zhu,et al.  Computational intelligence in optical remote sensing image processing , 2018, Appl. Soft Comput..

[4]  Chen Chen,et al.  Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion , 2020, Inf. Fusion.

[5]  Vimal K. Shrivastava,et al.  Analysis of various optimizers on deep convolutional neural network model in the application of hyperspectral remote sensing image classification , 2019, International Journal of Remote Sensing.

[6]  Lijun Zhao,et al.  Remote Sensing Image Scene Classification Using CNN-CapsNet , 2019, Remote. Sens..

[7]  Fuad A. Ghaleb,et al.  RS-DCNN: A novel distributed convolutional-neural-networks based-approach for big remote-sensing image classification , 2021, Comput. Electron. Agric..

[8]  Claudia Kuenzer,et al.  Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review - Part II: Applications , 2020, Remote. Sens..

[9]  Qimin Cheng,et al.  Multilabel Remote Sensing Image Retrieval Based on Fully Convolutional Network , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Zhenfeng Shao,et al.  Remote Sensing Image Fusion With Deep Convolutional Neural Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Huiyi Li,et al.  Image semantic segmentation method based on GAN network and ENet model , 2021, The Journal of Engineering.

[12]  Hao Chen,et al.  A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection , 2020, Remote. Sens..

[13]  Teerayut Horanont,et al.  Deep Learning-Based Semantic Segmentation of Urban Features in Satellite Images: A Review and Meta-Analysis , 2021, Remote. Sens..

[14]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Weiwei Cai,et al.  Remote Sensing Image Classification Based on a Cross-Attention Mechanism and Graph Convolution , 2020, IEEE Geoscience and Remote Sensing Letters.

[16]  Junjun Jiang,et al.  Edge-Enhanced GAN for Remote Sensing Image Superresolution , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Wei Xiong,et al.  FA-Net: feature attention network for semantic segmentation of ship port , 2020 .

[18]  Huiming Qu,et al.  Research on Semantic Segmentation of High-resolution Remote Sensing Image Based on Full Convolutional Neural Network , 2018, 2018 12th International Symposium on Antennas, Propagation and EM Theory (ISAPE).

[19]  Xiaohui Yuan,et al.  A review of deep learning methods for semantic segmentation of remote sensing imagery , 2021, Expert Syst. Appl..

[20]  Xiangtao Zheng,et al.  Exploring Models and Data for Remote Sensing Image Caption Generation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Ronghua Shang,et al.  Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Weipeng Jing,et al.  Fully Convolutional Neural Network with Augmented Atrous Spatial Pyramid Pool and Fully Connected Fusion Path for High Resolution Remote Sensing Image Segmentation , 2019, Applied Sciences.

[23]  Pedram Ghamisi,et al.  Remote sensing image classification using subspace sensor fusion , 2020, Inf. Fusion.

[24]  Sim Heng Ong,et al.  Remote Sensing Image Registration Using Multiple Image Features , 2017, Remote. Sens..

[25]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[26]  Bo Chen,et al.  Semantic image segmentation network based on deep learning , 2020, International Symposium on Multispectral Image Processing and Pattern Recognition.

[27]  Shuang Wang,et al.  A deep learning framework for remote sensing image registration , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.