River segmentation based on separable attention residual network

Abstract. River segmentation is an important aspect of remote sensing image analysis. In the actual remote sensing images of rivers, the background is mostly complex and heterogeneous, the traditional detection methods cannot identify the small tributaries and the edge information is rough. To solve the aforementioned problems, we propose a separable attention network based on different size fusion. In this method, residual neural network is used as the backbone network to obtain the information features of rivers, and the deep feature information is fused with the shallow feature information through attention modules of different scales. The shallow feature and large-scale attention module are used to locate the main position of the river, while the deep feature and small-scale attention module are responsible for the fine segmentation of the river edge, so as to accurately extract the river from the background. The experimental results show that, compared with previous methods, the accuracy and detection speed of proposed method are significantly improved. The mean intersection over union (MIoU) on the river segmentation data set reaches 97.07%. Meanwhile, this model has excellent generalization performance, and the MIoU of the public data set CamVid reaches 69.4%.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Xu Zhang,et al.  Non-intrusive load disaggregation based on deep dilated residual network , 2019, Electric Power Systems Research.

[4]  Richard Lepage,et al.  River Extraction From High-Resolution SAR Images Combining a Structural Feature Set and Mathematical Morphology , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[10]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[11]  Jinping Sun,et al.  River detection algorithm in SAR images based on edge extraction and ridge tracing techniques , 2011 .

[12]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  H. A. Jalab,et al.  River segmentation using satellite image contextual information and Bayesian classifier , 2016 .

[14]  Nitesh Sinha,et al.  Texture information-based hybrid methodology for the segmentation of SAR images , 2011 .

[15]  Ying Wang,et al.  Robot path planning based on multi-objective optimization with local search , 2018, J. Intell. Fuzzy Syst..

[16]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Roberto Cipolla,et al.  Segmentation and Recognition Using Structure from Motion Point Clouds , 2008, ECCV.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Jian Yang,et al.  Selective Kernel Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  P. McIntyre,et al.  Global threats to human water security and river biodiversity , 2010, Nature.

[23]  Zhou Jianjiang,et al.  SAR River Image Segmentation Based on Reciprocal Gray Entropy and Improved Chan-Vese Model , 2015 .

[24]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Liguo Weng,et al.  Cloud/snow recognition for multispectral satellite imagery based on a multidimensional deep residual network , 2018, International Journal of Remote Sensing.

[27]  Gang Yu,et al.  BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation , 2018, ECCV.

[28]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Hui Wang,et al.  Study on river segmentation and bridge recognition for SAR image based on FSVM , 2014, Other Conferences.

[30]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.