Ship detection based on squeeze excitation skip-connection path networks for optical remote sensing images

Abstract Ship detection plays a crucial role in remote sensing image processing, which has drawn great attention in recent years. A novel neural network architecture named squeeze excitation skip-connection path networks (SESPNets) is proposed. A bottom-up path is added to feature pyramid network to improve feature extraction capability, and path-level skip-connection structure is firstly proposed to enhance information flow and reduce parameter redundancy. Also, squeeze excitation module is adopted, which can adaptively recalibrate channel-wise feature responses by adding an extra branch after each shortcut path connection block. The multi-scale fused region of interest (ROI) align is then proposed to obtain more accurate and multi-scale proposals. Finally, soft-non-maximum suppression is utilized to overcome the problem of non-maximum suppression (NMS) in ship detection. As demonstrated in the experiments, it can be seen that the SESPNets model has achieved the state-of-the-art performance, which shows the effectiveness of proposed method.

[1]  Zhao Lin,et al.  A modified faster R-CNN based on CFAR algorithm for SAR ship detection , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[2]  Lining Gao,et al.  A Visual Search Inspired Computational Model for Ship Detection in Optical Satellite Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[3]  Yongdong Zhang,et al.  Implicit Negative Sub-Categorization and Sink Diversion for Object Detection , 2018, IEEE Transactions on Image Processing.

[4]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[6]  Takio Kurita,et al.  Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network , 2017, ICONIP.

[7]  Hui Zhou,et al.  A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Ting Wang,et al.  Melt index prediction by aggregated RBF neural networks trained with chaotic theory , 2014, Neurocomputing.

[9]  Xiaoshuang Ma,et al.  Learning a Dilated Residual Network for SAR Image Despeckling , 2017, Remote. Sens..

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Jianyu Yang,et al.  Ship Detection from Ocean SAR Image Based on Local Contrast Variance Weighted Information Entropy , 2018, Sensors.

[14]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[16]  Zainal Arifin Ahmad,et al.  Improving water quality index prediction in Perak River basin Malaysia through a combination of multiple neural networks , 2017 .

[17]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Marios Savvides,et al.  CMS-RCNN: Contextual Multi-Scale Region-based CNN for Unconstrained Face Detection , 2016, ArXiv.

[19]  Guang Yang,et al.  Ship Detection From Optical Satellite Images Based on Sea Surface Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.

[20]  Irena Hajnsek,et al.  Validating a Notch Filter for Detection of Targets at Sea With ALOS-PALSAR Data: Tokyo Bay , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[22]  Liang Chen,et al.  An Intensity-Space Domain CFAR Method for Ship Detection in HR SAR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[23]  Peiyun Hu,et al.  Finding Tiny Faces , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Zhiguo Jiang,et al.  Ship detection in optical remote sensing images based on deep convolutional neural networks , 2017 .

[25]  Nicolas Longépé,et al.  AIS-Based Evaluation of Target Detectors and SAR Sensors Characteristics for Maritime Surveillance , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[27]  Xin Xu,et al.  Deformable ConvNet with Aspect Ratio Constrained NMS for Object Detection in Remote Sensing Imagery , 2017, Remote. Sens..

[28]  Menglong Yan,et al.  Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks , 2018, Remote. Sens..

[29]  Xinggao Liu,et al.  Melt index prediction by fuzzy functions with dynamic fuzzy neural networks , 2014, Neurocomputing.

[30]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Zhenwei Shi,et al.  Fully Convolutional Network With Task Partitioning for Inshore Ship Detection in Optical Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[32]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Christopher Hay,et al.  Estimation of Crop Evapotranspiration Using Satellite Remote Sensing-Based Vegetation Index , 2018 .

[34]  Jun Wu,et al.  A novel ship classification approach for high resolution SAR images based on the BDA-KELM classification model , 2017 .

[35]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[36]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[37]  Yizhou Yu,et al.  Visual Saliency Detection Based on Multiscale Deep CNN Features , 2016, IEEE Transactions on Image Processing.

[38]  Huanxin Zou,et al.  An Adaptive Ship Detection Scheme for Spaceborne SAR Imagery , 2016, Sensors.

[39]  Maoguo Gong,et al.  An efficient automatic SAR image segmentation framework in AIS using kernel clustering index and histogram statistics , 2014, Appl. Soft Comput..

[40]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Zainal Arifin Ahmad,et al.  Prediction of Combustion Efficiency Using Multiple Neural Networks , 2017 .

[42]  Jun Wu,et al.  A Hierarchical Oil Tank Detector With Deep Surrounding Features for High-Resolution Optical Satellite Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  Matthieu Guillaumin,et al.  Non-maximum Suppression for Object Detection by Passing Messages Between Windows , 2014, ACCV.

[44]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[45]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[46]  Xiuping Jia,et al.  Crater Detection Based on Gist Features , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.