End-to-End Ship Detection in SAR Images for Complex Scenes Based on Deep CNNs

Ship detection on synthetic aperture radar (SAR) imagery has many valuable applications for both civil and military fields and has received extraordinary attention in recent years. The traditional detection methods are insensitive to multiscale ships and usually time-consuming, results in low detection accuracy and limitation for real-time processing. To balance the accuracy and speed, an end-to-end ship detection method for complex inshore and offshore scenes based on deep convolutional neural networks (CNNs) is proposed in this paper. First, the SAR images are divided into different grids, and the anchor boxes are predefined based on the responsible grids for dense ship prediction. Then, Darknet-53 with residual units is adopted as a backbone to extract features, and a top-down pyramid structure is added for multiscale feature fusion with concatenation. By this means, abundant hierarchical features containing both spatial and semantic information are extracted. Meanwhile, the strategies such as soft non-maximum suppression (Soft-NMS), mix-up and mosaic data augmentation, multiscale training, and hybrid optimization are used for performance enhancement. Besides, the model is trained from scratch to avoid learning objective bias of pretraining. The proposed one-stage method adopts end-to-end inference by a single network, so the detection speed can be guaranteed due to the concise paradigm. Extensive experiments are performed on the public SAR ship detection dataset (SSDD), and the results show that the method can detect both inshore and offshore ships with higher accuracy than other mainstream methods, yielding the accuracy with an average of 95.52%, and the detection speed is quite fast with about 72 frames per second (FPS). The actual Sentinel-1 and Gaofen-3 data are utilized for verification, and the detection results also show the effectiveness and robustness of the method.

[1]  Hongyi Zhang,et al.  mixup: Beyond Empirical Risk Minimization , 2017, ICLR.

[2]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Xuemei Pu,et al.  A Novel Convolutional Neural Network Architecture for SAR Target Recognition , 2019, J. Sensors.

[4]  Jianwei Li,et al.  Ship detection in SAR images based on an improved faster R-CNN , 2017, 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA).

[5]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Xiaoling Zhang,et al.  Depthwise Separable Convolution Neural Network for High-Speed SAR Ship Detection , 2019, Remote. Sens..

[7]  Gangyao Kuang,et al.  An Adaptive and Fast CFAR Algorithm Based on Automatic Censoring for Target Detection in High-Resolution SAR Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Abdelhak M. Zoubir,et al.  Estimation of the parameters of the K-distribution using higher order and fractional moments [radar clutter] , 1999 .

[9]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Benjamin Friedlander,et al.  A CFAR adaptive subspace detector for second-order Gaussian signals , 2005, IEEE Transactions on Signal Processing.

[14]  Xiaoling Zhang,et al.  High-Speed Ship Detection in SAR Images Based on a Grid Convolutional Neural Network , 2019, Remote. Sens..

[15]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Zongxu Pan,et al.  DRBox-v2: An Improved Detector With Rotatable Boxes for Target Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[19]  Shilin Zhou,et al.  Fast Shape Parameter Estimation of the Complex Generalized Gaussian Distribution in SAR Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[20]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Qi Li,et al.  Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Wenxian Yu,et al.  A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection From SAR Images , 2018, IEEE Access.

[23]  Shilin Zhou,et al.  Ship Detection Based on Complex Signal Kurtosis in Single-Channel SAR Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Jun Li,et al.  Fuzzy statistical normalization CFAR detector for non-rayleigh data , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[27]  Mingzhe Li,et al.  Efficient Low-Cost Ship Detection for SAR Imagery Based on Simplified U-Net , 2020, IEEE Access.

[28]  Huanxin Zou,et al.  A Novel Variable Index and Excision CFAR Based Ship Detection Method on SAR Imagery , 2015, J. Sensors.

[29]  Jiafeng Zhang,et al.  CFAR Ship Detection in Polarimetric Synthetic Aperture Radar Images Based on Whitening Filter , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Lei Deng,et al.  Effective and Efficient Batch Normalization Using a Few Uncorrelated Data for Statistics Estimation , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[33]  Meng Yang,et al.  Ship Detection in SAR Images Based on Lognormal $\rho$ -Metric , 2018, IEEE Geoscience and Remote Sensing Letters.

[34]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[35]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[36]  Nadav Levanon,et al.  Performances of order statistics CFAR , 1991 .

[37]  Kaiming He,et al.  Rethinking ImageNet Pre-Training , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[38]  Shilin Zhou,et al.  Learning Deep Ship Detector in SAR Images From Scratch , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Wenhui,et al.  AIR-SARShip-1.0: High-resolution SAR Ship Detection Dataset , 2020 .

[40]  Thomas Fritz,et al.  Ship Surveillance With TerraSAR-X , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Carlos López-Martínez,et al.  A novel algorithm for ship detection in SAR imagery based on the wavelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[42]  Xiao Xiang Zhu,et al.  Deep learning in remote sensing: a review , 2017, ArXiv.

[43]  Richard Socher,et al.  Improving Generalization Performance by Switching from Adam to SGD , 2017, ArXiv.

[44]  M. Weiss,et al.  Analysis of Some Modified Cell-Averaging CFAR Processors in Multiple-Target Situations , 1982, IEEE Transactions on Aerospace and Electronic Systems.

[45]  Yi Su,et al.  Inshore Ship Detection via Saliency and Context Information in High-Resolution SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[46]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[47]  Chuan He,et al.  MSARN: A Deep Neural Network Based on an Adaptive Recalibration Mechanism for Multiscale and Arbitrary-Oriented SAR Ship Detection , 2019, IEEE Access.

[48]  Jieping Ye,et al.  Object Detection in 20 Years: A Survey , 2019, Proceedings of the IEEE.

[49]  Mohan M. Trivedi,et al.  Localized Radon transform-based detection of ship wakes in SAR images , 1995, IEEE Trans. Geosci. Remote. Sens..

[50]  Lena Chang,et al.  Ship Detection Based on YOLOv2 for SAR Imagery , 2019, Remote. Sens..

[51]  Tianqi Chen,et al.  Empirical Evaluation of Rectified Activations in Convolutional Network , 2015, ArXiv.

[52]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[53]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Harm Greidanus,et al.  Ambiguity discrimination for ship detection using Sentinel-1 repeat acquisition operations , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[55]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[56]  Jiao Jiao,et al.  A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection , 2018, IEEE Access.