A Novel CNN-Based Detector for Ship Detection Based on Rotatable Bounding Box in SAR Images

Thanks to the excellent feature representation capabilities of neural networks, deep learning-based methods perform far better than traditional methods on target detection tasks such as ship detection. Although various network models have been proposed for SAR ship detection such as DRBox-v1, DRBox-v2, and MSR2N, there are still some problems such as mismatch of feature scale, contradictions between different learning tasks, and unbalanced distribution of positive samples, which have not been mentioned in these studies. In this article, an improved one-stage object detection framework based on RetinaNet and rotatable bounding box (RBox), which is referred as R-RetinaNet, is proposed to solve the above problems. The main improvements of R-RetinaNet as well as the contributions of this article are threefold. First, a scale calibration method is proposed to align the scale distribution of the output backbone feature map with the scale distribution of the targets. Second, a feature fusion network based on task-wise attention feature pyramid network is designed to decouple the feature optimization process of different tasks, which alleviates the conflict between different learning goals. Finally, an adaptive intersection over union (IoU) threshold training method is proposed for RBox-based model to correct the unbalanced distribution of positive samples caused by the fixed IoU threshold on RBox. Experimental results show that our method obtains 13.26%, 9.49%, 8.92%, and 4.55% gains in average precision under an IoU threshold of 0.5 on the public SAR ship detection dataset compared with four state-of-the-art RBox-based methods, respectively.

[1]  Xueru Bai,et al.  Ship Detection Using Deep Convolutional Neural Networks for PolSAR Images , 2019, Remote. Sens..

[2]  Chuan He,et al.  A Deep Neural Network Based on an Attention Mechanism for SAR Ship Detection in Multiscale and Complex Scenarios , 2019, IEEE Access.

[3]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Qi Li,et al.  Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Shilin Zhou,et al.  Scheme of Parameter Estimation for Generalized Gamma Distribution and Its Application to Ship Detection in SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Guanglu Song,et al.  Revisiting the Sibling Head in Object Detector , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Hong Zhang,et al.  Ship Classification in High-Resolution SAR Images Using Deep Learning of Small Datasets , 2018, Sensors.

[8]  Wenxian Yu,et al.  A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection From SAR Images , 2018, IEEE Access.

[9]  Xiaoling Zhang,et al.  Depthwise Separable Convolution Neural Network for High-Speed SAR Ship Detection , 2019, Remote. Sens..

[10]  Antonio Moccia,et al.  Segmentation of Marine SAR Images by Sublook Analysis and Application to Sea Traffic Monitoring , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jianwei Li,et al.  Ship detection in SAR images based on an improved faster R-CNN , 2017, 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA).

[12]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jie Zhang,et al.  Imbalanced Learning-Based Automatic SAR Images Change Detection by Morphologically Supervised PCA-Net , 2019, IEEE Geoscience and Remote Sensing Letters.

[14]  Irena Hajnsek,et al.  Ship Detection with Spectral Analysis of Synthetic Aperture Radar: A Comparison of New and Well-Known Algorithms , 2015, Remote. Sens..

[15]  Haipeng Wang,et al.  A Lightweight Feature Optimizing Network for Ship Detection in SAR Image , 2019, IEEE Access.

[16]  Xiaoling Zhang,et al.  HQ-ISNet: High-Quality Instance Segmentation for Remote Sensing Imagery , 2020, Remote. Sens..

[17]  Jiao Jiao,et al.  A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection , 2018, IEEE Access.

[18]  Rong Yang,et al.  MSR2N: Multi-Stage Rotational Region Based Network for Arbitrary-Oriented Ship Detection in SAR Images , 2020, Sensors.

[19]  Zhao Lin,et al.  A modified faster R-CNN based on CFAR algorithm for SAR ship detection , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[20]  Gangyao Kuang,et al.  Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[21]  Zhenwei Shi,et al.  Ship Detection in Spaceborne Optical Image With SVD Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Hong Zhang,et al.  Automatic Ship Detection Based on RetinaNet Using Multi-Resolution Gaofen-3 Imagery , 2019, Remote. Sens..

[23]  Jian Yang,et al.  Ship Detection Using Polarization Cross-Entropy , 2009, IEEE Geoscience and Remote Sensing Letters.

[24]  Shilin Zhou,et al.  Statistical Modeling of PMA Detector for Ship Detection in High-Resolution Dual-Polarization SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Ridha Touzi,et al.  Characterization of target symmetric scattering using polarimetric SARs , 2002, IEEE Trans. Geosci. Remote. Sens..

[26]  Armando Marino,et al.  Ship detection with RadarSat-2 Quad-Pol sar data using a notch filter based on perturbation analysis , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Jieping Ye,et al.  Object Detection in 20 Years: A Survey , 2019, Proceedings of the IEEE.

[28]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[29]  Tao Li,et al.  An Improved Superpixel-Level CFAR Detection Method for Ship Targets in High-Resolution SAR Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Yuning Jiang,et al.  Acquisition of Localization Confidence for Accurate Object Detection , 2018, ECCV.

[32]  Wenhui,et al.  AIR-SARShip-1.0: High-resolution SAR Ship Detection Dataset , 2020 .

[33]  Nicolas Longépé,et al.  AIS-Based Evaluation of Target Detectors and SAR Sensors Characteristics for Maritime Surveillance , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  D. Crisp,et al.  The State-of-the-Art in Ship Detection in Synthetic Aperture Radar Imagery , 2004 .

[35]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Thomas Fritz,et al.  Ship Surveillance With TerraSAR-X , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Knut Eldhuset,et al.  An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions , 1996, IEEE Trans. Geosci. Remote. Sens..

[38]  Chen Wang,et al.  Precise and Robust Ship Detection for High-Resolution SAR Imagery Based on HR-SDNet , 2020, Remote. Sens..

[39]  Haipeng Wang,et al.  Detection and Discrimination of Ship Targets in Complex Background From Spaceborne ALOS-2 SAR Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Jian Li,et al.  Target detection with synthetic aperture radar , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[41]  Huanxin Zou,et al.  Area Ratio Invariant Feature Group for Ship Detection in SAR Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Huanxin Zou,et al.  Noncircularity parameters and their potential in ship detection from high resolution SAR imagery , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[43]  Zongxu Pan,et al.  DRBox-v2: An Improved Detector With Rotatable Boxes for Target Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Chao Wang,et al.  Combining a single shot multibox detector with transfer learning for ship detection using sentinel-1 SAR images , 2018, Remote Sensing Letters.

[45]  M. Yeremy,et al.  Ocean Surveillance with Polarimetric SAR , 2001 .

[46]  Shilin Zhou,et al.  Learning Deep Ship Detector in SAR Images From Scratch , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Zongxu Pan,et al.  Ship Detection in Gaofen-3 SAR Images Based on Sea Clutter Distribution Analysis and Deep Convolutional Neural Network , 2018, Sensors.

[48]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Weiwei Jiang,et al.  Simultaneous Ship Detection and Orientation Estimation in SAR Images Based on Attention Module and Angle Regression , 2018, Sensors.

[50]  Jian Yang,et al.  Ship Detection in SAR Imagery via Variational Bayesian Inference , 2016, IEEE Geoscience and Remote Sensing Letters.

[51]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Christopher R. Jackson,et al.  Synthetic aperture radar : marine user's manual , 2004 .

[53]  Shifeng Zhang,et al.  Single-Shot Refinement Neural Network for Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[54]  M. Migliaccio,et al.  Reflection Symmetry for Polarimetric Observation of Man-Made Metallic Targets at Sea , 2012, IEEE Journal of Oceanic Engineering.

[55]  Xiaofeng Li,et al.  Automatic Detection of Ships in RADARSAT-1 SAR Imagery , 2001 .

[56]  Chuan He,et al.  MSARN: A Deep Neural Network Based on an Adaptive Recalibration Mechanism for Multiscale and Arbitrary-Oriented SAR Ship Detection , 2019, IEEE Access.

[57]  Wei Li,et al.  R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection , 2017, ArXiv.