DB-YOLO: A Duplicate Bilateral YOLO Network for Multi-Scale Ship Detection in SAR Images

With the wide application of convolutional neural networks (CNNs), a variety of ship detection methods based on CNNs in synthetic aperture radar (SAR) images were proposed, but there are still two main challenges: (1) Ship detection requires high real-time performance, and a certain detection speed should be ensured while improving accuracy; (2) The diversity of ships in SAR images requires more powerful multi-scale detectors. To address these issues, a SAR ship detector called Duplicate Bilateral YOLO (DB-YOLO) is proposed in this paper, which is composed of a Feature Extraction Network (FEN), Duplicate Bilateral Feature Pyramid Network (DB-FPN) and Detection Network (DN). Firstly, a single-stage network is used to meet the need of real-time detection, and the cross stage partial (CSP) block is used to reduce the redundant parameters. Secondly, DB-FPN is designed to enhance the fusion of semantic and spatial information. In view of the ships in SAR image are mainly distributed with small-scale targets, the distribution of parameters and computation values between FEN and DB-FPN in different feature layers is redistributed to solve the multi-scale detection. Finally, the bounding boxes and confidence scores are given through the detection head of YOLO. In order to evaluate the effectiveness and robustness of DB-YOLO, comparative experiments with the other six state-of-the-art methods (Faster R-CNN, Cascade R-CNN, Libra R-CNN, FCOS, CenterNet and YOLOv5s) on two SAR ship datasets, i.e., SSDD and HRSID, are performed. The experimental results show that the AP50 of DB-YOLO reaches 97.8% on SSDD and 94.4% on HRSID, respectively. DB-YOLO meets the requirement of real-time detection (48.1 FPS) and is superior to other methods in the experiments.

[1]  Yuhang Jiang,et al.  R-CenterNet+: Anchor-Free Detector for Ship Detection in SAR Images , 2021, Sensors.

[2]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Meiyu Huang,et al.  Boosting Ship Detection in SAR Images With Complementary Pretraining Techniques , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Thomas Fritz,et al.  Ship Surveillance With TerraSAR-X , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Chen Wang,et al.  Precise and Robust Ship Detection for High-Resolution SAR Imagery Based on HR-SDNet , 2020, Remote. Sens..

[6]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[7]  Alin Achim,et al.  Superpixel-Level CFAR Detectors for Ship Detection in SAR Imagery , 2018, IEEE Geoscience and Remote Sensing Letters.

[8]  B. P. Salmon,et al.  Synthetic Aperture Radar Ship Detection Using Haar-Like Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[9]  Alan Yuille,et al.  DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution , 2020, ArXiv.

[10]  Xiaoling Zhang,et al.  Depthwise Separable Convolution Neural Network for High-Speed SAR Ship Detection , 2019, Remote. Sens..

[11]  Hao Chen,et al.  FCOS: Fully Convolutional One-Stage Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Weihong Li,et al.  Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images , 2020, Remote. Sens..

[13]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[16]  Xiaoling Zhang,et al.  LS-SSDD-v1.0: A Deep Learning Dataset Dedicated to Small Ship Detection from Large-Scale Sentinel-1 SAR Images , 2020, Remote Sensing.

[17]  Hao Su,et al.  HRSID: A High-Resolution SAR Images Dataset for Ship Detection and Instance Segmentation , 2020, IEEE Access.

[18]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Zhaohui Zheng,et al.  Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression , 2019, AAAI.

[20]  Shigang Wang,et al.  New Hierarchical Saliency Filtering for Fast Ship Detection in High-Resolution SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Lizhe Wang,et al.  Rotation Sliding Window of the Hog Feature in Remote Sensing Images for Ship Detection , 2015, 2015 8th International Symposium on Computational Intelligence and Design (ISCID).

[22]  Xiaoling Zhang,et al.  ShipDeNet-20: An Only 20 Convolution Layers and <1-MB Lightweight SAR Ship Detector , 2021, IEEE Geoscience and Remote Sensing Letters.

[23]  Yunkai Deng,et al.  A Novel CNN-Based Detector for Ship Detection Based on Rotatable Bounding Box in SAR Images , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Rong Yang,et al.  MSR2N: Multi-Stage Rotational Region Based Network for Arbitrary-Oriented Ship Detection in SAR Images , 2020, Sensors.

[26]  Quoc V. Le,et al.  EfficientDet: Scalable and Efficient Object Detection , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[28]  Tianjun Shi,et al.  PAG-YOLO: A Portable Attention-Guided YOLO Network for Small Ship Detection , 2021, Remote. Sens..

[29]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[30]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Huajun Feng,et al.  Libra R-CNN: Towards Balanced Learning for Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Yao Chen,et al.  End-to-End Ship Detection in SAR Images for Complex Scenes Based on Deep CNNs , 2021, J. Sensors.

[33]  Marwan Younis,et al.  Tandem-L: A Highly Innovative Bistatic SAR Mission for Global Observation of Dynamic Processes on the Earth's Surface , 2015, IEEE Geoscience and Remote Sensing Magazine.

[34]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  David Miller,et al.  The TerraSAR-X Satellite , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Biao Hou,et al.  Multilayer CFAR Detection of Ship Targets in Very High Resolution SAR Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[37]  Stephen Lin,et al.  RepPoints: Point Set Representation for Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[38]  Jun-Wei Hsieh,et al.  CSPNet: A New Backbone that can Enhance Learning Capability of CNN , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[39]  Carlos López-Martínez,et al.  Ship Detection in SAR Images Based on Maxtree Representation and Graph Signal Processing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jianwei Li,et al.  Ship detection in SAR images based on an improved faster R-CNN , 2017, 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA).

[41]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).