R-CenterNet+: Anchor-Free Detector for Ship Detection in SAR Images

In recent years, the rapid development of Deep Learning (DL) has provided a new method for ship detection in Synthetic Aperture Radar (SAR) images. However, there are still four challenges in this task. (1) The ship targets in SAR images are very sparse. A large number of unnecessary anchor boxes may be generated on the feature map when using traditional anchor-based detection models, which could greatly increase the amount of computation and make it difficult to achieve real-time rapid detection. (2) The size of the ship targets in SAR images is relatively small. Most of the detection methods have poor performance on small ships in large scenes. (3) The terrestrial background in SAR images is very complicated. Ship targets are susceptible to interference from complex backgrounds, and there are serious false detections and missed detections. (4) The ship targets in SAR images are characterized by a large aspect ratio, arbitrary direction and dense arrangement. Traditional horizontal box detection can cause non-target areas to interfere with the extraction of ship features, and it is difficult to accurately express the length, width and axial information of ship targets. To solve these problems, we propose an effective lightweight anchor-free detector called R-Centernet+ in the paper. Its features are as follows: the Convolutional Block Attention Module (CBAM) is introduced to the backbone network to improve the focusing ability on small ships; the Foreground Enhance Module (FEM) is used to introduce foreground information to reduce the interference of the complex background; the detection head that can output the ship angle map is designed to realize the rotation detection of ship targets. To verify the validity of the proposed model in this paper, experiments are performed on two public SAR image datasets, i.e., SAR Ship Detection Dataset (SSDD) and AIR-SARShip. The results show that the proposed R-Centernet+ detector can detect both inshore and offshore ships with higher accuracy than traditional models with an average precision of 95.11% on SSDD and 84.89% on AIR-SARShip, and the detection speed is quite fast with 33 frames per second.

[1]  Fan Zhang,et al.  Slim and Efficient Neural Network Design for Resource-Constrained SAR Target Recognition , 2018, Remote. Sens..

[2]  Jiao Jiao,et al.  A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection , 2018, IEEE Access.

[3]  Hao Chen,et al.  FCOS: Fully Convolutional One-Stage Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[5]  Biao Hou,et al.  Multilayer CFAR Detection of Ship Targets in Very High Resolution SAR Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[6]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[7]  Daniel R. Fuhrmann,et al.  A CFAR adaptive matched filter detector , 1992 .

[8]  Meng Yang,et al.  Ship Detection in SAR Images Based on Lognormal $\rho$ -Metric , 2018, IEEE Geoscience and Remote Sensing Letters.

[9]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[10]  Abhinav Gupta,et al.  Contextual Priming and Feedback for Faster R-CNN , 2016, ECCV.

[11]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Qi Li,et al.  Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Wenxian Yu,et al.  A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection From SAR Images , 2018, IEEE Access.

[14]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[15]  Fenghua Zhu,et al.  FII-CenterNet: An Anchor-Free Detector With Foreground Attention for Traffic Object Detection , 2021, IEEE Transactions on Vehicular Technology.

[16]  Hong Zhang,et al.  Automatic Ship Detection Based on RetinaNet Using Multi-Resolution Gaofen-3 Imagery , 2019, Remote. Sens..

[17]  Linrang Zhang,et al.  Focusing High-Resolution Airborne SAR with Topography Variations Using an Extended BPA Based on a Time/Frequency Rotation Principle , 2018, Remote. Sens..

[18]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[19]  Jiafeng Zhang,et al.  CFAR Ship Detection in Polarimetric Synthetic Aperture Radar Images Based on Whitening Filter , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jun Li,et al.  Fuzzy statistical normalization CFAR detector for non-rayleigh data , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[22]  Wenhui,et al.  AIR-SARShip-1.0: High-resolution SAR Ship Detection Dataset , 2020 .

[23]  Thomas Fritz,et al.  Ship Surveillance With TerraSAR-X , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Knut Eldhuset,et al.  An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions , 1996, IEEE Trans. Geosci. Remote. Sens..

[25]  Hei Law,et al.  CornerNet: Detecting Objects as Paired Keypoints , 2018, ECCV.

[26]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[27]  Mingzhe Li,et al.  Efficient Low-Cost Ship Detection for SAR Imagery Based on Simplified U-Net , 2020, IEEE Access.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Chao Wang,et al.  Combining a single shot multibox detector with transfer learning for ship detection using sentinel-1 SAR images , 2018, Remote Sensing Letters.

[30]  Carlos López-Martínez,et al.  A novel algorithm for ship detection in SAR imagery based on the wavelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[31]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Xinbo Gao,et al.  A CenterNet++ model for ship detection in SAR images , 2021, Pattern Recognit..

[33]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[34]  Liang Chen,et al.  An Intensity-Space Domain CFAR Method for Ship Detection in HR SAR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[35]  Kazuo Ouchi,et al.  On a Novel Approach Using MLCC and CFAR for the Improvement of Ship Detection by Synthetic Aperture Radar , 2010, IEEE Geoscience and Remote Sensing Letters.

[36]  Lukasz Rybak,et al.  A Geometrical Divide of Data Particle in Gravitational Classification of Moons and Circles Data Sets , 2020, Entropy.

[37]  J. Dudczyk,et al.  Optimizing the minimum cost flow algorithm for the phase unwrapping process in SAR radar , 2014 .

[38]  Jianwei Li,et al.  Ship detection in SAR images based on an improved faster R-CNN , 2017, 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA).

[39]  Wentao An,et al.  An Improved Iterative Censoring Scheme for CFAR Ship Detection With SAR Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Nikos Komodakis,et al.  Object Detection via a Multi-region and Semantic Segmentation-Aware CNN Model , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[41]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[42]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Xiaoling Zhang,et al.  LS-SSDD-v1.0: A Deep Learning Dataset Dedicated to Small Ship Detection from Large-Scale Sentinel-1 SAR Images , 2020, Remote Sensing.

[44]  Huiyu Zhou,et al.  Anchor-free Convolutional Network with Dense Attention Feature Aggregation for Ship Detection in SAR Images , 2020, Remote. Sens..

[45]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[46]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.