MSARN: A Deep Neural Network Based on an Adaptive Recalibration Mechanism for Multiscale and Arbitrary-Oriented SAR Ship Detection

Ship detection plays an important role in synthetic aperture radar (SAR) image interpretation. However, there are still some difficulties in SAR ship detection. First, ships often have a large aspect ratio and arbitrary directionality in SAR images. Traditional detection algorithms can cause the detection area to be redundant, which makes it difficult to accurately locate the target in complex scenes. Second, ships in ports are often densely arranged, and the effective identification of densely arranged ships is complicated. Finally, ships in SAR images exist at a variety of scales due to the multiresolution imaging modes used and ship shape variations, which pose a considerable challenge for ship detection. To solve the above problems, we propose a multiscale adaptive recalibration network (MSARN) to detect multiscale and arbitrarily oriented ships in complex scenarios. The recalibration of the extracted multiscale features through global information increases the sensitivity of the network to the target angle, thereby increasing the accuracy of positioning. In particular, we designed a pyramid anchor and a loss function to match the rotated target. In addition, we modified the rotation non-maximum suppression (RNMS) method to solve the problem of the large overlap ratio of the detection box. The proposed model combines the positioning advantage of rotation detection with the speed advantage of a single-stage framework. Experiments show that based on the SAR rotation ship detection (SRSD) data set, the proposed algorithm has a faster detection speed and higher accuracy than some state-of-the-art methods.

[1]  Yang Liu,et al.  SAR ship detection using sea-land segmentation-based convolutional neural network , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[2]  Chuan He,et al.  A Deep Neural Network Based on an Attention Mechanism for SAR Ship Detection in Multiscale and Complex Scenarios , 2019, IEEE Access.

[3]  Kaiming He,et al.  Rethinking ImageNet Pre-Training , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Shilin Zhou,et al.  Learning Deep Ship Detector in SAR Images From Scratch , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jiao Jiao,et al.  A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection , 2018, IEEE Access.

[6]  Weiyao Lin,et al.  Tiny-DSOD: Lightweight Object Detection for Resource-Restricted Usages , 2018, BMVC.

[7]  Zhao Lin,et al.  A modified faster R-CNN based on CFAR algorithm for SAR ship detection , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[8]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[9]  Shigang Wang,et al.  New Hierarchical Saliency Filtering for Fast Ship Detection in High-Resolution SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Tianxu Zhang,et al.  Robust contact-point detection from pantograph-catenary infrared images by employing horizontal-vertical enhancement operator , 2019 .

[11]  Yi Su,et al.  Inshore Ship Detection via Saliency and Context Information in High-Resolution SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[12]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[13]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[15]  Tao Tang,et al.  Man-Made Target Detection from Polarimetric SAR Data via Nonstationarity and Asymmetry , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Xiangyang Xue,et al.  Arbitrary-Oriented Scene Text Detection via Rotation Proposals , 2017, IEEE Transactions on Multimedia.

[17]  Weiwei Sun,et al.  R-CNN-Based Ship Detection from High Resolution Remote Sensing Imagery , 2019, Remote. Sens..

[18]  Tianxu Zhang,et al.  Progressive Dual-Domain Filter for Enhancing and Denoising Optical Remote-Sensing Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[19]  Yunhong Wang,et al.  Receptive Field Block Net for Accurate and Fast Object Detection , 2017, ECCV.

[20]  Tao Zhang,et al.  Rotated Region Based Fully Convolutional Network for Ship Detection , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[22]  Sergey Voinov,et al.  Modelling ship detectability depending on TerraSAR-X-derived metocean parameters , 2018, CEAS Space Journal.

[23]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[24]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[25]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[27]  Wenxian Yu,et al.  A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection From SAR Images , 2018, IEEE Access.

[28]  Huanxin Zou,et al.  A Bilateral CFAR Algorithm for Ship Detection in SAR Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[29]  Yichen Wei,et al.  Relation Networks for Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Huanxin Zou,et al.  Area Ratio Invariant Feature Group for Ship Detection in SAR Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  David A. Plaisted,et al.  A Heuristic Triangulation Algorithm , 1987, J. Algorithms.

[33]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[34]  Yiming Pi,et al.  Multi-Scale Proposal Generation for Ship Detection in SAR Images , 2019, Remote. Sens..

[35]  Stephen Lin,et al.  GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[36]  Menglong Yan,et al.  Position Detection and Direction Prediction for Arbitrary-Oriented Ships via Multitask Rotation Region Convolutional Neural Network , 2018, IEEE Access.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Jianwei Li,et al.  Ship detection in SAR images based on an improved faster R-CNN , 2017, 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA).

[39]  Tao Li,et al.  An Improved Superpixel-Level CFAR Detection Method for Ship Targets in High-Resolution SAR Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Yiping Yang,et al.  Rotated region based CNN for ship detection , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[41]  Gangyao Kuang,et al.  Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[42]  Menglong Yan,et al.  Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks , 2018, Remote. Sens..

[43]  Weiwei Sun,et al.  Spatial-Spectral Squeeze-and-Excitation Residual Network for Hyperspectral Image Classification , 2019, Remote. Sens..

[44]  Chao Wang,et al.  A SAR Dataset of Ship Detection for Deep Learning under Complex Backgrounds , 2019, Remote. Sens..

[45]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Zhi Zhang,et al.  Bag of Freebies for Training Object Detection Neural Networks , 2019, ArXiv.

[48]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[49]  Liang Chen,et al.  An Intensity-Space Domain CFAR Method for Ship Detection in HR SAR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[50]  Wei Li,et al.  R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection , 2017, ArXiv.

[51]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[52]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Xiaogang Wang,et al.  Context Encoding for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.