A Novel Detector Based on Convolution Neural Networks for Multiscale SAR Ship Detection in Complex Background

Convolution neural network (CNN)-based detectors have shown great performance on ship detections of synthetic aperture radar (SAR) images. However, the performance of current models has not been satisfactory enough for detecting multiscale ships and small-size ones in front of complex backgrounds. To address the problem, we propose a novel SAR ship detector based on CNN, which consist of three subnetworks: the Fusion Feature Extractor Network (FFEN), Region Proposal Network (RPN), and Refine Detection Network (RDN). Instead of using a single feature map, we fuse feature maps in bottom–up and top–down ways and generate proposals from each fused feature map in FFEN. Furthermore, we further merge features generated by the region-of-interest (RoI) pooling layer in RDN. Based on the feature representation strategy, the CNN framework constructed can significantly enhance the location and semantics information for the multiscale ships, in particular for the small ships. On the other hand, the residual block is introduced to increase the network depth, through which the detection precision could be further improved. The public SAR ship dataset (SSDD) and China Gaofen-3 satellite SAR image are used to validate the proposed method. Our method shows excellent performance for detecting the multiscale and small-size ships with respect to some competitive models and exhibits high potential in practical application.

[1]  Zhao Lin,et al.  A modified faster R-CNN based on CFAR algorithm for SAR ship detection , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[2]  Yu Zhou,et al.  SAR Automatic Target Recognition Using a Roto-Translational Invariant Wavelet-Scattering Convolution Network , 2018, Remote. Sens..

[3]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[4]  Cordelia Schmid,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[5]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Hong Zhang,et al.  Automatic Ship Detection Based on RetinaNet Using Multi-Resolution Gaofen-3 Imagery , 2019, Remote. Sens..

[7]  Yunchao Wei,et al.  Perceptual Generative Adversarial Networks for Small Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[9]  Gui Gao,et al.  CFAR Ship Detection in Nonhomogeneous Sea Clutter Using Polarimetric SAR Data Based on the Notch Filter , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Maurizio Migliaccio,et al.  A Physical Full-Resolution SAR Ship Detection Filter , 2008, IEEE Geoscience and Remote Sensing Letters.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Lei Xue,et al.  A Multilayer Fusion Light-Head Detector for SAR Ship Detection , 2019, Sensors.

[13]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Fabio Mazzarella,et al.  SAR Ship Detection and Self-Reporting Data Fusion Based on Traffic Knowledge , 2015, IEEE Geoscience and Remote Sensing Letters.

[15]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[16]  Marwan Younis,et al.  Tandem-L: A Highly Innovative Bistatic SAR Mission for Global Observation of Dynamic Processes on the Earth's Surface , 2015, IEEE Geoscience and Remote Sensing Magazine.

[17]  Jianwei Li,et al.  Ship detection in SAR images based on an improved faster R-CNN , 2017, 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA).

[18]  Tao Li,et al.  An Improved Superpixel-Level CFAR Detection Method for Ship Targets in High-Resolution SAR Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[20]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[21]  Heng Zhang,et al.  Building extraction from high-resolution SAR imagery based on deep neural networks , 2017 .

[22]  Wenxian Yu,et al.  A coupled convolutional neural network for small and densely clustered ship detection in SAR images , 2018, Science China Information Sciences.

[23]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[24]  Chao Wang,et al.  Combining a single shot multibox detector with transfer learning for ship detection using sentinel-1 SAR images , 2018, Remote Sensing Letters.

[25]  Irena Hajnsek,et al.  Validating a Notch Filter for Detection of Targets at Sea With ALOS-PALSAR Data: Tokyo Bay , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Christine M. Netishen,et al.  Performance of a High-Resolution Polarimetric SAR Automatic Target Recognition System , 1993 .

[27]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Gangyao Kuang,et al.  Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[29]  Haipeng Wang,et al.  Detection and Discrimination of Ship Targets in Complex Background From Spaceborne ALOS-2 SAR Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Henning Heiselberg,et al.  Ship-Iceberg Discrimination in Sentinel-2 Multispectral Imagery by Supervised Classification , 2017, Remote. Sens..

[31]  Jiao Jiao,et al.  A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection , 2018, IEEE Access.

[32]  Lanqing Huang,et al.  OpenSARShip: A Dataset Dedicated to Sentinel-1 Ship Interpretation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Zhimin Zhang,et al.  Waterline Mapping and Change Detection of Tangjiashan Dammed Lake After Wenchuan Earthquake From Multitemporal High-Resolution Airborne SAR Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  S LewMichael,et al.  Deep learning for visual understanding , 2016 .

[35]  Lei Liu,et al.  Real-Time Optronic Beamformer on Receive in Phased Array Radar , 2019, IEEE Geoscience and Remote Sensing Letters.

[36]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[37]  Naouma Kourti,et al.  The SUMO Ship Detector Algorithm for Satellite Radar Images , 2017, Remote. Sens..

[38]  Shigang Wang,et al.  New Hierarchical Saliency Filtering for Fast Ship Detection in High-Resolution SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Xiao Xiang Zhu,et al.  HSF-Net: Multiscale Deep Feature Embedding for Ship Detection in Optical Remote Sensing Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Timo Balz,et al.  Landslide monitoring with high-resolution SAR data in the Three Gorges region , 2012, Science China Earth Sciences.

[41]  Yan Wang,et al.  A Modified CFAR Algorithm Based on Object Proposals for Ship Target Detection in SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[42]  Bo Zhang,et al.  Ship detection based on feature confidence for high resolution SAR images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[43]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[44]  Menglong Yan,et al.  Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks , 2018, Remote. Sens..