A Novel Salient Feature Fusion Method for Ship Detection in Synthetic Aperture Radar Images

Ship detection of synthetic aperture radar (SAR) images is one of the research hotspots in the field of marine surveillance. Fusing salient features to detection network can effectively improve the precision of ship detection. However, how to effectively fuse the salient features of SAR images is still a difficult task. In this paper, to improve the ship detection precision, we design a novel one-stage ship detection network to fuse salient features and deep convolutional neural network (CNN) features. Firstly, a saliency map extraction algorithm is proposed. The algorithm is applied to generate saliency map by using multi-scale pyramid features and frequency domain features. Secondly, the backbone of the ship detection network contains a two-stream network. The upper-stream network uses the original SAR image as input to extract multi-scale deep CNN features. The lower-stream network uses the corresponding saliency map as input to acquire multi-scale salient features. Thirdly, for integrating the salient features to deep CNN features, a novel salient feature fusion method is designed. Finally, an improved bi-directional feature pyramid network is applied to the ship detection network for reducing the computational complexity and network parameters. The proposed methods are evaluated on the public ship detection dataset and the experimental results shows that it can make a significant improvement in the precision of SAR image ship detection.

[1]  Zhao Lin,et al.  A modified faster R-CNN based on CFAR algorithm for SAR ship detection , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[2]  Huchuan Lu,et al.  Attentive Feedback Network for Boundary-Aware Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Jiao Jiao,et al.  A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection , 2018, IEEE Access.

[4]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[5]  Lena Chang,et al.  Ship Detection Based on YOLOv2 for SAR Imagery , 2019, Remote. Sens..

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[8]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ming-Hsuan Yang,et al.  PiCANet: Learning Pixel-Wise Contextual Attention for Saliency Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Chao Wang,et al.  A SAR Dataset of Ship Detection for Deep Learning under Complex Backgrounds , 2019, Remote. Sens..

[11]  J.S. Lee,et al.  Polarimetric SAR speckle filtering and its impact on classification , 1997, IGARSS'97. 1997 IEEE International Geoscience and Remote Sensing Symposium Proceedings. Remote Sensing - A Scientific Vision for Sustainable Development.

[12]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[13]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[14]  Xiaoling Zhang,et al.  LS-SSDD-v1.0: A Deep Learning Dataset Dedicated to Small Ship Detection from Large-Scale Sentinel-1 SAR Images , 2020, Remote Sensing.

[15]  Lu Li,et al.  Saliency-Guided Single Shot Multibox Detector for Target Detection in SAR Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Tao Li,et al.  Structure-Measure: A New Way to Evaluate Foreground Maps , 2017, International Journal of Computer Vision.

[18]  Kun Fu,et al.  An Anchor-Free Method Based on Feature Balancing and Refinement Network for Multiscale Ship Detection in SAR Images , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Qingming Huang,et al.  F³Net: Fusion, Feedback and Focus for Salient Object Detection , 2020, AAAI.

[20]  Xiangyu Zhang,et al.  DetNet: A Backbone network for Object Detection , 2018, ArXiv.

[21]  Lei Xue,et al.  A Multilayer Fusion Light-Head Detector for SAR Ship Detection , 2019, Sensors.

[22]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[23]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[24]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[25]  Bo Chen,et al.  MnasNet: Platform-Aware Neural Architecture Search for Mobile , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Quoc V. Le,et al.  EfficientDet: Scalable and Efficient Object Detection , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Huanxin Zou,et al.  A Bilateral CFAR Algorithm for Ship Detection in SAR Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[29]  Bo Ren,et al.  Enhanced-alignment Measure for Binary Foreground Map Evaluation , 2018, IJCAI.

[30]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[31]  Wenxian Yu,et al.  A coupled convolutional neural network for small and densely clustered ship detection in SAR images , 2018, Science China Information Sciences.

[32]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[33]  Lan Du,et al.  SAR Target Detection Based on SSD With Data Augmentation and Transfer Learning , 2019, IEEE Geoscience and Remote Sensing Letters.

[34]  Andrey A. Kurekin,et al.  Operational Monitoring of Illegal Fishing in Ghana through Exploitation of Satellite Earth Observation and AIS Data , 2019, Remote. Sens..

[35]  Shiyuan Chen,et al.  A new CFAR algorithm based on variable window for ship target detection in SAR images , 2019, Signal Image Video Process..

[36]  Liang Chen,et al.  An Intensity-Space Domain CFAR Method for Ship Detection in HR SAR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[37]  Yan Wang,et al.  A Modified CFAR Algorithm Based on Object Proposals for Ship Target Detection in SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[39]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Xiaoling Zhang,et al.  ShipDeNet-20: An Only 20 Convolution Layers and <1-MB Lightweight SAR Ship Detector , 2021, IEEE Geoscience and Remote Sensing Letters.

[41]  Xiaoling High-speed and High-accurate SAR Ship Detection Based on a Depthwise Separable Convolution Neural Network , 2020 .

[42]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[43]  Naouma Kourti,et al.  The SUMO Ship Detector Algorithm for Satellite Radar Images , 2017, Remote. Sens..

[44]  Qi Li,et al.  Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Jianwei Li,et al.  Ship detection in SAR images based on an improved faster R-CNN , 2017, 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA).

[47]  Jun Wang,et al.  A Hierarchical Convolution Neural Network (CNN)-Based Ship Target Detection Method in Spaceborne SAR Imagery , 2019, Remote. Sens..

[48]  Xueming Li,et al.  A Novel Feature Fusion Method for Computing Image Aesthetic Quality , 2020, IEEE Access.

[49]  Ming Zhao,et al.  Robust Infrared Maritime Target Detection Based on Visual Attention and Spatiotemporal Filtering , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Zhuowen Tu,et al.  Deeply Supervised Salient Object Detection with Short Connections , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Qingming Huang,et al.  F3Net: Fusion, Feedback and Focus for Salient Object Detection , 2019, AAAI.

[52]  Hongwei Liu,et al.  Superpixel-Based CFAR Target Detection for High-Resolution SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.