A coupled convolutional neural network for small and densely clustered ship detection in SAR images

Ship detection from synthetic aperture radar (SAR) imagery plays a significant role in global marine surveillance. However, a desirable performance is rarely achieved when detecting small and densely clustered ship targets, and this problem is difficult to solve. Recently, convolutional neural networks (CNNs) have shown strong detection power in computer vision and are flexible in complex background conditions, whereas traditional methods have limited ability. However, CNNs struggle to detect small targets and densely clustered ones that exist widely in many SAR images. To address this problem while preserving the good properties for complex background conditions, we develop a coupled CNN for small and densely clustered SAR ship detection. The proposed method mainly consists of two subnetworks: an exhaustive ship proposal network (ESPN) for ship-like region generation from multiple layers with multiple receptive fields, and an accurate ship discrimination network (ASDN) for false alarm elimination by referring to the context information of each proposal generated by ESPN. The motivation in ESPN is to generate as many ship proposals as possible, and in ASDN, the goal is to obtain the final results accurately. Experiments are evaluated on two data sets. One is collected from 60 wide-swath Sentinel-1 images and the other is from 20 GaoFen-3 (GF-3) images. Both data sets contain many ships that are small and densely clustered. The quantitative comparison results illustrate the clear improvements of the new method in terms of average precision (AP) and F1 score by 0.4028 and 0.3045 for the Sentinel-1 data set compared with the multi-step constant false alarm rate (CFAR-MS) method. The values are verified as 0.2033 and 0.1522 for the GF-3 data set. In addition, the new method is demonstrated to be more efficient than CFAR-MS.

[1]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Peter A. Flach,et al.  Precision-Recall-Gain Curves: PR Analysis Done Right , 2015, NIPS.

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Shigang Wang,et al.  New Hierarchical Saliency Filtering for Fast Ship Detection in High-Resolution SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Pasquale Iervolino,et al.  A novel ship-detection technique for Sentinel-1 SAR data , 2015, 2015 IEEE 5th Asia-Pacific Conference on Synthetic Aperture Radar (APSAR).

[7]  Jianhua Wang,et al.  Salient object detection via region contrast and graph regularization , 2015, Science China Information Sciences.

[8]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[9]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[10]  Kavita Bala,et al.  Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  He Chen,et al.  A coarse-to-fine image registration method based on visual attention model , 2014, Science China Information Sciences.

[12]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[13]  D. Crisp,et al.  The State-of-the-Art in Ship Detection in Synthetic Aperture Radar Imagery , 2004 .

[14]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  He Chen,et al.  A waterborne salient ship detection method on SAR imagery , 2015, Science China Information Sciences.

[17]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[18]  Xiao Xiang Zhu,et al.  $L_{1}$ -Regularization-Based SAR Imaging and CFAR Detection via Complex Approximated Message Passing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Yueting Zhuang,et al.  DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection , 2015, IEEE Transactions on Image Processing.

[20]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[23]  Silvio Savarese,et al.  Subcategory-Aware Convolutional Neural Networks for Object Proposals and Detection , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[24]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[25]  Liang Chen,et al.  An Intensity-Space Domain CFAR Method for Ship Detection in HR SAR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[26]  Xiaofeng Li,et al.  Automatic Detection of Ships in RADARSAT-1 SAR Imagery , 2001 .

[27]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[28]  Huanxin Zou,et al.  A CFAR Detection Algorithm for Generalized Gamma Distributed Background in High-Resolution SAR Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[29]  Weiming Tian,et al.  A novel subsidence monitoring technique based on space-surface bistatic differential interferometry using GNSS as transmitters , 2015, Science China Information Sciences.

[30]  Zongxu Pan,et al.  An Improved Shape Contexts Based Ship Classification in SAR Images , 2017, Remote. Sens..

[31]  Peter Regner,et al.  SNAP (Sentinel Application Platform) and the ESA Sentinel 3 Toolbox , 2015 .

[32]  Lei Liu,et al.  Fast Vessel Detection in Gaofen-3 SAR Images with Ultrafine Strip-Map Mode , 2017, Sensors.

[33]  M. N. Ferrara,et al.  Automatic moving targets detection using a rule-based system: comparison between different study cases , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[34]  Gui Gao,et al.  CFAR Ship Detection in Nonhomogeneous Sea Clutter Using Polarimetric SAR Data Based on the Notch Filter , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Yi Su,et al.  Inshore Ship Detection via Saliency and Context Information in High-Resolution SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.