Weakly supervised ship detection from SAR images based on a three-component CNN-CAM-CRF model

Abstract Ship detection from synthetic aperture radar (SAR) images plays an important role in marine safety and ocean resource management. Unsupervised ship detection methods have a complex set of rules, while supervised methods, such as deep learning approaches, consume substantial time and manpower to make training samples. We demonstrate that ships in an SAR image can be detected by a weakly supervised convolutional neural network that combines new deep learning technology called class activation mapping with the conditional random field. Our model is trained using only SAR images with two global labels, namely, “ship” and “nonship,” and produces three types of output: ship location heatmap, ship bounding box, and pixel-level segmentation product. Experiments on Chinese Gaofen-3 fine strip SAR images validate the effectiveness of the proposed method. Compared with the state-of-the-art methods, our method achieves higher detection accuracy and more intelligent detection characteristics.

[1]  F. Adragna,et al.  Optimal target detection using one channel SAR complex imagery: application to ship detection , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[2]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[3]  Yan Wang,et al.  A Modified CFAR Algorithm Based on Object Proposals for Ship Target Detection in SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  François Chollet,et al.  Keras: The Python Deep Learning library , 2018 .

[6]  William J. Emery,et al.  SAR Image Content Retrieval Based on Fuzzy Similarity and Relevance Feedback , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Gong Zhang,et al.  A novel ship detection method for SAR images based on nonlinear diffusion filtering and Gaussian curvature , 2016 .

[8]  S. Blake OS-CFAR theory for multiple targets and nonuniform clutter , 1988 .

[9]  Xi Zhang,et al.  Ship Detection Based on Oceanic Displaced Phase Center Antenna Technique in Along-Track Interferometric SAR , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Pramod K. Varshney,et al.  CFAR detection for multiple target situations , 1989 .

[11]  Jianyu Yang,et al.  Ship Detection from Ocean SAR Image Based on Local Contrast Variance Weighted Information Entropy , 2018, Sensors.

[12]  P. Lombardo,et al.  Segmentation-based technique for ship detection in SAR images , 2001 .

[13]  Tao Liu,et al.  CFAR Ship Detection Methods Using Compact Polarimetric SAR in a K-Wishart Distribution , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  W. Pichel,et al.  The use of satellite-based SAR in support of fisheries enforcement applications , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[15]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Liang Chen,et al.  An Intensity-Space Domain CFAR Method for Ship Detection in HR SAR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[17]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[18]  Shigang Wang,et al.  New Hierarchical Saliency Filtering for Fast Ship Detection in High-Resolution SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Qi Li,et al.  Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Pramod K. Varshney,et al.  Intelligent CFAR processor based on data variability , 2000, IEEE Trans. Aerosp. Electron. Syst..

[21]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[22]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Shuang Wang,et al.  SAR Images Retrieval Based on Semantic Classification and Region-Based Similarity Measure for Earth Observation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Hong Zhang,et al.  Automatic Ship Detection Based on RetinaNet Using Multi-Resolution Gaofen-3 Imagery , 2019, Remote. Sens..

[27]  Carlos López-Martínez,et al.  A novel algorithm for ship detection in SAR imagery based on the wavelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Irena Hajnsek,et al.  Polarimetric and interferometric characterization of coherent scatterers in urban areas , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Shiyuan Chen,et al.  A new CFAR algorithm based on variable window for ship target detection in SAR images , 2019, Signal Image Video Process..

[31]  Daniel R. Fuhrmann,et al.  A CFAR adaptive matched filter detector , 1992 .

[32]  Andrew Adams,et al.  Fast High‐Dimensional Filtering Using the Permutohedral Lattice , 2010, Comput. Graph. Forum.

[33]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[34]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[35]  Lena Chang,et al.  Ship Detection Based on YOLOv2 for SAR Imagery , 2019, Remote. Sens..

[36]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Maria T. Rey,et al.  Ship detection in RADARSAT SAR imagery , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[38]  M. Weiss,et al.  Analysis of Some Modified Cell-Averaging CFAR Processors in Multiple-Target Situations , 1982, IEEE Transactions on Aerospace and Electronic Systems.

[39]  Laurent Ferro-Famil,et al.  Scene characterization using subaperture polarimetric SAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[40]  Ronan Collobert,et al.  From image-level to pixel-level labeling with Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Sheng Gao,et al.  Ship Detection Using Compact Polarimetric SAR Based on the Notch Filter , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Gangyao Kuang,et al.  Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[43]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.