HyperLi-Net: A hyper-light deep learning network for high-accurate and high-speed ship detection from synthetic aperture radar imagery

Abstract Ship detection from Synthetic Aperture Radar (SAR) imagery is attracting increasing attention due to its great value in ocean. However, existing most studies are frequently improving detection accuracy at the expense of detection speed. Thus, to solve this problem, this paper proposes HyperLi-Net for high-accurate and high-speed SAR ship detection. We propose five external modules to achieve high-accuracy, i.e., Multi-Receptive-Field Module (MRF-Module), Dilated Convolution Module (DC-Module), Channel and Spatial Attention Module (CSA-Module), Feature Fusion Module (FF-Module) and Feature Pyramid Module (FP-Module). We also adopt five internal mechanisms to achieve high-speed, i.e., Region-Free Model (RF-Model), Small Kernel (S-Kernel), Narrow Channel (N-Channel), Separable Convolution (Separa-Conv) and Batch Normalization Fusion (BN-Fusion). Experimental results on the SAR Ship Detection Dataset (SSDD), Gaofen-SSDD and Sentinel-SSDD show that HyperLi-Net’s accuracy and speed are both superior to the other nine state-of-the-art methods. Moreover, the satisfactory detection results on two Sentinel-1 SAR images can reveal HyperLi-Net’s good migration capability. HyperLi-Net is build from scratch with fewer parameters, lower computation costs and lighter model that can be efficiently trained on CPUs and is helpful for future hardware transplantation, e.g. FPGAs, DSPs, etc.

[1]  Bo Tang,et al.  Multi-Scale Rotation-Invariant Haar-Like Feature Integrated CNN-Based Ship Detection Algorithm of Multiple-Target Environment in SAR Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Fang Xu,et al.  Ship Detection from Optical Remote Sensing Images Using Multi-Scale Analysis and Fourier HOG Descriptor , 2019, Remote. Sens..

[3]  Biao Hou,et al.  Multilayer CFAR Detection of Ship Targets in Very High Resolution SAR Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[4]  Wolfgang Middelmann,et al.  Object-based detection of vehicles using combined optical and elevation data , 2018 .

[5]  Zongxu Pan,et al.  DRBox-v2: An Improved Detector With Rotatable Boxes for Target Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Jian Yang,et al.  Ship Classification Based on MSHOG Feature and Task-Driven Dictionary Learning with Structured Incoherent Constraints in SAR Images , 2018, Remote. Sens..

[7]  Lena Chang,et al.  Ship Detection Based on YOLOv2 for SAR Imagery , 2019, Remote. Sens..

[8]  A. Bundy,et al.  Difference of Gaussians , 1984 .

[9]  Shilin Zhou,et al.  Learning Deep Ship Detector in SAR Images From Scratch , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Zongxu Pan,et al.  Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data , 2017, Remote. Sens..

[11]  Nikos Komodakis,et al.  Object Detection via a Multi-region and Semantic Segmentation-Aware CNN Model , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Michel Petit,et al.  Synthetic aperture radar imaging of sea surface life and fishing activities , 1992, IEEE Trans. Geosci. Remote. Sens..

[13]  Jordi J. Mallorqui,et al.  Automatic vessel monitoring with single and multidimensional SAR images in the wavelet domain , 2006 .

[14]  G. Born,et al.  Seasat Mission Overview , 1979, Science.

[15]  Chen Wang,et al.  Precise and Robust Ship Detection for High-Resolution SAR Imagery Based on HR-SDNet , 2020, Remote. Sens..

[16]  Bo Li,et al.  Ship Detection From Optical Satellite Images Based on Saliency Segmentation and Structure-LBP Feature , 2017, IEEE Geoscience and Remote Sensing Letters.

[17]  Krištof Oštir,et al.  Vessel detection and classification from spaceborne optical images: A literature survey , 2018, Remote sensing of environment.

[18]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Haipeng Wang,et al.  A Lightweight Feature Optimizing Network for Ship Detection in SAR Image , 2019, IEEE Access.

[20]  Wentao An,et al.  An Improved Iterative Censoring Scheme for CFAR Ship Detection With SAR Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Haigang Sui,et al.  Automatic ship detection for optical satellite images based on visual attention model and LBP , 2014, 2014 IEEE Workshop on Electronics, Computer and Applications.

[22]  Maurizio Migliaccio,et al.  On the degree of polarization for SAR sea oil slick observation , 2013 .

[23]  Hong Zhang,et al.  Automatic Ship Detection Based on RetinaNet Using Multi-Resolution Gaofen-3 Imagery , 2019, Remote. Sens..

[24]  Chuan He,et al.  A Deep Neural Network Based on an Attention Mechanism for SAR Ship Detection in Multiscale and Complex Scenarios , 2019, IEEE Access.

[25]  Takeshi Mita,et al.  Joint Haar-like features for face detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[26]  Tao Zhang,et al.  Ship Detection From PolSAR Imagery Using the Complete Polarimetric Covariance Difference Matrix , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Wenxian Yu,et al.  A coupled convolutional neural network for small and densely clustered ship detection in SAR images , 2018, Science China Information Sciences.

[28]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[29]  B. P. Salmon,et al.  Synthetic Aperture Radar Ship Detection Using Haar-Like Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[30]  Lei Xue,et al.  A Multilayer Fusion Light-Head Detector for SAR Ship Detection , 2019, Sensors.

[31]  Valero Laparra,et al.  Transferring deep learning models for cloud detection between Landsat-8 and Proba-V , 2020 .

[32]  Wei Luo,et al.  SAR Image Retrieval Based on Unsupervised Domain Adaptation and Clustering , 2019, IEEE Geoscience and Remote Sensing Letters.

[33]  Mihai Datcu,et al.  Deep SAR-Net: Learning objects from signals , 2020 .

[34]  Zongxu Pan,et al.  Projection Shape Template-Based Ship Target Recognition in TerraSAR-X Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[35]  Mingzhe Li,et al.  Efficient Low-Cost Ship Detection for SAR Imagery Based on Simplified U-Net , 2020, IEEE Access.

[36]  Shigang Wang,et al.  New Hierarchical Saliency Filtering for Fast Ship Detection in High-Resolution SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Vahid Tabataba Vakili,et al.  Introducing excision switching-CFAR in K distributed sea clutter , 2009, Signal Process..

[38]  Zongxu Pan,et al.  What, Where, and How to Transfer in SAR Target Recognition Based on Deep CNNs , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Chao Wang,et al.  A SAR Dataset of Ship Detection for Deep Learning under Complex Backgrounds , 2019, Remote. Sens..

[40]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[41]  Marco Lops,et al.  Biparametric CFAR procedures for lognormal clutter , 1993 .

[42]  Fei Gao,et al.  Enhanced Feature Extraction for Ship Detection from Multi-Resolution and Multi-Scene Synthetic Aperture Radar (SAR) Images , 2019, Remote. Sens..

[43]  Motoyuki Sato,et al.  Disaster debris estimation using high-resolution polarimetric stereo-SAR , 2016 .

[44]  Gui Gao,et al.  A Parzen-Window-Kernel-Based CFAR Algorithm for Ship Detection in SAR Images , 2011, IEEE Geoscience and Remote Sensing Letters.

[45]  Kang-Hyun Jo,et al.  Hybrid cascade boosting machine using variant scale blocks based HOG features for pedestrian detection , 2014, Neurocomputing.

[46]  Weiwei Jiang,et al.  Simultaneous Ship Detection and Orientation Estimation in SAR Images Based on Attention Module and Angle Regression , 2018, Sensors.

[47]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[48]  Wenxian Yu,et al.  A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection From SAR Images , 2018, IEEE Access.

[49]  Liang Chen,et al.  A novel threshold template algorithm for ship detection in high-resolution SAR images , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[50]  Abdelmalik Taleb-Ahmed,et al.  Performances evaluation of GNSS ALTBOC acquisition with CFAR detection in Rayleigh fading channel , 2013, 2013 Saudi International Electronics, Communications and Photonics Conference.

[51]  Xiaoling Zhang,et al.  High-Speed Ship Detection in SAR Images Based on a Grid Convolutional Neural Network , 2019, Remote. Sens..

[52]  Yang Long,et al.  SAR Ship Detection Based on Convolutional Neural Network with Deep Multiscale Feature Fusion , 2020 .

[53]  V. Anastassopoulos,et al.  Optimal CFAR detection in Weibull clutter , 1995 .

[54]  Qi Li,et al.  Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Jiao Jiao,et al.  A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection , 2018, IEEE Access.

[56]  Lanqing Huang,et al.  OpenSARShip: A Dataset Dedicated to Sentinel-1 Ship Interpretation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[57]  Richard Bamler,et al.  Performance Analysis of the TerraSAR-X Traffic Monitoring Concept , 2006 .

[58]  Zhao Tong,et al.  Ship Target Detection in SAR Image Based on RetinaNet , 2020 .

[59]  Nilton Nobuhiro Imai,et al.  A convolutional neural network approach for counting and geolocating citrus-trees in UAV multispectral imagery , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[60]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[61]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[62]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[63]  Xiaoling Zhang,et al.  Depthwise Separable Convolution Neural Network for High-Speed SAR Ship Detection , 2019, Remote. Sens..

[64]  Yiming Pi,et al.  Multi-Scale Proposal Generation for Ship Detection in SAR Images , 2019, Remote. Sens..

[65]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[66]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[67]  Bo Zhang,et al.  Ship detection based on feature confidence for high resolution SAR images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[68]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[69]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[70]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[71]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[72]  Jian Yang,et al.  SAR Target Recognition via Supervised Discriminative Dictionary Learning and Sparse Representation of the SAR-HOG Feature , 2016, Remote. Sens..

[73]  Sheng Gao,et al.  Ship Detection Using Compact Polarimetric SAR Based on the Notch Filter , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[74]  Gangyao Kuang,et al.  Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[75]  Heesung Kwon,et al.  Going Deeper With Contextual CNN for Hyperspectral Image Classification , 2016, IEEE Transactions on Image Processing.

[76]  Wang Ying-hua SAR variant target automatic recognition algorithm based on local texture characteristic , 2012 .

[77]  Chao Wang,et al.  Combining a single shot multibox detector with transfer learning for ship detection using sentinel-1 SAR images , 2018, Remote Sensing Letters.

[78]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[79]  Lizhe Wang,et al.  Rotation Sliding Window of the Hog Feature in Remote Sensing Images for Ship Detection , 2015, 2015 8th International Symposium on Computational Intelligence and Design (ISCID).

[80]  Peng Chen,et al.  Detection of Small Ship Objects Using Anchor Boxes Cluster and Feature Pyramid Network Model for SAR Imagery , 2020, Journal of Marine Science and Engineering.

[81]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[82]  Lin Lei,et al.  Multi-scale object detection in remote sensing imagery with convolutional neural networks , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[83]  Michael J. Collins,et al.  On the use of compact polarimetry SAR for ship detection , 2013 .

[84]  Buqing Cao,et al.  Web Page Recognition Algorithm Based on Link Analysis in Theme Search Engine , 2012, 2012 Second International Conference on Cloud and Green Computing.

[85]  Tao Zhang,et al.  Ship detection from PolSAR imagery using the ambiguity removal polarimetric notch filter , 2019 .