Source-Assisted Hierarchical Semantic Calibration Method for Ship Detection Across Different Satellite SAR Images

With the increase of spaceborne synthetic aperture radar (SAR) platforms, numerous SAR images are available for ship detection applications. Traditional deep learning-based detection methods struggle with the distributional disparities in SAR images acquired from different platforms, arising from differences in radar characteristics and data acquisition conditions. Existing approaches employ domain adaptation (DA) techniques to align domain distribution and thus mitigate distribution divergence. However, due to the inherent specificity of SAR images, i.e., ship targets and background environments exhibit highly visual similarity, these methods may inadvertently destroy the discriminative representations of ship targets, resulting in poor cross-domain detection performance. To alleviate this dilemma, we propose a source-assisted hierarchical semantic calibration (SHSC) framework for ship detection across different satellite SAR images. First, a source-assisted semantic calibration module (SSCM) is designed, which performs multilevel semantic calibration by constructing a source-assisted (SA) detector as a guiding mechanism to preserve the discriminative semantics of ship targets. Then, the uncertainty-aware guided feature-level alignment module (UG-FAM) and instance-level alignment module (UG-IAM) are developed, which effectively capture the crucial ship target attributes by emphasizing the learning of those discriminative samples. Extensive experiments are conducted on the datasets obtained from the TerraSAR, Gaofen-3, Sentinel-1, and RadarSat-2 satellites. The experimental results show that the proposed SHSC method outperforms the other UDA approach by an average of more than 3% on AP in ship target detection accuracy across different satellite SAR images.

[1]  Linlin Zhang,et al.  Dualistic cascade convolutional neural network dedicated to fully PolSAR image ship detection , 2023, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  Zenghui Zhang,et al.  A domain specific knowledge extraction transformer method for multisource satellite-borne SAR images ship detection , 2023, ISPRS Journal of Photogrammetry and Remote Sensing.

[3]  P. Luo,et al.  Dense Distinct Query for End-to-End Object Detection , 2023, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  David Zhang,et al.  Multi-adversarial Faster-RCNN with Paradigm Teacher for Unrestricted Object Detection , 2022, International Journal of Computer Vision.

[5]  D. Gavrila,et al.  Structural Knowledge Distillation for Object Detection , 2022, NeurIPS.

[6]  Gui Gao,et al.  A novel full-polarization SAR image ship detector based on scattering mechanisms and wave polarization anisotropy , 2022, ISPRS Journal of Photogrammetry and Remote Sensing.

[7]  Xiaoqiang Lu,et al.  Multi-Level Alignment Network for Cross-Domain Ship Detection , 2022, Remote. Sens..

[8]  Limin Wang,et al.  Task-specific Inconsistency Alignment for Domain Adaptive Object Detection , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  H. Shum,et al.  DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection , 2022, ICLR.

[10]  A. Subramanian,et al.  To miss-attend is to misalign! Residual Self-Attentive Feature Alignment for Adapting Object Detectors , 2022, 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).

[11]  Xiaoling Zhang,et al.  SAR Ship Detection Dataset (SSDD): Official Release and Comprehensive Data Analysis , 2021, Remote. Sens..

[12]  Jianping Gou,et al.  Knowledge Distillation: A Survey , 2020, International Journal of Computer Vision.

[13]  Xinghao Ding,et al.  Harmonizing Transferability and Discriminability for Adapting Object Detectors , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Chen Wang,et al.  Precise and Robust Ship Detection for High-Resolution SAR Imagery Based on HR-SDNet , 2020, Remote. Sens..

[15]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[16]  Jianwei Li,et al.  Small ship detection in SAR images based on modified SSD , 2019, 2019 IEEE International Conference on Signal, Information and Data Processing (ICSIDP).

[17]  Toby P. Breckon,et al.  Unsupervised Domain Adaptation via Structured Prediction Based Selective Pseudo-Labeling , 2019, AAAI.

[18]  Zhiqiang Shen,et al.  SCL: Towards Accurate Domain Adaptive Object Detection via Gradient Detach Based Stacked Complementary Losses , 2019, ArXiv.

[19]  Lei Zhang,et al.  Multi-Adversarial Faster-RCNN for Unrestricted Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[20]  Han Zhao,et al.  On Learning Invariant Representations for Domain Adaptation , 2019, ICML.

[21]  Gangyao Kuang,et al.  Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[22]  Tao Zhang,et al.  Ship Detection From PolSAR Imagery Using the Complete Polarimetric Covariance Difference Matrix , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Chao Wang,et al.  A SAR Dataset of Ship Detection for Deep Learning under Complex Backgrounds , 2019, Remote. Sens..

[24]  Yiming Pi,et al.  Multi-Scale Proposal Generation for Ship Detection in SAR Images , 2019, Remote. Sens..

[25]  Kate Saenko,et al.  Strong-Weak Distribution Alignment for Adaptive Object Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Luc Van Gool,et al.  Domain Adaptive Faster R-CNN for Object Detection in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[31]  Zongxu Pan,et al.  Projection Shape Template-Based Ship Target Recognition in TerraSAR-X Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[32]  Serge J. Belongie,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  Liang Chen,et al.  A novel threshold template algorithm for ship detection in high-resolution SAR images , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[37]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[39]  Colin P. Schwegmann,et al.  Manifold Adaptation for Constant False Alarm Rate Ship Detection in South African Oceans , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Bo Zhang,et al.  A PolSAR ship detector based on a multi-polarimetric-feature combination using visual attention , 2014 .

[41]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[42]  Huanxin Zou,et al.  A CFAR Detection Algorithm for Generalized Gamma Distributed Background in High-Resolution SAR Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[43]  Mitsunobu Sugimoto,et al.  On the novel use of model-based decomposition in SAR polarimetry for target detection on the sea , 2013 .

[44]  Michael J. Collins,et al.  On the use of compact polarimetry SAR for ship detection , 2013 .

[45]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[46]  Irena Hajnsek,et al.  Very-High-Resolution Airborne Synthetic Aperture Radar Imaging: Signal Processing and Applications , 2013, Proceedings of the IEEE.

[47]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[48]  Bo Zhang,et al.  Ship detection based on feature confidence for high resolution SAR images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[49]  Gui Gao,et al.  A Parzen-Window-Kernel-Based CFAR Algorithm for Ship Detection in SAR Images , 2011, IEEE Geoscience and Remote Sensing Letters.

[50]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[51]  Liming Jiang,et al.  Using SAR Images to Detect Ships From Sea Clutter , 2008, IEEE Geoscience and Remote Sensing Letters.

[52]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[53]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[54]  Corina da Costa Freitas,et al.  A model for extremely heterogeneous clutter , 1997, IEEE Trans. Geosci. Remote. Sens..

[55]  Chuan Zhang,et al.  Oriented Ship Detection Based on Soft Thresholding and Context Information in SAR Images of Complex Scenes , 2024, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Ziyan Zhou,et al.  A Super Lightweight and Efficient SAR Image Ship Detector , 2023, IEEE Geoscience and Remote Sensing Letters.

[57]  Linlin Zhang,et al.  Scattering Characteristic-Aware Fully Polarized SAR Ship Detection Network Based on a Four-Component Decomposition Model , 2023, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Guili Gao,et al.  ADCG: A Cross-Modality Domain Transfer Learning Method for Synthetic Aperture Radar in Ship Automatic Target Recognition , 2023, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Tao Liu,et al.  Simultaneous Diagonalization of Hermitian Matrices and Its Application in PolSAR Ship Detection , 2023, IEEE Transactions on Geoscience and Remote Sensing.

[60]  L. Du,et al.  Unsupervised Domain Adaptation Based on Progressive Transfer for Ship Detection: From Optical to SAR Images , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Ying Luo,et al.  An Automatic Ship Detection Method Adapting to Different Satellites SAR Images with Feature Alignment and Compensation Loss , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Ying Luo,et al.  A Feature Decomposition-Based Method for Automatic Ship Detection Crossing Different Satellite SAR Images , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Xinbo Gao,et al.  A Robust One-Stage Detector for Multiscale Ship Detection With Complex Background in Massive SAR Images , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Daji Ergu,et al.  A Review of Yolo Algorithm Developments , 2021, ITQM.

[65]  Yuchen Guo,et al.  Unsupervised Domain Adaptation for SAR Target Detection , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[66]  Daniel R. Fuhrmann,et al.  A CFAR adaptive matched filter detector , 1992 .