Arbitrary-Oriented Ship Detection Through Center-Head Point Extraction

Ship detection in remote sensing images plays a crucial role in various applications and has drawn increasing attention in recent years. However, existing arbitrary-oriented ship detection methods are generally developed on a set of predefined rotated anchor boxes. These predefined boxes not only lead to inaccurate angle predictions but also introduce extra hyper-parameters and high computational cost. Moreover, the prior knowledge of ship size has not been fully exploited by existing methods, which hinders the improvement of their detection accuracy. Aiming at solving the above issues, in this paper, we propose a center-head point extraction based detector (named CHPDet) to achieve arbitrary-oriented ship detection in remote sensing images. Our CHPDet formulates arbitraryoriented ships as rotated boxes with head points which are used to determine the direction. And rotated Gaussian kernel is used to map the annotations into target heatmaps. Keypoint estimation is performed to find the center of ships. Then, the size and head point of the ships are regressed. The orientation-invariant model (OIM) is also used to produce orientation-invariant feature maps. Finally, we use the target size as prior to finetune the results. Moreover, we introduce a new dataset for multi-class arbitrary-oriented ship detection in remote sensing images at a fixed ground sample distance (GSD) which is named FGSD2021. Experimental results on FGSD2021 and two other widely used data sets, i.e., HRSC2016, and UCAS-AOD demonstrate that our CHPDet achieves state-of-the-art performance and can well distinguish between bow and stern. Code and FGSD2021 dataset are available at https://github.com/zf020114/CHPDet.

[1]  Yiping Yang,et al.  Rotated region based CNN for ship detection , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[2]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Junchi Yan,et al.  R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object , 2019, AAAI.

[4]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Yiping Yang,et al.  Ship Rotated Bounding Box Space for Ship Extraction From High-Resolution Optical Satellite Images With Complex Backgrounds , 2016, IEEE Geoscience and Remote Sensing Letters.

[6]  Yue Zhang,et al.  X-LineNet: Detecting Aircraft in Remote Sensing Images by a Pair of Intersecting Line Segments , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[8]  Xian Sun,et al.  DABNet: Deformable Contextual and Boundary-Weighted Network for Cloud Detection in Remote Sensing Images , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Gui-Song Xia,et al.  ReDet: A Rotation-equivariant Detector for Aerial Object Detection , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Yiping Yang,et al.  A High Resolution Optical Satellite Image Dataset for Ship Recognition and Some New Baselines , 2017, ICPRAM.

[11]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Jianke Zhu,et al.  Oriented RepPoints for Aerial Object Detection , 2021, ArXiv.

[14]  Hao Li,et al.  Oriented Objects as pairs of Middle Lines , 2019, ArXiv.

[15]  Gui-Song Xia,et al.  Align Deep Features for Oriented Object Detection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[17]  Lorenzo Bruzzone,et al.  Unsupervised Change Detection in Multispectral Remote Sensing Images via Spectral-Spatial Band Expansion , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Wei An,et al.  Gated Recurrent Multiattention Network for VHR Remote Sensing Image Classification , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Tao Zhang,et al.  Rotated Region Based Fully Convolutional Network for Ship Detection , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Qiang Qiu,et al.  Oriented Response Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Xue Yang,et al.  Learning Modulated Loss for Rotated Object Detection , 2019, ArXiv.

[23]  Hei Law,et al.  CornerNet: Detecting Objects as Paired Keypoints , 2018, ECCV.

[24]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[25]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[26]  Yue Zhang,et al.  Point-Based Estimator for Arbitrary-Oriented Object Detection in Aerial Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jiebo Luo,et al.  DOTA: A Large-Scale Dataset for Object Detection in Aerial Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Junwei Han,et al.  Oriented R-CNN for Object Detection , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[29]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[30]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  H. Zou,et al.  Enhancing Mid–Low-Resolution Ship Detection With High-Resolution Feature Distillation , 2022, IEEE Geoscience and Remote Sensing Letters.

[32]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[33]  Xiangyang Xue,et al.  Arbitrary-Oriented Scene Text Detection via Rotation Proposals , 2017, IEEE Transactions on Multimedia.

[34]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[35]  Wei Li,et al.  R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection , 2017, ArXiv.

[36]  Cheng Wang,et al.  PBNet: Part-based convolutional neural network for complex composite object detection in remote sensing imagery , 2021 .

[37]  Lingjuan Miao,et al.  Dynamic Anchor Learning for Arbitrary-Oriented Object Detection , 2020, AAAI.

[38]  Bo Liu,et al.  Oriented Object Detection in Aerial Images with Box Boundary-Aware Vectors , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[39]  Gang Wan,et al.  Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[40]  Gui-Song Xia,et al.  Learning RoI Transformer for Detecting Oriented Objects in Aerial Images , 2018, ArXiv.

[41]  Junchi Yan,et al.  Arbitrary-Oriented Object Detection with Circular Smooth Label , 2020, ECCV.

[42]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Bo Li,et al.  Ship Detection From Optical Satellite Images Based on Saliency Segmentation and Structure-LBP Feature , 2017, IEEE Geoscience and Remote Sensing Letters.

[44]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[45]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Yue Zhang,et al.  SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[47]  Bo Li,et al.  Ship Detection in High-Resolution Optical Imagery Based on Anomaly Detector and Local Shape Feature , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Kai Chen,et al.  Gliding vertex on the horizontal bounding box for multi-oriented object detection , 2020, IEEE transactions on pattern analysis and machine intelligence.

[49]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[50]  Deise Santana Maia,et al.  Classification of Remote Sensing Data With Morphological Attribute Profiles: A decade of advances , 2021, IEEE Geoscience and Remote Sensing Magazine.

[51]  Hao Chen,et al.  FCOS: Fully Convolutional One-Stage Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[52]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[53]  Junchi Yan,et al.  Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss , 2021, ICML.

[54]  Kai Chen,et al.  Hybrid Task Cascade for Instance Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Junchi Yan,et al.  Dense Label Encoding for Boundary Discontinuity Free Rotation Detection , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Wenxian Yu,et al.  Toward Arbitrary-Oriented Ship Detection With Rotated Region Proposal and Discrimination Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[58]  Shilin Zhou,et al.  DARDet: A Dense Anchor-Free Rotated Object Detector in Aerial Images , 2021, IEEE Geoscience and Remote Sensing Letters.

[59]  Shilin Zhou,et al.  Learning Deep Ship Detector in SAR Images From Scratch , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Lin Lei,et al.  Multi-scale object detection in remote sensing imagery with convolutional neural networks , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.