High-Quality Angle Prediction for Oriented Object Detection in Remote Sensing Images

Oriented object detection is a challenging task in remote sensing, where the detected objects can be represented by oriented bounding boxes (OBBs). Angle prediction in oriented object detection has been widely studied, due to its crucial role in object detection. However, the precision of angle prediction is severely limited by misalignments in most of the existing methods, including representation-, evaluation-, and optimization-based misalignments. To alleviate these misalignments, this article presents a novel angle prediction method, called angle quality estimation (AQE). Specifically, our proposed AQE transforms the angle prediction task into a distribution estimation task to address the representation misalignment problem and implicitly measure the quality of the predicted angles. Based on the estimated AQ, we then propose a new metric to comprehensively evaluate the quality of OBBs. Then, we propose an object aspect ratio-based loss function to optimize angle prediction for addressing the optimization misalignment. Our proposed AQE is a plug-and-play method, which can be embedded on any existing oriented object detector. Experimental results on three public benchmarks, including dataset for object detection in aerial images (DOTA), high resolution ship collections 2016 (HRSC2016), and International Conference on Document Analysis and Recognition 2015 (ICDAR2015) datasets, show that our method achieves better performance than the other state of the arts.

[1]  Tianyang Zhang,et al.  Generalized few-shot object detection in remote sensing images , 2023, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  Jian Xue,et al.  Shape-Adaptive Selection and Measurement for Oriented Object Detection , 2022, AAAI Conference on Artificial Intelligence.

[3]  Huiyu Zhou,et al.  Absolute Wrong Makes Better: Boosting Weakly Supervised Object Detection via Negative Deterministic Information , 2022, IJCAI.

[4]  Jian Xue,et al.  Refined One-Stage Oriented Object Detection Method for Remote Sensing Images , 2022, IEEE Transactions on Image Processing.

[5]  Wei Li,et al.  A General Gaussian Heatmap Label Assignment for Arbitrary-Oriented Object Detection , 2021, IEEE Transactions on Image Processing.

[6]  Licheng Jiao,et al.  Foreground Refinement Network for Rotated Object Detection in Remote Sensing Images , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Gui-Song Xia,et al.  ReDet: A Rotation-equivariant Detector for Aerial Object Detection , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Junchi Yan,et al.  Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss , 2021, ICML.

[9]  Lingjuan Miao,et al.  Dynamic Anchor Learning for Arbitrary-Oriented Object Detection , 2020, AAAI.

[10]  Junchi Yan,et al.  Dense Label Encoding for Boundary Discontinuity Free Rotation Detection , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Licheng Jiao,et al.  GRS-Det: An Anchor-Free Rotation Ship Detector Based on Gaussian-Mask in Remote Sensing Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Hyung-Il Kim,et al.  Localization Uncertainty Estimation for Anchor-Free Object Detection , 2020, ECCV Workshops.

[13]  Jun Li,et al.  Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection , 2020, NeurIPS.

[14]  Weiming Dong,et al.  Dynamic Refinement Network for Oriented and Densely Packed Object Detection , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Junchi Yan,et al.  Arbitrary-Oriented Object Detection with Circular Smooth Label , 2020, ECCV.

[16]  Haoran Wei,et al.  Oriented Objects as pairs of Middle Lines , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[17]  Xinggang Wang,et al.  IoU-aware Single-stage Object Detector for Accurate Localization , 2019, Image Vis. Comput..

[18]  Wen Yang,et al.  Mask OBB: A Semantic Attention-Based Mask Oriented Bounding Box Representation for Multi-Category Object Detection in Aerial Images , 2019, Remote. Sens..

[19]  Jian Guan,et al.  IENet: Interacting Embranchment One Stage Anchor Free Detector for Orientation Aerial Object Detection , 2019, ArXiv.

[20]  Guisong Xia,et al.  Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Xue Yang,et al.  Learning Modulated Loss for Rotated Object Detection , 2019, AAAI.

[22]  Junchi Yan,et al.  R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object , 2019, AAAI.

[23]  Jun Du,et al.  Adaptive Period Embedding for Representing Oriented Objects in Aerial Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Bin Fang,et al.  Feature Pyramid Reconfiguration With Consistent Loss for Object Detection , 2019, IEEE Transactions on Image Processing.

[25]  Shengjin Wang,et al.  HAR-Net: Joint Learning of Hybrid Attention for Single-Stage Object Detection , 2019, IEEE Transactions on Image Processing.

[26]  Hyuk-Jae Lee,et al.  Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Driving , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[27]  Shijian Lu,et al.  CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Hanqing Lu,et al.  Attention CoupleNet: Fully Convolutional Attention Coupling Network for Object Detection , 2019, IEEE Transactions on Image Processing.

[29]  Gui-Song Xia,et al.  Learning RoI Transformer for Detecting Oriented Objects in Aerial Images , 2018, ArXiv.

[30]  Yue Zhang,et al.  SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[31]  Xiangyu Zhang,et al.  Bounding Box Regression With Uncertainty for Accurate Object Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Yuning Jiang,et al.  Acquisition of Localization Confidence for Accurate Object Detection , 2018, ECCV.

[33]  Peter Reinartz,et al.  Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagery , 2018, ACCV.

[34]  Gui-Song Xia,et al.  Rotation-Sensitive Regression for Oriented Scene Text Detection , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Menglong Yan,et al.  Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks , 2018, Remote. Sens..

[36]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Jiebo Luo,et al.  DOTA: A Large-Scale Dataset for Object Detection in Aerial Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[38]  Yiping Yang,et al.  Rotated region based CNN for ship detection , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[39]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[40]  Wei Li,et al.  R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection , 2017, ArXiv.

[41]  Shuchang Zhou,et al.  EAST: An Efficient and Accurate Scene Text Detector , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[43]  Xiang Bai,et al.  Detecting Oriented Text in Natural Images by Linking Segments , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Xiangyang Xue,et al.  Arbitrary-Oriented Scene Text Detection via Rotation Proposals , 2017, IEEE Transactions on Multimedia.

[45]  Yiping Yang,et al.  A High Resolution Optical Satellite Image Dataset for Ship Recognition and Some New Baselines , 2017, ICPRAM.

[46]  Serge J. Belongie,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Pan He,et al.  Detecting Text in Natural Image with Connectionist Text Proposal Network , 2016, ECCV.

[48]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[50]  Ernest Valveny,et al.  ICDAR 2015 competition on Robust Reading , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[51]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[54]  Christopher K. I. Williams,et al.  International Journal of Computer Vision manuscript No. (will be inserted by the editor) The PASCAL Visual Object Classes (VOC) Challenge , 2022 .

[55]  B. Hou,et al.  Feature Split–Merge–Enhancement Network for Remote Sensing Object Detection , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Shunping Ji,et al.  A New Spatial-Oriented Object Detection Framework for Remote Sensing Images , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.