Aircraft-LBDet: Multi-Task Aircraft Detection with Landmark and Bounding Box Detection

With the rapid development of artificial intelligence and computer vision, deep learning has become widely used for aircraft detection. However, aircraft detection is still a challenging task due to the small target size and dense arrangement of aircraft and the complex backgrounds in remote sensing images. Existing remote sensing aircraft detection methods were mainly designed based on algorithms employed in general object detection methods. However, these methods either tend to ignore the key structure and size information of aircraft targets or have poor detection effects on densely distributed aircraft targets. In this paper, we propose a novel multi-task aircraft detection algorithm. Firstly, a multi-task joint training method is proposed, which provides richer semantic structure features for bounding box localization through landmark detection. Secondly, a multi-task inference algorithm is introduced that utilizes landmarks to provide additional supervision for bounding box NMS (non-maximum suppression) filtering, effectively reducing false positives. Finally, a novel loss function is proposed as a constrained optimization between bounding boxes and landmarks, which further improves aircraft detection accuracy. Experiments on the UCAS-AOD dataset demonstrated the state-of-the-art precision and efficiency of our proposed method compared to existing approaches. Furthermore, our ablation study revealed that the incorporation of our designed modules could significantly enhance network performance.

[1]  Hyung-Min Kwon Adversarial image perturbations with distortions weighted by color on deep neural networks , 2022, Multimedia Tools and Applications.

[2]  Ling Jian,et al.  SS R-CNN: Self-Supervised Learning Improving Mask R-CNN for Ship Detection in Remote Sensing Images , 2022, Remote. Sens..

[3]  Hyun Kwon,et al.  Toward Backdoor Attacks for Image Captioning Model in Deep Neural Networks , 2022, Security and Communication Networks.

[4]  W. Li,et al.  MS-IAF: Multi-Scale Information Augmentation Framework for Aircraft Detection , 2022, Remote. Sens..

[5]  Zia Khan,et al.  Deep Learning-Based Change Detection in Remote Sensing Images: A Review , 2022, Remote Sensing.

[6]  Xin Tan,et al.  An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images , 2022, Remote. Sens..

[7]  Leiyu Chen,et al.  Review of Image Classification Algorithms Based on Convolutional Neural Networks , 2021, Remote. Sens..

[8]  Shilin Zhou,et al.  DARDet: A Dense Anchor-Free Rotated Object Detector in Aerial Images , 2021, IEEE Geoscience and Remote Sensing Letters.

[9]  Yuxin Dong,et al.  Ship Object Detection of Remote Sensing Image Based on Visual Attention , 2021, Remote. Sens..

[10]  Jing Liu,et al.  Aircraft detection in remote sensing images based on deconvolution and position attention , 2021 .

[11]  Xiaohui Yuan,et al.  A review of deep learning methods for semantic segmentation of remote sensing imagery , 2021, Expert Syst. Appl..

[12]  Yuqian Li,et al.  Object detection in remote sensing images based on deep transfer learning , 2021, Multimedia Tools and Applications.

[13]  Qian Yin,et al.  Remote sensing image building detection method based on Mask R-CNN , 2021, Complex & Intelligent Systems.

[14]  Andrzej Stateczny,et al.  Cascade Object Detection and Remote Sensing Object Detection Method Based on Trainable Activation Function , 2021, Remote. Sens..

[15]  Xian Hu,et al.  Multiscale Convolutional Neural Networks for Geospatial Object Detection in VHR Satellite Images , 2021, IEEE Geoscience and Remote Sensing Letters.

[16]  Xinbo Gao,et al.  A Cascade Rotated Anchor-Aided Detector for Ship Detection in Remote Sensing Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Yue Zhang,et al.  Arbitrary-Oriented Object Detection in Remote Sensing Images Based on Polar Coordinates , 2020, IEEE Access.

[18]  Rui Li,et al.  Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[19]  S. Ullo,et al.  Land Use and Land Cover Classification using a Human Group based Particle Swarm Optimization Algorithm with a LSTM classifier on hybrid-pre-processing Remote Sensing Images , 2020, Remote. Sens..

[20]  Yue Zhang,et al.  Rotation-aware and multi-scale convolutional neural network for object detection in remote sensing images , 2020 .

[21]  Gong Cheng,et al.  Object Detection in Remote Sensing Images Based on Improved Bounding Box Regression and Multi-Level Features Fusion , 2020, Remote. Sens..

[22]  Yue Zhang,et al.  X-LineNet: Detecting Aircraft in Remote Sensing Images by a Pair of Intersecting Line Segments , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Lin Lei,et al.  Multi-scale object detection in remote sensing imagery with convolutional neural networks , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[24]  Haokui Zhang,et al.  Deep learning for remote sensing image classification: A survey , 2018, WIREs Data Mining Knowl. Discov..

[25]  Ke Li,et al.  Rotation-Insensitive and Context-Augmented Object Detection in Remote Sensing Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Hao Wu,et al.  Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[27]  Qingshan Liu,et al.  Hyperspectral Image Classification Using Spectral-Spatial LSTMs , 2017, CCCV.

[28]  Zhihan Lv,et al.  Change detection method for remote sensing images based on an improved Markov random field , 2017, Multimedia Tools and Applications.

[29]  Ronald Kemker,et al.  Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[31]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[33]  K. Fu,et al.  S2CGNet: A Robust Aircraft Detector Based on the Sword-Shaped Component Geometry , 2023, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Yazhou Ren,et al.  TEMDnet: A Novel Deep Denoising Network for Transient Electromagnetic Signal With Signal-to-Image Transformation , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Qiuyue Deng,et al.  GLF-Net: A Target Detection Method Based on Global and Local Multiscale Feature Fusion of Remote Sensing Aircraft Images , 2022, IEEE Geoscience and Remote Sensing Letters.

[36]  Daji Ergu,et al.  A Review of Yolo Algorithm Developments , 2021, ITQM.

[37]  Qi Wang,et al.  ABNet: Adaptive Balanced Network for Multi-scale Object Detection in Remote Sensing Imagery , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Xiuqiao Xiang,et al.  Aircraft detection in remote sensing image based on corner clustering and deep learning , 2020, Eng. Appl. Artif. Intell..