A Novel Data Augmentation Method for Detection of Specific Aircraft in Remote Sensing RGB Images

In this paper, we propose a novel data augmentation method for the detection of specific aircraft in remote sensing RGB images. For object detection, the number of training data has great influence on the training of deep learning network. Researchers suggest that the extensive training samples in deep learning are indispensable. The extensive training samples can guarantee the accuracy and robustness of object detection. We refer to military aircraft and helicopter as specific aircraft. Due to the number of remote sensing images of specific aircraft is far less than that of civil aircraft, it is difficult to train an ideal detection model only by using the available specific aircraft images. Deep learning networks have the excellent ability on fault tolerance and generalization and can extract features from simulated aircraft samples. This means that the simulated aircraft samples can partly replace real images to some extent and reduce the need for detection models. Inspired by this, true remote sensing images are combined with specific aircraft three-dimensional models to form simulated images. Compared with previous data augmentation method, such as flipping and rotating, our method brings in new sample information. The experiments based on remote sensing images show the feasibility and effectiveness of our method. Meanwhile, the proposed method has compatibility with other data augmentation methods.

[1]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Haiyan Guan,et al.  Rotation-Invariant Object Detection in High-Resolution Satellite Imagery Using Superpixel-Based Deep Hough Forests , 2015, IEEE Geoscience and Remote Sensing Letters.

[3]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jie Yang,et al.  Fast Aircraft Detection Using End-to-End Fully Convolutional Network , 2016, 2016 IEEE International Conference on Digital Signal Processing (DSP).

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Xin Huang,et al.  Deep networks under scene-level supervision for multi-class geospatial object detection from remote sensing images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[8]  Hui Wu,et al.  Fast aircraft detection in satellite images based on convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[9]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Liangpei Zhang,et al.  Robust geospatial object detection based on pre-trained faster R-CNN framework for high spatial resolution imagery , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[12]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[13]  Abhinav Gupta,et al.  A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[15]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[16]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.

[17]  Jiebo Luo,et al.  DOTA: A Large-Scale Dataset for Object Detection in Aerial Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[19]  Xinwei Zheng,et al.  A multi-model ensemble method based on convolutional neural networks for aircraft detection in large remote sensing images , 2018 .

[20]  Zhenwei Shi,et al.  Airplane detection based on rotation invariant and sparse coding in remote sensing images , 2014 .

[21]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Joon Beom Seo,et al.  A Perlin Noise-Based Augmentation Strategy for Deep Learning with Small Data Samples of HRCT Images , 2018, Scientific Reports.

[24]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.