Effective Airplane Detection in Remote Sensing Images Based on Multilayer Feature Fusion and Improved Nonmaximal Suppression Algorithm

Aiming at the problem of insufficient representation ability of weak and small objects and overlapping detection boxes in airplane object detection, an effective airplane detection method in remote sensing images based on multilayer feature fusion and an improved nonmaximal suppression algorithm is proposed. Firstly, based on the common low-level visual features of natural images and airport remote sensing images, region-based convolutional neural networks are chosen to conduct transfer learning for airplane images using a limited amount of data. Then, the L2 norm normalization, feature connection, scale scaling, and feature dimension reduction are introduced to achieve effective fusion of lowand high-level features. Finally, a nonmaximal suppression method based on a soft decision function is proposed to solve the overlap problem of detection boxes. The experimental results show that the proposed method can effectively improve the representation ability of weak and small objects, as well as quickly and accurately detect airplane objects in the airport area.

[1]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Xian Sun,et al.  Object Detection in High-Resolution Remote Sensing Images Using Rotation Invariant Parts Based Model , 2014, IEEE Geoscience and Remote Sensing Letters.

[3]  Shiming Xiang,et al.  Aircraft Detection by Deep Belief Nets , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[6]  Lin Lei,et al.  Multi-scale object detection in remote sensing imagery with convolutional neural networks , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[7]  宋明珠 Song Mingzhu,et al.  Weak Ship Target Detection of Noisy Optical Remote Sensing Image on Sea Surface , 2017 .

[8]  Xian Sun,et al.  Aircraft Recognition in High-Resolution Satellite Images Using Coarse-to-Fine Shape Prior , 2013, IEEE Geoscience and Remote Sensing Letters.

[9]  Abhinav Gupta,et al.  A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Bo Du,et al.  Weakly Supervised Learning Based on Coupled Convolutional Neural Networks for Aircraft Detection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Fuchun Sun,et al.  HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Shuai Li,et al.  End-to-End Airport Detection in Remote Sensing Images Combining Cascade Region Proposal Networks and Multi-Threshold Detection Networks , 2018, Remote. Sens..

[15]  Wei Li,et al.  Robust airplane detection in satellite images , 2011, 2011 18th IEEE International Conference on Image Processing.

[16]  Yang Li,et al.  An Aircraft Detection Framework Based on Reinforcement Learning and Convolutional Neural Networks in Remote Sensing Images , 2018, Remote. Sens..

[17]  Zhenwei Shi,et al.  Airplane detection based on rotation invariant and sparse coding in remote sensing images , 2014 .

[18]  Wei Liu,et al.  ParseNet: Looking Wider to See Better , 2015, ArXiv.

[19]  Wensheng Wang,et al.  A Novel Method of Aircraft Detection Based on High-Resolution Panchromatic Optical Remote Sensing Images , 2017, Sensors.

[20]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Matthieu Guillaumin,et al.  Non-maximum Suppression for Object Detection by Passing Messages Between Windows , 2014, ACCV.

[22]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[23]  Zhong Chen,et al.  End-to-End Airplane Detection Using Transfer Learning in Remote Sensing Images , 2018, Remote. Sens..

[24]  Chunhong Pan,et al.  Feature Extraction by Rotation-Invariant Matrix Representation for Object Detection in Aerial Image , 2017, IEEE Geoscience and Remote Sensing Letters.

[25]  Yihua Tan,et al.  Aircraft Detection in High-Resolution SAR Images Based on a Gradient Textural Saliency Map , 2015, Sensors.

[26]  Ediz Polat,et al.  Detection of stationary aircrafts from satelitte images , 2011, 2011 IEEE 19th Signal Processing and Communications Applications Conference (SIU).

[27]  Shukui Bo,et al.  Region-based airplane detection in remotely sensed imagery , 2010, 2010 3rd International Congress on Image and Signal Processing.

[28]  Xinran Yu,et al.  An automated airplane detection system for large panchromatic image with high spatial resolution , 2014 .

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  Hui Wu,et al.  Fast aircraft detection in satellite images based on convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[31]  Ping Jiang,et al.  Robust Aircraft Detection with a Simple and Efficient Model , 2018, Inf..

[32]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Shuai Li,et al.  Rapid Airplane Detection in Remote Sensing Images Based on Multilayer Feature Fusion in Fully Convolutional Neural Networks , 2018, Sensors.

[34]  Wei Liu,et al.  DSSD : Deconvolutional Single Shot Detector , 2017, ArXiv.