Orientation guided anchoring for geospatial object detection from remote sensing imagery

Abstract Object detection from remote sensing imagery plays a significant role in a wide range of applications, including urban planning, intelligent transportation systems, ecology and environment analysis, etc. However, scale variations, orientation variations, illumination changes, and partial occlusions, as well as image qualities, bring great challenges for accurate geospatial object detection. In this paper, we propose an efficient orientation guided anchoring based geospatial object detection network based on convolutional neural networks. To handle objects of varying sizes, the feature extraction subnetwork extracts a pyramid of semantically strong features at different scales. Based on orientation guided anchoring, the anchor generation subnetwork generates a small set of high-quality, oriented anchors as object proposals. After orientation region of interest pooling, objects of interest are detected from the object proposals through the object detection subnetwork. The proposed method has been tested on a large geospatial object detection dataset. Quantitative evaluations show that an overall completeness, correctness, quality, and F1-measure of 0.9232, 0.9648, 0.8931, and 0.9435, respectively, are obtained. In addition, the proposed method achieves a processing speed of 8 images per second on a GPU on the cloud computing platform. Comparative studies with the existing object detection methods also demonstrate the advantageous detection accuracy and computational efficiency of our proposed method.

[1]  Farid Melgani,et al.  Convolutional SVM Networks for Object Detection in UAV Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Dawei Zai,et al.  Rotation-and-scale-invariant airplane detection in high-resolution satellite images based on deep-Hough-forests , 2016 .

[3]  Xiao Xiang Zhu,et al.  Vehicle Instance Segmentation From Aerial Image and Video Using a Multitask Learning Residual Fully Convolutional Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Tania Stathaki,et al.  Detection of Cars in High-Resolution Aerial Images of Complex Urban Environments , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Josiane Zerubia,et al.  Tree crown extraction using marked point processes , 2004, 2004 12th European Signal Processing Conference.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Noel E. O'Connor,et al.  Shallow and Deep Convolutional Networks for Saliency Prediction , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[10]  Josiane Zerubia,et al.  Unsupervised marked point process model for boat extraction in harbors from high resolution optical remotely sensed images , 2013, 2013 IEEE International Conference on Image Processing.

[11]  Maoguo Gong,et al.  Automatic Tobacco Plant Detection in UAV Images via Deep Neural Networks , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Qing Liu,et al.  Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Liangpei Zhang,et al.  A Multifeature Tensor for Remote-Sensing Target Recognition , 2011, IEEE Geoscience and Remote Sensing Letters.

[14]  Liujuan Cao,et al.  Vehicle Detection in High-Resolution Aerial Images via Sparse Representation and Superpixels , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Zhiguo Jiang,et al.  Online Exemplar-Based Fully Convolutional Network for Aircraft Detection in Remote Sensing Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[16]  Yizhuang Xie,et al.  M-FCN: Effective Fully Convolutional Network-Based Airplane Detection Framework , 2017, IEEE Geoscience and Remote Sensing Letters.

[17]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Josiane Zerubia,et al.  Building Detection in a Single Remotely Sensed Image with a Point Process of Rectangles , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Menglong Yan,et al.  IoU-Adaptive Deformable R-CNN: Make Full Use of IoU for Multi-Class Object Detection in Remote Sensing Imagery , 2019, Remote. Sens..

[20]  Yuan Hu,et al.  A Sample Update-Based Convolutional Neural Network Framework for Object Detection in Large-Area Remote Sensing Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[21]  O. Phillips,et al.  Individual tree crown delineation in a highly diverse tropical forest using very high resolution satellite images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[22]  Xiaoqiang Lu,et al.  Hierarchical and Robust Convolutional Neural Network for Very High-Resolution Remote Sensing Object Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Lei Guo,et al.  A coarse-to-fine model for airport detection from remote sensing images using target-oriented visual saliency and CRF , 2015, Neurocomputing.

[24]  Xiao Xiang Zhu,et al.  HSF-Net: Multiscale Deep Feature Embedding for Ship Detection in Optical Remote Sensing Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Andrea Manno-Kovacs,et al.  Building Detection From Monocular VHR Images by Integrated Urban Area Knowledge , 2015, IEEE Geoscience and Remote Sensing Letters.

[26]  Huseyin Gokhan Akcay,et al.  Building detection using directional spatial constraints , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Xiankun Yang,et al.  Road and Linear Structure Automatic Extraction from Remote Sensing Images Using Marked Point Process , 2008, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[28]  Hua Ai,et al.  Ship Detection in Optical Satellite Images Using Haar-like Features and Periphery-Cropped Neural Networks , 2018, IEEE Access.

[29]  C. A. Rishikeshan,et al.  An automated mathematical morphology driven algorithm for water body extraction from remotely sensed images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  Hong Huo,et al.  Rotation-Invariant Object Detection of Remotely Sensed Images Based on Texton Forest and Hough Voting , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Yanfei Zhong,et al.  Multi-class geospatial object detection based on a position-sensitive balancing framework for high spatial resolution remote sensing imagery , 2018 .

[32]  Fan Chen,et al.  Rotation-Invariant Object Detection in Remote Sensing Images Based on Radial-Gradient Angle , 2015, IEEE Geoscience and Remote Sensing Letters.

[33]  Zhiguo Jiang,et al.  Airport Detection Using End-to-End Convolutional Neural Network with Hard Example Mining , 2017, Remote. Sens..

[34]  Xian Sun,et al.  A generic discriminative part-based model for geospatial object detection in optical remote sensing images , 2015 .

[35]  Ting Peng,et al.  Incorporating Generic and Specific Prior Knowledge in a Multiscale Phase Field Model for Road Extraction From VHR Images , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Heng-Ming Tai,et al.  Inshore Ship Detection in Remote Sensing Images via Weighted Pose Voting , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[37]  He Chen,et al.  Arbitrary-Oriented Ship Detection Framework in Optical Remote-Sensing Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[38]  Jun Zhou,et al.  Multiscale Visual Attention Networks for Object Detection in VHR Remote Sensing Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[39]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Ke Li,et al.  Rotation-Insensitive and Context-Augmented Object Detection in Remote Sensing Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[41]  K. Vani,et al.  Water flow based geometric active deformable model for road network , 2015 .

[42]  Hong Huo,et al.  Affine Invariant Description and Large-Margin Dimensionality Reduction for Target Detection in Optical Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[43]  Gongjian Wen,et al.  Occluded Object Detection in High-Resolution Remote Sensing Images Using Partial Configuration Object Model , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Jalal Amini,et al.  Integrating fuzzy object based image analysis and ant colony optimization for road extraction from remotely sensed images , 2018 .

[45]  Jiangye Yuan,et al.  Learning Building Extraction in Aerial Scenes with Convolutional Networks , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Jocelyn Chanussot,et al.  ORSIm Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Zhihai Xu,et al.  $\mathcal{R}^2$ -CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Maciel Zortea,et al.  A supervised approach for simultaneous segmentation and classification of remote sensing images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[50]  Jun Zhou,et al.  VHR Object Detection Based on Structural Feature Extraction and Query Expansion , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Shuai Li,et al.  End-to-End Airport Detection in Remote Sensing Images Combining Cascade Region Proposal Networks and Multi-Threshold Detection Networks , 2018, Remote. Sens..

[52]  Ye Zhang,et al.  A light and faster regional convolutional neural network for object detection in optical remote sensing images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[53]  Wei Guo,et al.  Geospatial Object Detection in High Resolution Satellite Images Based on Multi-Scale Convolutional Neural Network , 2018, Remote. Sens..

[54]  Wenxian Yu,et al.  Toward Arbitrary-Oriented Ship Detection With Rotated Region Proposal and Discrimination Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[55]  Jia Liu,et al.  Unified Partial Configuration Model Framework for Fast Partially Occluded Object Detection in High-Resolution Remote Sensing Images , 2018, Remote. Sens..

[56]  Liujuan Cao,et al.  Vehicle detection from highway satellite images via transfer learning , 2016, Inf. Sci..

[57]  Zhenwei Shi,et al.  Fully Convolutional Network With Task Partitioning for Inshore Ship Detection in Optical Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[58]  Chen Zheng,et al.  Semantic Segmentation of Remote Sensing Imagery Using Object-Based Markov Random Field Model With Regional Penalties , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Sang-Yeon Kim,et al.  Application of Deep-Learning Methods to Bird Detection Using Unmanned Aerial Vehicle Imagery , 2019, Sensors.

[60]  Shunping Xiao,et al.  Deformable Faster R-CNN with Aggregating Multi-Layer Features for Partially Occluded Object Detection in Optical Remote Sensing Images , 2018, Remote. Sens..

[61]  Jiaxing Zhang,et al.  An On-Road Vehicle Detection Method for High-Resolution Aerial Images Based on Local and Global Structure Learning , 2017, IEEE Geoscience and Remote Sensing Letters.

[62]  Haiyan Guan,et al.  Rotation-Invariant Object Detection in High-Resolution Satellite Imagery Using Superpixel-Based Deep Hough Forests , 2015, IEEE Geoscience and Remote Sensing Letters.

[63]  Bo Du,et al.  A Sparse Representation-Based Binary Hypothesis Model for Target Detection in Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[65]  Naoto Yokoya,et al.  Object Detection Based on Sparse Representation and Hough Voting for Optical Remote Sensing Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[66]  Xin Xu,et al.  Deformable ConvNet with Aspect Ratio Constrained NMS for Object Detection in Remote Sensing Imagery , 2017, Remote. Sens..

[67]  Junwei Han,et al.  Object detection in remote sensing imagery using a discriminatively trained mixture model , 2013 .

[68]  Selim Aksoy,et al.  Detection of Compound Structures Using a Gaussian Mixture Model With Spectral and Spatial Constraints , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[69]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Chee Peng Lim,et al.  Robust Vehicle Detection in Aerial Images Using Bag-of-Words and Orientation Aware Scanning , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[71]  Yue Wu,et al.  A Novel Multi-Model Decision Fusion Network for Object Detection in Remote Sensing Images , 2019, Remote. Sens..

[72]  Zhenwei Shi,et al.  Ship Detection in Spaceborne Optical Image With SVD Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[73]  Libao Zhang,et al.  Airport Detection and Aircraft Recognition Based on Two-Layer Saliency Model in High Spatial Resolution Remote-Sensing Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[74]  Shiping Ma,et al.  Remote Sensing Airport Detection Based on End-to-End Deep Transferable Convolutional Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[75]  Uwe Stilla,et al.  Airborne Vehicle Detection in Dense Urban Areas Using HoG Features and Disparity Maps , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.