Building detection in high spatial resolution remote sensing imagery with the U-Rotation Detection Network

ABSTRACT Building detection in high spatial resolution optical remote sensing images is important for city planning, navigation, population estimation and many other applications. Although many methods have been proposed, building detection is still a challenging problem due to complex scenes and small or arbitrarily orientated buildings. Moreover, most algorithms detect rotated buildings with horizontal bounding boxes leading to many background pixels being preserved in the final detection, which is not beneficial for post-processing. To address these problems, we present the U-Rotation Detection Network (U-RDN), which can effectively detect buildings with arbitrarily orientated detection bounding boxes. First, the U-Rotation Region Proposal Network (U-RRPN) is proposed to generate rotated proposals through rotated anchors. Then, a Rotation Fast-Region Convolutional Neural Network (RFast-RCNN) is performed, which extracts fixed-size features from rotated proposals and utilizes them to obtain fine-detections. For extracting fixed-size features from rotated proposals, we propose Auto Mask Region-Of-Interest Align (AM-ROI Align). The AM-ROI Align not only reduces abundant noise but also preserves the proper information of an object in ROI. Experimental results using the public building dataset, SpaceNet, show that our method can detect buildings with skewed bounding boxes and has a state-of-the-art performance compared with other algorithms.

[1]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[2]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[6]  Belaid Bouikhalene,et al.  Building Detection from Satellite Images based on Curvature Scale Space Method , 2016 .

[7]  Xiangyang Xue,et al.  Arbitrary-Oriented Scene Text Detection via Rotation Proposals , 2017, IEEE Transactions on Multimedia.

[8]  Jianya Gong,et al.  Angular difference feature extraction for urban scene classification using ZY-3 multi-angle high-resolution satellite imagery , 2018 .

[9]  Yong Dou,et al.  Region-based convolutional neural networks for object detection in very high resolution remote sensing images , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[10]  Feng Li,et al.  An Effective Method Based on ACF for Aircraft Detection in Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Rongjun Qin,et al.  Multi-level monitoring of subtle urban changes for the megacities of China using high-resolution multi-view satellite imagery , 2017 .

[13]  A. Trémeau,et al.  International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives , 2013 .

[14]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[15]  Liangpei Zhang,et al.  Morphological Building/Shadow Index for Building Extraction From High-Resolution Imagery Over Urban Areas , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  M. Moens,et al.  First Report of the Cereal Cyst Nematode Heterodera latipons on Wheat in Morocco. , 2012, Plant disease.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Jiangye Yuan,et al.  Automatic Building Extraction in Aerial Scenes Using Convolutional Networks , 2016, ArXiv.

[19]  Olaf Hellwich,et al.  COLOR TEXTONS FOR BUILDING DETECTION , 2012 .

[20]  Brian Johnson,et al.  A regression modelling approach for optimizing segmentation scale parameters to extract buildings of different sizes , 2018 .

[21]  Shiyong Cui,et al.  BUILDING EXTRACTION FROM REMOTE SENSING DATA USING FULLY CONVOLUTIONAL NETWORKS , 2017 .

[22]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Liangpei Zhang,et al.  An Efficient and Robust Integrated Geospatial Object Detection Framework for High Spatial Resolution Remote Sensing Imagery , 2017, Remote. Sens..

[24]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[25]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Yan-Jun Hu,et al.  ACCURATE AND FAST BUILDING DETECTION USING BINARY BAG-OF-FEATURES , 2017 .

[27]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Weiguo Gong,et al.  Learning Oriented Region-based Convolutional Neural Networks for Building Detection in Satellite Remote Sensing Images , 2017 .

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).