Semi-Supervised Building Detection from High-Resolution Remote Sensing Imagery

Urban building information reflects the status and trends of a region’s development and is essential for urban sustainability. Detection of buildings from high-resolution (HR) remote sensing images (RSIs) provides a practical approach for quickly acquiring building information. Mainstream building detection methods are based on fully supervised deep learning networks, which require a large number of labeled RSIs. In practice, manually labeling building instances in RSIs is labor-intensive and time-consuming. This study introduces semi-supervised deep learning techniques for building detection and proposes a semi-supervised building detection framework to alleviate this problem. Specifically, the framework is based on teacher–student mutual learning and consists of two key modules: the color and Gaussian augmentation (CGA) module and the consistency learning (CL) module. The CGA module is designed to enrich the diversity of building features and the quantity of labeled images for better training of an object detector. The CL module derives a novel consistency loss by imposing consistency of predictions from augmented unlabeled images to enhance the detection ability on the unlabeled RSIs. The experimental results on three challenging datasets show that the proposed framework outperforms state-of-the-art building detection methods and semi-supervised object detection methods. This study develops a new approach for optimizing the building detection task and a methodological reference for the various object detection tasks on RSIs.

[1]  Hanhong Zheng,et al.  Context-content collaborative network for building extraction from high-resolution imagery , 2023, Knowl. Based Syst..

[2]  Qibin Hou,et al.  SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation , 2022, NeurIPS.

[3]  Liang Huang,et al.  CA-BASNet: A Building Extraction Network in High Spatial Resolution Remote Sensing Images , 2022, Sustainability.

[4]  Do Young Eun,et al.  Efficiency Ordering of Stochastic Gradient Descent , 2022, NeurIPS.

[5]  Tao Zhang,et al.  A review of building detection from very high resolution optical remote sensing images , 2022, GIScience & Remote Sensing.

[6]  Yanchun Zhang,et al.  U-Net-Based Medical Image Segmentation , 2022, Journal of healthcare engineering.

[7]  Y. Wu,et al.  Review the state-of-the-art technologies of semantic segmentation based on deep learning , 2022, Neurocomputing.

[8]  Yuchen Guo,et al.  Semi-Supervised SAR Target Detection Based on an Improved Faster R-CNN , 2021, Remote. Sens..

[9]  Zhuo Zheng,et al.  Building damage assessment for rapid disaster response with a deep object-based semantic change detection framework: From natural disasters to man-made disasters , 2021 .

[10]  Bin Wang,et al.  Rotation-Invariant and Relation-Aware Cross-Domain Adaptation Object Detection Network for Optical Remote Sensing Images , 2021, Remote. Sens..

[11]  Bo Du,et al.  Scene-Driven Multitask Parallel Attention Network for Building Extraction in High-Resolution Remote Sensing Images , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Yumin Tan,et al.  Deep learning-based multi-feature semantic segmentation in building extraction from images of UAV photogrammetry , 2021 .

[13]  Kun Zhao,et al.  Bounding Boxes Are All We Need: Street View Image Classification via Context Encoding of Detected Buildings , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Michal Kedzierski,et al.  Detection, Classification and Boundary Regularization of Buildings in Satellite Imagery Using Faster Edge Region Convolutional Neural Networks , 2020, Remote. Sens..

[15]  Zhi Tian,et al.  FCOS: A Simple and Strong Anchor-Free Object Detector , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Shashi Shekhar,et al.  A locally-constrained YOLO framework for detecting small and densely-distributed building footprints , 2019, Int. J. Geogr. Inf. Sci..

[17]  Yanli Wang,et al.  Object Detection in High Resolution Remote Sensing Imagery Based on Convolutional Neural Networks With Suitable Object Scale Features , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Yoshua Bengio,et al.  Interpolation Consistency Training for Semi-Supervised Learning , 2019, IJCAI.

[19]  Feng Li,et al.  Fusion of Multiscale Convolutional Neural Networks for Building Extraction in Very High-Resolution Images , 2019, Remote. Sens..

[20]  Meng Lu,et al.  Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Hossein Arefi,et al.  A CNN-Based Approach for Automatic Building Detection and Recognition of Roof Types Using a Single Aerial Image , 2018, PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science.

[22]  Ruofei Zhong,et al.  Multilevel Building Detection Framework in Remote Sensing Images Based on Convolutional Neural Networks , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Tao Zhang,et al.  Monitoring of Urban Impervious Surfaces Using Time Series of High-Resolution Remote Sensing Images in Rapidly Urbanized Areas: A Case Study of Shenzhen , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Clive S. Fraser,et al.  Improved Building Detection Using Texture Information , 2013 .

[26]  Liangpei Zhang,et al.  An Adaptive Mean-Shift Analysis Approach for Object Extraction and Classification From Urban Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[27]  L. Du,et al.  Semisupervised SAR Ship Detection Network via Scene Characteristic Learning , 2023, IEEE Transactions on Geoscience and Remote Sensing.

[28]  B. Hou,et al.  Feature Split–Merge–Enhancement Network for Remote Sensing Object Detection , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Bin Wang,et al.  BOMSC-Net: Boundary Optimization and Multi-scale Context Awareness Based Building Extraction from High-Resolution Remote Sensing Imagery , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[30]  D. Ming,et al.  Distance Weight-Graph Attention Model-Based High-Resolution Remote Sensing Urban Functional Zone Identification , 2021, IEEE Transactions on Geoscience and Remote Sensing.