Attention Enhanced U-Net for Building Extraction from Farmland Based on Google and WorldView-2 Remote Sensing Images

High-resolution remote sensing images contain abundant building information and provide an important data source for extracting buildings, which is of great significance to farmland preservation. However, the types of ground features in farmland are complex, the buildings are scattered and may be obscured by clouds or vegetation, leading to problems such as a low extraction accuracy in the existing methods. In response to the above problems, this paper proposes a method of attention-enhanced U-Net for building extraction from farmland, based on Google and WorldView-2 remote sensing images. First, a Resnet unit is adopted as the infrastructure of the U-Net network encoding part, then the spatial and channel attention mechanism module is introduced between the Resnet unit and the maximum pool and the multi-scale fusion module is added to improve the U-Net network. Second, the buildings found on WorldView-2 and Google images are extracted through farmland boundary constraints. Third, boundary optimization and fusion processing are carried out for the building extraction results on the WorldView-2 and Google images. Fourth, a case experiment is performed. The method in this paper is compared with semantic segmentation models, such as FCN8, U-Net, Attention_UNet, and DeepLabv3+. The experimental results indicate that this method attains a higher accuracy and better effect in terms of building extraction within farmland; the accuracy is 97.47%, the F1 score is 85.61%, the recall rate (Recall) is 93.02%, and the intersection of union (IoU) value is 74.85%. Hence, buildings within farming areas can be effectively extracted, which is conducive to the preservation of farmland.

[1]  Chenxi Li,et al.  Characteristics, hazards, and control of illegal villa (houses): evidence from the Northern Piedmont of Qinling Mountains, Shaanxi Province, China , 2019, Environmental Science and Pollution Research.

[2]  Yugang Tian,et al.  A Novel Urban Composition Index Based on Water-Impervious Surface-Pervious Surface (W-I-P) Model for Urban Compositions Mapping Using Landsat Imagery , 2020, Remote. Sens..

[3]  Bedir Tekinerdogan,et al.  Effect of Attention Mechanism in Deep Learning-Based Remote Sensing Image Processing: A Systematic Literature Review , 2021, Remote. Sens..

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[6]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[7]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[8]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[9]  Bin Wang,et al.  Building Detection from VHR Remote Sensing Imagery Based on the Morphological Building Index , 2018, Remote. Sens..

[10]  Stavros Stavrou,et al.  Building extraction in satellite images using active contours and colour features , 2016 .

[11]  Wei Yuan,et al.  Automatic Building Segmentation of Aerial Imagery Using Multi-Constraint Fully Convolutional Networks , 2018, Remote. Sens..

[12]  Colin Perrin,et al.  Preserving Farmland on the Urban Fringe: A Literature Review on Land Policies in Developed Countries , 2020, Land.

[13]  Deren Li,et al.  An Accurate Matching Method for Projecting Vector Data into Surveillance Video to Monitor and Protect Cultivated Land , 2020, ISPRS Int. J. Geo Inf..

[14]  Feng Li,et al.  Fusion of Multiscale Convolutional Neural Networks for Building Extraction in Very High-Resolution Images , 2019, Remote. Sens..

[15]  Biao Wang,et al.  Building Extraction in Very High Resolution Imagery by Dense-Attention Networks , 2018, Remote. Sens..

[16]  Jun Wu,et al.  An Optimized Faster R-CNN Method Based on DRNet and RoI Align for Building Detection in Remote Sensing Images , 2020, Remote. Sens..

[17]  Han Hu,et al.  Joint Learning of Contour and Structure for Boundary-Preserved Building Extraction , 2021, Remote. Sens..

[18]  Lianru Gao,et al.  Building Extraction from High-Resolution Aerial Imagery Using a Generative Adversarial Network with Spatial and Channel Attention Mechanisms , 2019, Remote. Sens..

[19]  Tian Zhao,et al.  Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network , 2019, Remote. Sens..

[20]  Yuzhe Wu,et al.  Cultivated land protection policies in China facing 2030: Dynamic balance system versus basic farmland zoning , 2017 .

[21]  Yongyang Xu,et al.  Building Extraction in Very High Resolution Remote Sensing Imagery Using Deep Learning and Guided Filters , 2018, Remote. Sens..

[22]  Saman Ghaffarian,et al.  Automatic building detection based on Purposive FastICA (PFICA) algorithm using monocular high resolution Google Earth images , 2014 .

[23]  Xiangyun Hu,et al.  PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection , 2020, Remote. Sens..

[24]  Yongyang Xu,et al.  Building Extraction Based on U-Net with an Attention Block and Multiple Losses , 2020, Remote. Sens..

[25]  Hongmin Gao,et al.  An Efficient Building Extraction Method from High Spatial Resolution Remote Sensing Images Based on Improved Mask R-CNN , 2020, Sensors.

[26]  Zhenfeng Shao,et al.  BRRNet: A Fully Convolutional Neural Network for Automatic Building Extraction From High-Resolution Remote Sensing Images , 2020, Remote. Sens..

[27]  Lin Lei,et al.  Multi-scale object detection in remote sensing imagery with convolutional neural networks , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[28]  L. Salvati,et al.  Governance changes in peri-urban farmland protection following decentralisation: A comparison between Montpellier (France) and Rome (Italy) , 2018 .

[29]  Haohui Chen,et al.  A Novel Framework Based on Mask R-CNN and Histogram Thresholding for Scalable Segmentation of New and Old Rural Buildings , 2021, Remote. Sens..

[30]  Manchun Li,et al.  Delineation of a basic farmland protection zone based on spatial connectivity and comprehensive quality evaluation: A case study of Changsha City, China , 2020 .