Developing a Method to Extract Building 3D Information from GF-7 Data

The three-dimensional (3D) information of buildings can describe the horizontal and vertical development of a city. The GaoFen-7 (GF-7) stereo-mapping satellite can provide multi-view and multi-spectral satellite images, which can clearly describe the fine spatial details within urban areas, while the feasibility of extracting building 3D information from GF-7 image remains understudied. This article establishes an automated method for extracting building footprints and height information from GF-7 satellite imagery. First, we propose a multi-stage attention U-Net (MSAU-Net) architecture for building footprint extraction from multi-spectral images. Then, we generate the point cloud from the multi-view image and construct normalized digital surface model (nDSM) to represent the height of off-terrain objects. Finally, the building height is extracted from the nDSM and combined with the results of building footprints to obtain building 3D information. We select Beijing as the study area to test the proposed method, and in order to verify the building extraction ability of MSAU-Net, we choose GF-7 self-annotated building dataset and a public dataset (WuHan University (WHU) Building Dataset) for model testing, while the accuracy is evaluated in detail through comparison with other models. The results are summarized as follows: (1) In terms of building footprint extraction, our method can achieve intersection-over-union indicators of 89.31% and 80.27% for the WHU Dataset and GF-7 self-annotated datasets, respectively; these values are higher than the results of other models. (2) The root mean square between the extracted building height and the reference building height is 5.41 m, and the mean absolute error is 3.39 m. In summary, our method could be useful for accurate and automatic 3D building information extraction from GF-7 satellite images, and have good application potential.

[1]  Chengyi Wang,et al.  Multi-Scale Residual Deep Network for Semantic Segmentation of Buildings with Regularizer of Shape Representation , 2020, Remote. Sens..

[2]  Wuming Zhang,et al.  An Easy-to-Use Airborne LiDAR Data Filtering Method Based on Cloth Simulation , 2016, Remote. Sens..

[3]  F. Meier,et al.  Hyperlocal mapping of urban air temperature using remote sensing and crowdsourced weather data , 2020 .

[4]  Kun Jia,et al.  Spatio-temporal changes of ecological vulnerability across the Qinghai-Tibetan Plateau , 2021, Ecological Indicators.

[5]  A. Inaba,et al.  Human Settlements, Infrastructure and Spatial Planning , 2014 .

[6]  Hui Lin,et al.  Fusion of WorldView-2 Stereo and Multitemporal TerraSAR-X Images for Building Height Extraction in Urban Areas , 2015, IEEE Geoscience and Remote Sensing Letters.

[7]  Leila Maria Garcia Fonseca,et al.  Urban population estimation based on residential buildings volume using IKONOS-2 images and lidar data , 2016 .

[8]  Rongjun Qin,et al.  Multi-level monitoring of subtle urban changes for the megacities of China using high-resolution multi-view satellite imagery , 2017 .

[9]  Tingting Lv,et al.  Detecting Building Edges from High Spatial Resolution Remote Sensing Imagery Using Richer Convolution Features Network , 2018, Remote. Sens..

[10]  Qihao Weng,et al.  Population Estimation of Urban Residential Communities Using Remotely Sensed Morphologic Data , 2015, IEEE Geoscience and Remote Sensing Letters.

[11]  Mats Sandberg,et al.  The influence of building height variability on pollutant dispersion and pedestrian ventilation in idealized high-rise urban areas , 2012 .

[12]  Feng Qi,et al.  Building height estimation using Google Earth , 2016 .

[13]  Rongjun Qin,et al.  3D Reconstruction through Fusion of Cross-View Images , 2020, Recent Advances in Image Restoration with Applications to Real World Problems.

[14]  C. Schmullius,et al.  Spatio-temporal analysis of the relationship between 2D/3D urban site characteristics and land surface temperature , 2017 .

[15]  Xiaocong Xu,et al.  Building Footprint Extraction from High-Resolution Images via Spatial Residual Inception Convolutional Neural Network , 2019, Remote. Sens..

[16]  Rongjun Qin,et al.  Change detection on LOD 2 building models with very high resolution spaceborne stereo imagery , 2014 .

[17]  Karen C. Seto,et al.  Building up or spreading out? Typologies of urban growth across 478 cities of 1 million+ , 2019, Environmental Research Letters.

[18]  Karen C. Seto,et al.  Developing a method to estimate building height from Sentinel-1 data , 2020 .

[19]  P. Patel,et al.  Global scenarios of urban density and its impacts on building energy use through 2050 , 2017, Proceedings of the National Academy of Sciences.

[20]  Xiaohuan Xi,et al.  Trend analysis of building height and total floor space in Beijing, China using ICESat/GLAS data , 2011 .

[21]  Lei Wang,et al.  An end-to-end shape modeling framework for vectorized building outline generation from aerial images , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[22]  Peng Jia,et al.  Mapping Fine-Scale Urban Spatial Population Distribution Based on High-Resolution Stereo Pair Images, Points of Interest, and Land Cover Data , 2020, Remote. Sens..

[23]  Guojin He,et al.  Robust Building Extraction for High Spatial Resolution Remote Sensing Images with Self-Attention Network , 2020, Sensors.

[24]  Jianya Gong,et al.  Angular difference feature extraction for urban scene classification using ZY-3 multi-angle high-resolution satellite imagery , 2018 .

[25]  Yinxia Cao,et al.  A deep learning method for building height estimation using high-resolution multi-view imagery over urban areas: A case study of 42 Chinese cities , 2021 .

[26]  Rongjun Qin,et al.  Automated LoD-2 Model Reconstruction from Very-HighResolution Satellite-derived Digital Surface Model and Orthophoto , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.