A Hierarchical Building Segmentation in Digital Surface Models for 3D Reconstruction

In this study, a hierarchical method for segmenting buildings in a digital surface model (DSM), which is used in a novel framework for 3D reconstruction, is proposed. Most 3D reconstructions of buildings are model-based. However, the limitations of these methods are overreliance on completeness of the offline-constructed models of buildings, and the completeness is not easily guaranteed since in modern cities buildings can be of a variety of types. Therefore, a model-free framework using high precision DSM and texture-images buildings was introduced. There are two key problems with this framework. The first one is how to accurately extract the buildings from the DSM. Most segmentation methods are limited by either the terrain factors or the difficult choice of parameter-settings. A level-set method are employed to roughly find the building regions in the DSM, and then a recently proposed ‘occlusions of random textures model’ are used to enhance the local segmentation of the buildings. The second problem is how to generate the facades of buildings. Synergizing with the corresponding texture-images, we propose a roof-contour guided interpolation of building facades. The 3D reconstruction results achieved by airborne-like images and satellites are compared. Experiments show that the segmentation method has good performance, and 3D reconstruction is easily performed by our framework, and better visualization results can be obtained by airborne-like images, which can be further replaced by UAV images.

[1]  Michael Cramer,et al.  The DGPF-Test on Digital Airborne Camera Evaluation - Over- view and Test Design , 2010 .

[2]  Keiko Saito,et al.  Mapping urban building stocks for vulnerability assessment – preliminary results , 2011, Int. J. Digit. Earth.

[3]  Yanming Chen,et al.  Multiscale Grid Method for Detection and Reconstruction of Building Roofs from Airborne LiDAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Dustin G. Mixon,et al.  Images as Occlusions of Textures: A Framework for Segmentation , 2014, IEEE Transactions on Image Processing.

[5]  Jonathan Li,et al.  Web-based visualization of large 3D urban building models , 2014, Int. J. Digit. Earth.

[6]  Rongjun Qin,et al.  Object-Based 3-D Building Change Detection on Multitemporal Stereo Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Peng-hui Tian,et al.  Building Contours Extraction from Light Detect and Ranging Data , 2011, 2011 Symposium on Photonics and Optoelectronics (SOPO).

[8]  Yi Shen,et al.  A roof-contour guided multi-side interpolation method for building texture-mapping using remote sensing resource , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[9]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ye Zhang,et al.  Feature guided multi-window area-based matching method for urban remote sensing stereo pairs , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[11]  Ting Zhao,et al.  A Multicriteria Evaluation Method for 3-D Building Reconstruction , 2014, IEEE Geoscience and Remote Sensing Letters.

[12]  Chun Liu,et al.  Automatic Buildings Extraction From LiDAR Data in Urban Area by Neural Oscillator Network of Visual Cortex , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  C. Brenner Building reconstruction from images and laser scanning , 2005 .

[14]  Ye Zhang,et al.  A novel level set framework for LOD2 building modeling , 2012, 2012 19th IEEE International Conference on Image Processing.

[15]  Zhu Lin,et al.  Design and development of wetland evaluation system based on remote sensing and 3D visualization , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[16]  Ye Zhang,et al.  Shadow Detection and Removal for Occluded Object Information Recovery in Urban High-Resolution Panchromatic Satellite Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Hichem Sahli,et al.  A Stochastic Framework for the Identification of Building Rooftops Using a Single Remote Sensing Image , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Matthieu Cord,et al.  Detection, Characterization, and Modeling Vegetation in Urban Areas From High-Resolution Aerial Imagery , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  J. Gong,et al.  3D Building Model Reconstruction from Multi-view Aerial Imagery and Lidar Data , 2011 .

[20]  Florence Tupin,et al.  Extraction and Three-Dimensional Reconstruction of Isolated Buildings in Urban Scenes From High-Resolution Optical and SAR Spaceborne Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Chaitanya K. Baru,et al.  OpenTopography: a services oriented architecture for community access to LIDAR topography , 2011, COM.Geo.

[22]  Paolo Gamba,et al.  Digital surface models and building extraction: a comparison of IFSAR and LIDAR data , 2000, IEEE Trans. Geosci. Remote. Sens..

[23]  Josiane Zerubia,et al.  Structural Approach for Building Reconstruction from a Single DSM , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.