Combined Rule-Based and Hypothesis-Based Method for Building Model Reconstruction from Photogrammetric Point Clouds

Three-dimensional (3D) building models play an important role in digital cities and have numerous potential applications in environmental studies. In recent years, the photogrammetric point clouds obtained by aerial oblique images have become a major source of data for 3D building reconstruction. Aiming at reconstructing a 3D building model at Level of Detail (LoD) 2 and even LoD3 with preferred geometry accuracy and affordable computation expense, in this paper, we propose a novel method for the efficient reconstruction of building models from the photogrammetric point clouds which combines the rule-based and the hypothesis-based method using a two-stage topological recovery process. Given the point clouds of a single building, planar primitives and their corresponding boundaries are extracted and regularized to obtain abstracted building counters. In the first stage, we take advantage of the regularity and adjacency of the building counters to recover parts of the topological relationships between different primitives. Three constraints, namely pairwise constraint, triplet constraint, and nearby constraint, are utilized to form an initial reconstruction with candidate faces in ambiguous areas. In the second stage, the topologies in ambiguous areas are removed and reconstructed by solving an integer linear optimization problem based on the initial constraints while considering data fitting degree. Experiments using real datasets reveal that compared with state-of-the-art methods, the proposed method can efficiently reconstruct 3D building models in seconds with the geometry accuracy in decimeter level.

[1]  Xuedong Wen,et al.  Accurate Reconstruction of the LoD3 Building Model by Integrating Multi-Source Point Clouds and Oblique Remote Sensing Imagery , 2019, ISPRS Int. J. Geo Inf..

[2]  Florent Lafarge,et al.  Surface Reconstruction through Point Set Structuring , 2013, Comput. Graph. Forum.

[3]  Dong Chen,et al.  LiDAR Point Clouds to 3-D Urban Models$:$ A Review , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Fabio Remondino,et al.  OBLIQUE PHOTOGRAMMETRY SUPPORTING 3D URBAN RECONSTRUCTION OF COMPLEX SCENARIOS , 2017 .

[5]  Filip Biljecki,et al.  Applications of 3D City Models: State of the Art Review , 2015, ISPRS Int. J. Geo Inf..

[6]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[7]  Mohammad Awrangjeb,et al.  Automatic filtering and 2D modeling of airborne laser scanning building point cloud , 2020 .

[8]  V. Ruggiero,et al.  Roof planes detection via a second-order variational model , 2018 .

[9]  Qing Zhu,et al.  TEXTURE-AWARE DENSE IMAGE MATCHING USING TERNARY CENSUS TRANSFORM , 2016 .

[10]  Florent Lafarge,et al.  LOD Generation for Urban Scenes , 2015, ACM Trans. Graph..

[11]  Hans-Gerd Maas,et al.  Cycle graph analysis for 3D roof structure modelling: Concepts and performance , 2014 .

[12]  Qing Zhu,et al.  Integration of aerial oblique imagery and terrestrial imagery for optimized 3D modeling in urban areas , 2018 .

[13]  Ben Gorte,et al.  Automatic Building Outline Extraction from ALS Point Clouds by Ordered Points Aided Hough Transform , 2019, Remote. Sens..

[14]  Jianping Li,et al.  Automated Reconstruction of Building LoDs from Airborne LiDAR Point Clouds Using an Improved Morphological Scale Space , 2017, Remote. Sens..

[15]  George Vosselman,et al.  Building Reconstruction by Target Based Graph Matching on Incomplete Laser Data: Analysis and Limitations , 2009, Sensors.

[16]  Dong Chen,et al.  Curved Buildings Reconstruction From Airborne LiDAR Data by Matching and Deforming Geometric Primitives , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[17]  A. Gruen,et al.  SEMANTICALLY ENRICHED HIGH RESOLUTION LOD 3 BUILDING MODEL GENERATION , 2019 .

[18]  Lei Wang,et al.  An end-to-end shape modeling framework for vectorized building outline generation from aerial images , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  Ulrich Neumann,et al.  2.5D Dual Contouring: A Robust Approach to Creating Building Models from Aerial LiDAR Point Clouds , 2010, ECCV.

[20]  J. Shan,et al.  Building boundary tracing and regularization from airborne lidar point clouds , 2007 .

[21]  Lutz Plümer,et al.  Model driven reconstruction of roofs from sparse LIDAR point clouds , 2013 .

[22]  Dong Chen,et al.  Topologically Aware Building Rooftop Reconstruction From Airborne Laser Scanning Point Clouds , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Josiane Zerubia,et al.  Automatic Building Extraction from DEMs using an Object Approach and Application to the 3D-city Modeling , 2008 .

[24]  Fayez Tarsha Kurdi,et al.  Automatic evaluation and improvement of roof segments for modelling missing details using Lidar data , 2020, International Journal of Remote Sensing.

[25]  J. Badach,et al.  A framework for Air Quality Management Zones - Useful GIS-based tool for urban planning: Case studies in Antwerp and Gdańsk , 2020, Building and Environment.

[26]  Cheng Wang,et al.  Line segment extraction for large scale unorganized point clouds , 2015 .

[27]  E. Ng,et al.  Planning strategies for roadside tree planting and outdoor comfort enhancement in subtropical high-density urban areas , 2017 .

[28]  Andrzej Borkowski,et al.  3D building reconstruction from ALS data using unambiguous decomposition into elementary structures , 2016 .

[29]  Yongjun Zhang,et al.  3D building roof reconstruction from airborne LiDAR point clouds: a framework based on a spatial database , 2017, Int. J. Geogr. Inf. Sci..

[30]  Zbigniew Lubniewski,et al.  Improving the Accuracy of Automatic Reconstruction of 3D Complex Buildings Models from Airborne Lidar Point Clouds , 2020, Remote. Sens..

[31]  Neil Smith,et al.  Reconstructing building mass models from UAV images , 2016, Comput. Graph..

[32]  G. Vosselman BUILDING RECONSTRUCTION USING PLANAR FACES IN VERY HIGH DENSITY HEIGHT DATA , 1999 .

[33]  Xianfeng Huang,et al.  A Methodology for Automated Segmentation and Reconstruction of Urban 3-D Buildings from ALS Point Clouds , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Jie Shan,et al.  Building roof modeling from airborne laser scanning data based on level set approach , 2011 .

[35]  Reinhard Klein,et al.  Automatic reconstruction of fully volumetric 3D building models from oriented point clouds , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  G. Sohn,et al.  Using a Binary Space Partitioning Tree for Reconstructing Polyhedral Building Models from Airborne Lidar Data , 2008 .

[37]  S. J. Oude Elberink,et al.  A graph edit dictionary for correcting errors in roof topology graphs reconstructed from point clouds , 2014 .

[38]  Suya You,et al.  Photorealistic Large-Scale Urban City Model Reconstruction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[39]  Jin Liu,et al.  Automatic 3D building reconstruction from multi-view aerial images with deep learning , 2021 .

[40]  Wanshou Jiang,et al.  HRTT: A Hierarchical Roof Topology Structure for Robust Building Roof Reconstruction from Point Clouds , 2017, Remote. Sens..

[41]  Jie Shan,et al.  Segmentation and Reconstruction of Polyhedral Building Roofs From Aerial Lidar Point Clouds , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Yansong Duan,et al.  Extracting buildings from and regularizing boundaries in airborne lidar data using connected operators , 2016, International Journal of Remote Sensing.

[43]  Qing Zhu,et al.  Hierarchical Regularization of Building Boundaries in Noisy Aerial Laser Scanning and Photogrammetric Point Clouds , 2018, Remote. Sens..

[44]  F. Tarsha-Kurdi,et al.  Model-driven and data-driven approaches using LIDAR data: analysis and comparison , 2007 .

[45]  Ayman Habib,et al.  An adaptive approach for the segmentation and extraction of planar and linear/cylindrical features from laser scanning data , 2014 .

[46]  Michael Wimmer,et al.  O-snap , 2013, ACM Trans. Graph..

[47]  Lutz Plümer,et al.  CityGML – Interoperable semantic 3D city models , 2012 .

[48]  Li Li,et al.  PAIRWISE LINKAGE FOR POINT CLOUD SEGMENTATION , 2016 .

[49]  Xinyi Liu,et al.  TopoLAP: Topology Recovery for Building Reconstruction by Deducing the Relationships between Linear and Planar Primitives , 2019, Remote. Sens..

[50]  Mohammad Awrangjeb,et al.  An Effective Data-Driven Method for 3-D Building Roof Reconstruction and Robust Change Detection , 2018, Remote. Sens..

[51]  Shu-Ching Chen,et al.  Automatic Construction of Building Footprints From Airborne LIDAR Data , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Zongyue Wang,et al.  Robust 3D reconstruction of building surfaces from point clouds based on structural and closed constraints , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.