A Semantic Modelling Framework-Based Method for Building Reconstruction from Point Clouds

Over the past few years, there has been an increasing need for semantic information in automatic city modelling. However, due to the complexity of building structure, the semantic reconstruction of buildings is still a challenging task because it is difficult to extract architectural rules and semantic information from the data. To improve the insufficiencies, we present a semantic modelling framework-based approach for automated building reconstruction using the semantic information extracted from point clouds or images. In this approach, a semantic modelling framework is designed to describe and generate the building model, and a workflow is established for extracting the semantic information of buildings from an unorganized point cloud and converting the semantic information into the semantic modelling framework. The technical feasibility of our method is validated using three airborne laser scanning datasets, and the results are compared with other related works comprehensively, which indicate that our approach can simplify the reconstruction process from a point cloud and generate 3D building models with high accuracy and rich semantic information.

[1]  Vivek Verma,et al.  3D Building Detection and Modeling from Aerial LIDAR Data , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Uwe Stilla,et al.  WINDOW DETECTION IN SPARSE POINT CLOUDS USING INDOOR POINTS , 2013, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[3]  George Stiny,et al.  Pictorial and Formal Aspects of Shape and Shape Grammars , 1975 .

[4]  Wuming Zhang,et al.  Semantic Decomposition and Reconstruction of Compound Buildings with Symmetric Roofs from LiDAR Data and Aerial Imagery , 2015, Remote. Sens..

[5]  Shi-Min Hu,et al.  Adaptive partitioning of urban facades , 2011, SA '11.

[6]  Roland T. Chin,et al.  On the Detection of Dominant Points on Digital Curves , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Michael Wimmer,et al.  Interactive visual editing of grammars for procedural architecture , 2008, SIGGRAPH 2008.

[8]  Dennis Dahlke,et al.  True 3D building reconstruction: façade, roof and overhang modelling from oblique and vertical aerial imagery , 2015 .

[9]  Pascal Müller,et al.  Procedural modeling of cities , 2001, SIGGRAPH.

[10]  Chao Wang,et al.  Automatic BIM component extraction from point clouds of existing buildings for sustainability applications , 2015 .

[11]  Daniel G. Aliaga,et al.  Automatic Extraction of Manhattan-World Building Masses from 3D Laser Range Scans , 2012, IEEE Transactions on Visualization and Computer Graphics.

[12]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[13]  Bernhard Hohmann,et al.  Cityfit - High-Quality Urban Reconstruction by Fitting Shape Grammars to Image and derived Textured Point Clouds , 2008 .

[14]  Chris Sells,et al.  Programming wpf, 2nd edition , 2007 .

[15]  Hans-Gerd Maas,et al.  Cycle graph analysis for 3D roof structure modelling: Concepts and performance , 2014 .

[16]  Daniel G. Aliaga,et al.  Build-by-number: rearranging the real world to visualize novel architectural spaces , 2005, VIS 05. IEEE Visualization, 2005..

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Jixian Zhang,et al.  Advances in fusion of optical imagery and LiDAR point cloud applied to photogrammetry and remote sensing , 2017 .

[19]  Jing Xiao,et al.  Building footprint extraction based on radiometric and geometric constraints in airborne oblique images , 2015 .

[20]  Chao Luo,et al.  A KNOWLEDGE BASED HIERARCHICAL CLASSIFICATION TREE FOR 3 D FACADE MODELING USING TERRESTRIAL LASER SCANNING DATA , 2010 .

[21]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[22]  S. J. Oude Elberink,et al.  A graph edit dictionary for correcting errors in roof topology graphs reconstructed from point clouds , 2014 .

[23]  Uwe Stilla,et al.  Reconstruction of façades in point clouds from multi aspect oblique ALS , 2013, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[24]  Karl-Heinz Häfele,et al.  OGC City Geography Markup Language (CityGML) Encoding Standard , 2012 .

[25]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[26]  Mariette Yvinec,et al.  Feature Preserving Mesh Generation from 3D Point Clouds , 2010, Comput. Graph. Forum.

[27]  Lingfeng Wang,et al.  Layer-Wise Floorplan Extraction for Automatic Urban Building Reconstruction , 2016, IEEE Transactions on Visualization and Computer Graphics.

[28]  Daniel G. Aliaga,et al.  Building reconstruction using manhattan-world grammars , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[30]  Sven Havemann,et al.  A GML shape grammar for semantically enriched 3D building models , 2010, Comput. Graph..

[31]  Dieter Finkenzeller.  Detailed Building Facades , 2008, IEEE Computer Graphics and Applications.

[32]  Jian Wang,et al.  Automatic extraction of building boundaries using aerial LiDAR data , 2016 .

[33]  Daniel Solis.  Illustrated WPF , 2009 .

[34]  Norbert Haala,et al.  FAÇADE RECONSTRUCTION USING GEOMETRIC AND RADIOMETRIC POINT CLOUD INFORMATION , 2015 .

[35]  Luc Van Gool,et al.  Procedural 3D Building Reconstruction Using Shape Grammars and Detectors , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[36]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[37]  Véronique Gaildrat,et al.  Wall grammar for building generation , 2006, GRAPHITE '06.

[38]  Junichi Susaki.  Knowledge-Based Modeling of Buildings in Dense Urban Areas by Combining Airborne LiDAR Data and Aerial Images , 2013, Remote. Sens..