CLUSTERING OF WALL GEOMETRY FROM UNSTRUCTURED POINT CLOUDS

Abstract. The automated reconstruction of Building Information Modeling (BIM) objects from point cloud data is still ongoing research. A key aspect is retrieving the proper observations for each object. After segmenting and classifying the initial point cloud, the labeled segments should be clustered according to their respective objects. However, this procedure is challenging due to noise, occlusions and the associativity between different objects. This is especially important for wall geometry as it forms the basis for further BIM reconstruction. In this work, a method is presented to automatically group wall segments derived from point clouds according to the proper walls of a building. More specifically, a Conditional Random Field is employed that evaluates the context of each observation in order to determine which wall it belongs too. The emphasis is on the clustering of highly associative walls as this topic currently is a gap in the body of knowledge. First a set of classified planar primitives is obtained using algorithms developed in prior work. Next, both local and contextual features are extracted based on the nearest neighbors and a number of seeds that are heuristically determined. The final wall clusters are then computed by decoding the graph and thus the most likely configuration of the observations. The experiments prove that the used method is a promising framework for wall clustering from unstructured point cloud data. Compared to a conventional region growing method, the proposed method significantly reduces the rate of false positives, resulting in better wall clusters. A key advantage of the proposed method is its capability of dealing with complex wall geometry in entire buildings opposed to the presented methods in current literature.

[1]  Martin Weinmann,et al.  Comparison of belief propagation and graph-cut approaches for contextual classification of 3D lidar point cloud data , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[2]  Dongjian He,et al.  A self-adaptive segmentation method for a point cloud , 2018, The Visual Computer.

[3]  Mark W. Schmidt,et al.  Graphical model structure learning using L₁-regularization , 2010 .

[4]  Mani Golparvar-Fard,et al.  Segmentation of building point cloud models including detailed architectural/structural features and MEP systems , 2015 .

[5]  Guojun Lu,et al.  An Automatic Building Extraction and Regularisation Technique Using LiDAR Point Cloud Data and Orthoimage , 2016, Remote. Sens..

[6]  Xinchang Zhang,et al.  Recognition of building group patterns in topographic maps based on graph partitioning and random forest , 2018 .

[7]  M. Bassier,et al.  Clustering of Wall Geometry from Unstructured Point Clouds Using Conditional Random Fields , 2019, Remote. Sens..

[8]  Renato Pajarola,et al.  Automatic room detection and reconstruction in cluttered indoor environments with complex room layouts , 2014, Comput. Graph..

[9]  Radim Sára,et al.  Spatial Pattern Templates for Recognition of Objects with Regular Structure , 2013, GCPR.

[10]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Renato Pajarola,et al.  Bayesian graph-cut optimization for wall surfaces reconstruction in indoor environments , 2017, The Visual Computer.

[12]  Sven Oesau,et al.  Indoor scene reconstruction using feature sensitive primitive extraction and graph-cut , 2014 .

[13]  Luigi Barazzetti,et al.  Towards automatic indoor reconstruction of cluttered building rooms from point clouds , 2014 .

[14]  Edwin Olson,et al.  Graph-based segmentation for colored 3D laser point clouds , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Avideh Zakhor,et al.  Floor plan generation and room labeling of indoor environments from laser range data , 2015, 2014 International Conference on Computer Graphics Theory and Applications (GRAPP).

[16]  Sagi Filin,et al.  Segmentation of terrestrial laser scanning data using geometry and image information , 2013 .

[17]  Markus Vincze,et al.  Fast semantic segmentation of 3D point clouds using a dense CRF with learned parameters , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Cheng Wang,et al.  Line segment extraction for large scale unorganized point clouds , 2015 .

[19]  Carl T. Haas,et al.  State of research in automatic as-built modelling , 2015, Adv. Eng. Informatics.

[20]  Thomas Hellström,et al.  Semi-Automatic Image Labelling Using Depth Information , 2015, Comput..

[21]  Patricio A. Vela,et al.  Detection of Walls, Floors, and Ceilings in Point Cloud Data , 2016 .

[22]  M. Bassier,et al.  Automated Semantic Labelling of 3D Vector Models for Scan-to-BIM , 2016 .

[23]  Enrique Valero,et al.  Automatic Method for Building Indoor Boundary Models from Dense Point Clouds Collected by Laser Scanners , 2012, Sensors.

[24]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[25]  Michela Bertolotto,et al.  Octree-based region growing for point cloud segmentation , 2015 .

[26]  C. Mallet,et al.  A structured regularization framework for spatially smoothing semantic labelings of 3D point clouds , 2017 .

[27]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[28]  Norbert Haala,et al.  3D Façade Labeling over Complex Scenarios: A Case Study Using Convolutional Neural Network and Structure-From-Motion , 2018, Remote. Sens..

[29]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Renato Pajarola,et al.  Piecewise‐planar Reconstruction of Multi‐room Interiors with Arbitrary Wall Arrangements , 2016, Comput. Graph. Forum.

[31]  Brendan J. Frey,et al.  A Revolution: Belief Propagation in Graphs with Cycles , 1997, NIPS.

[32]  S. J. Oude Elberink,et al.  Exploiting indoor mobile laser scanner trajectories for semantic interpretation of point clouds , 2017 .

[33]  George Vosselman,et al.  Contextual segment-based classification of airborne laser scanner data , 2017 .

[34]  Silvio Savarese,et al.  3D Semantic Parsing of Large-Scale Indoor Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Reinhard Klein,et al.  Automatic reconstruction of parametric building models from indoor point clouds , 2016, Comput. Graph..

[36]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields , 2010, Found. Trends Mach. Learn..

[37]  Wolfgang Förstner,et al.  eTRIMS Image Database for Interpreting Images of Man-Made Scenes , 2009 .

[38]  A Budroni,et al.  Automatic 3D modelling of indoor Manhattan-world scenes from laser data , 2010 .

[39]  Jaehoon Jung,et al.  Productive modeling for development of as-built BIM of existing indoor structures , 2014 .

[40]  Jan Boehm,et al.  Automatic Geometry Generation from Point Clouds for BIM , 2015, Remote. Sens..

[41]  Antonio Adán,et al.  3D Reconstruction of Interior Wall Surfaces under Occlusion and Clutter , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[42]  Thorsten Joachims,et al.  Contextually Guided Semantic Labeling and Search for 3D Point Clouds , 2011, ArXiv.

[43]  Lutz Plümer,et al.  CityGML – Interoperable semantic 3D city models , 2012 .

[44]  Burcu Akinci,et al.  Automatic Reconstruction of As-Built Building Information Models from Laser-Scanned Point Clouds: A Review of Related Techniques | NIST , 2010 .

[45]  Silvio Savarese,et al.  Joint 2D-3D-Semantic Data for Indoor Scene Understanding , 2017, ArXiv.

[46]  Frank Schultmann,et al.  Building Information Modeling (BIM) for existing buildings — Literature review and future needs , 2014 .

[47]  Konstantinos G. Derpanis,et al.  Overview of the RANSAC Algorithm , 2005 .

[48]  M. Bassier,et al.  Classification of sensor independent point cloud data of building objects using random forests , 2019, Journal of Building Engineering.

[49]  Anh Nguyen,et al.  3D point cloud segmentation: A survey , 2013, 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[50]  Hang Yang,et al.  Structured Indoor Modeling , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[51]  Daniel Huber,et al.  Using Context to Create Semantic 3D Models of Indoor Environments , 2010, BMVC.