Automatic reconstruction of fully volumetric 3D building models from point clouds

We present a novel method for reconstructing parametric, volumetric, multi-story building models from unstructured, unfiltered indoor point clouds by means of solving an integer linear optimization problem. Our approach overcomes limitations of previous methods in several ways: First, we drop assumptions about the input data such as the availability of separate scans as an initial room segmentation. Instead, a fully automatic room segmentation and outlier removal is performed on the unstructured point clouds. Second, restricting the solution space of our optimization approach to arrangements of volumetric wall entities representing the structure of a building enforces a consistent model of volumetric, interconnected walls fitted to the observed data instead of unconnected, paper-thin surfaces. Third, we formulate the optimization as an integer linear programming problem which allows for an exact solution instead of the approximations achieved with most previous techniques. Lastly, our optimization approach is designed to incorporate hard constraints which were difficult or even impossible to integrate before. We evaluate and demonstrate the capabilities of our proposed approach on a variety of complex real-world point clouds. This is an early preprint version. The final version, which was accepted for publication in the ISPRS Journal of Photogrammetry and Remote Sensing, is available at https: // doi. org/ 10. 1016/ j. isprsjprs. 2019. 03. 017

[1]  Luigi Barazzetti,et al.  Towards automatic indoor reconstruction of cluttered building rooms from point clouds , 2014 .

[2]  S. Dongen A cluster algorithm for graphs , 2000 .

[3]  Marc Pollefeys,et al.  Indoor Scan2BIM: Building information models of house interiors , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Jan Boehm,et al.  Automatic Geometry Generation from Point Clouds for BIM , 2015, Remote. Sens..

[5]  Antonio Adán,et al.  3D Reconstruction of Interior Wall Surfaces under Occlusion and Clutter , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[6]  Hyojoo Son,et al.  Semantic as-built 3D modeling of structural elements of buildings based on local concavity and convexity , 2017, Adv. Eng. Informatics.

[7]  Eckehard G. Steinbach,et al.  Room segmentation in 3D point clouds using anisotropic potential fields , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Martin Tamke,et al.  Data completion in building information management: electrical lines from range scans and photographs , 2017 .

[9]  Tania Landes,et al.  From Point Clouds to Building Information Models: 3D Semi-Automatic Reconstruction of Indoors of Existing Buildings , 2017 .

[10]  Renato Pajarola,et al.  Robust Reconstruction of Interior Building Structures with Multiple Rooms under Clutter and Occlusions , 2013, 2013 International Conference on Computer-Aided Design and Computer Graphics.

[11]  Axel Wendt,et al.  Automatic Room Segmentation From Unstructured 3-D Data of Indoor Environments , 2017, IEEE Robotics and Automation Letters.

[12]  Cyrill Stachniss,et al.  Automatic Room Segmentation of 3D Laser Data Using Morphological Processing , 2017, ISPRS Int. J. Geo Inf..

[13]  Brian Okorn,et al.  Toward Automated Modeling of Floor Plans , 2010 .

[14]  Antonio Adán,et al.  Scan-to-BIM for 'secondary' building components , 2018, Adv. Eng. Informatics.

[15]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2011 .

[16]  Reinhard Klein,et al.  Automatic reconstruction of parametric building models from indoor point clouds , 2016, Comput. Graph..

[17]  Reinhard Klein,et al.  Automatic generation of structural building descriptions from 3D point cloud scans , 2015, 2014 International Conference on Computer Graphics Theory and Applications (GRAPP).

[18]  Renato Pajarola,et al.  Exploiting the room structure of buildings for scalable architectural modeling of interiors , 2017, SIGGRAPH Posters.

[19]  Avideh Zakhor,et al.  Planar 3D modeling of building interiors from point cloud data , 2012, 2012 19th IEEE International Conference on Image Processing.

[20]  Sven Oesau,et al.  Indoor scene reconstruction using feature sensitive primitive extraction and graph-cut , 2014 .

[21]  Avideh Zakhor,et al.  Floor plan generation and room labeling of indoor environments from laser range data , 2015, 2014 International Conference on Computer Graphics Theory and Applications (GRAPP).

[22]  Renato Pajarola,et al.  Piecewise‐planar Reconstruction of Multi‐room Interiors with Arbitrary Wall Arrangements , 2016, Comput. Graph. Forum.

[23]  John Kaiser Calautit,et al.  A framework for producing gbXML building geometry from Point Clouds for accurate and efficient Building Energy Modelling , 2018 .

[24]  Renato Pajarola,et al.  Reconstructing Complex Indoor Environments with Arbitrary Wall Orientations , 2014, Eurographics.

[25]  Kourosh Khoshelham,et al.  THE ISPRS BENCHMARK ON INDOOR MODELLING , 2017 .

[26]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[27]  Daniel Huber,et al.  Building Modeling through Enclosure Reasoning , 2014, 2014 2nd International Conference on 3D Vision.

[28]  Sven Oesau,et al.  Indoor Scene Reconstruction using Primitive-driven Space Partitioning and Graph-cut , 2013, UDMV.

[29]  Niloy J. Mitra,et al.  RAPter , 2015, ACM Trans. Graph..

[30]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[31]  Thomas Krijnen,et al.  An IFC schema extension and binary serialization format to efficiently integrate point cloud data into building models , 2017, Adv. Eng. Informatics.

[32]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[33]  Dong Chen,et al.  Modeling Indoor Spaces Using Decomposition and Reconstruction of Structural Elements , 2017 .

[34]  Renato Pajarola,et al.  Automatic room detection and reconstruction in cluttered indoor environments with complex room layouts , 2014, Comput. Graph..

[35]  Avideh Zakhor,et al.  Fast, Automated, Scalable Generation of Textured 3D Models of Indoor Environments , 2015, IEEE Journal of Selected Topics in Signal Processing.

[36]  Jan Boehm,et al.  Automated 3D Reconstruction of Interiors from Point Clouds , 2010 .

[37]  M. Bassier,et al.  Classification of sensor independent point cloud data of building objects using random forests , 2019, Journal of Building Engineering.

[38]  Jiajun Wu,et al.  Raster-to-Vector: Revisiting Floorplan Transformation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[39]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[40]  Silvio Savarese,et al.  Joint 2D-3D-Semantic Data for Indoor Scene Understanding , 2017, ArXiv.

[41]  Chen Liu,et al.  FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scans , 2018, ECCV.

[42]  Peter Wonka,et al.  PolyFit: Polygonal Surface Reconstruction from Point Clouds , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).