Automatic Reconstruction of As-Built Building Information Models from Laser-Scanned Point Clouds: A Review of Related Techniques | NIST

Building information models (BIMs) are maturing as a new paradigm for storing and exchanging knowledge about a facility. BIMs constructed from a CAD model do not generally capture details of a facility as it was actually built. Laser scanners can be used to capture dense 3D measurements of a facility's as-built condition and the resulting point cloud can be manually processed to create an as-built BIM — a time-consuming, subjective, and error-prone process that could benefit significantly from automation. This article surveys techniques developed in civil engineering and computer science that can be utilized to automate the process of creating as-built BIMs. We sub-divide the overall process into three core operations: geometric modeling, object recognition, and object relationship modeling. We survey the state-of-the-art methods for each operation and discuss their potential application to automated as-built BIM creation. We also outline the main methods used by these algorithms for representing knowledge about shape, identity, and relationships. In addition, we formalize the possible variations of the overall as-built BIM creation problem and outline performance evaluation measures for comparing as-built BIM creation algorithms and tracking progress of the field. Finally, we identify and discuss technology gaps that need to be addressed in future research.

[1]  Ulrich Bauer,et al.  Generating parametric models of tubes from laser scans , 2009, Comput. Aided Des..

[2]  George Vosselman,et al.  EXTRACTING WINDOWS FROM TERRESTRIAL LASER SCANNING , 2007 .

[3]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[4]  Martin Buss,et al.  Comparison of surface normal estimation methods for range sensing applications , 2009, 2009 IEEE International Conference on Robotics and Automation.

[5]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[6]  Barr,et al.  Superquadrics and Angle-Preserving Transformations , 1981, IEEE Computer Graphics and Applications.

[7]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[8]  Livio De Luca,et al.  Reverse engineering of architectural buildings based on a hybrid modeling approach , 2006, Comput. Graph..

[9]  F. Rottensteiner SEMI-AUTOMATIC BUILDING RECONSTRUCTION INTEGRATED IN STRICT BUNDLE BLOCK ADJUSTMENT , 2000 .

[10]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[11]  Xiaokun Li,et al.  On surface reconstruction: A priority driven approach , 2009, Comput. Aided Des..

[12]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[13]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[14]  Zheng Qin,et al.  Stratified helix information of medial-axis-points matching for 3D model retrieval , 2007, MIR '07.

[15]  Suya You,et al.  Urban Site Modeling from LiDAR , 2003, ICCSA.

[16]  Mi-Suen Lee,et al.  A Computational Framework for Segmentation and Grouping , 2000 .

[17]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Martial Hebert,et al.  Rapid object indexing using locality sensitive hashing and joint 3D-signature space estimation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Amr A. Oloufa,et al.  Algorithms for automated deduction of topological information , 2005 .

[20]  Karl-Heinz Häfele,et al.  Curvature estimation for segmentation of triangulated surfaces , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[21]  Mohammed Bennamoun,et al.  A Novel Representation and Feature Matching Algorithm for Automatic Pairwise Registration of Range Images , 2005, International Journal of Computer Vision.

[22]  Alfons Kemper,et al.  An analysis of geometric modeling in database systems , 1987, CSUR.

[23]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[24]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[25]  Ramakant Nevatia,et al.  Recognizing 3-D Objects Using Surface Descriptions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Avinash C. Kak,et al.  Fast vision-guided mobile robot navigation using model-based reasoning and prediction of uncertainties , 1992, CVGIP Image Underst..

[27]  James V. Miller,et al.  MUSE: robust surface fitting using unbiased scale estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Robert B. Fisher,et al.  Experiments in Curvature-Based Segmentation of Range Data , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Burcu Akinci,et al.  The ASDMCon Project: The Challenge of Detecting Defects on Construction Sites , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[31]  Chandra Kambhamettu,et al.  Extending superquadrics with exponent functions: modeling and reconstruction , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[32]  Wei-Chung Lin,et al.  CSG-based object recognition using range images , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[33]  Burcin Becerik-Gerber,et al.  A Research Outlook for Real-Time Project Information Management by Integrating Advanced Field Data Acquisition Systems and Building Information Modeling , 2009 .

[34]  Rudolf Staiger 10 years of terrestrial Laser Scanning technology, systems and applications , 2011 .

[35]  Ramesh C. Jain,et al.  Invariant surface characteristics for 3D object recognition in range images , 1985, Comput. Vis. Graph. Image Process..

[36]  Martin D. Levine,et al.  Recovering parametric geons from multiview range data , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Patrick J. Flynn,et al.  A Survey Of Free-Form Object Representation and Recognition Techniques , 2001, Comput. Vis. Image Underst..

[38]  Sunghee Choi,et al.  The power crust , 2001, SMA '01.

[39]  Tony DeRose,et al.  Piecewise smooth surface reconstruction , 1994, SIGGRAPH.

[40]  Andrew W. Fitzgibbon,et al.  High-level model acquisition from range images , 1997, Comput. Aided Des..

[41]  Ellen Gail Lowenfeld Walker Frame-based geometric reasoning for construction and maintenance of three-dimensional world models , 1989 .

[42]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[43]  Martial Hebert,et al.  Parts-based 3D object classification , 2004, CVPR 2004.

[44]  Chin Seng Chua,et al.  Point Signatures: A New Representation for 3D Object Recognition , 1997, International Journal of Computer Vision.

[45]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[46]  Vivek Verma,et al.  3D Building Detection and Modeling from Aerial LIDAR Data , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[47]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[48]  Toby Howard,et al.  A hybrid approach to the recovery of deformable superquadric models from 3D data , 2001, Proceedings. Computer Graphics International 2001.

[49]  Petko Faber,et al.  How can we exploit typical architectural structures to improve model recovery? , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[50]  Sylvain Petitjean,et al.  A survey of methods for recovering quadrics in triangle meshes , 2002, CSUR.

[51]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[53]  Helmut Cantzler,et al.  Improving architectural 3D reconstruction by constrained modelling , 2003 .

[54]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[55]  Jean-Pierre Kruth,et al.  Nurbs curve and surface fitting and interpolation , 1995 .

[56]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[57]  Vadim Shapiro,et al.  Construction and optimization of CSG representations , 1991, Comput. Aided Des..

[58]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[59]  Franc Solina,et al.  Superquadrics for Segmenting and Modeling Range Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Ernst Rank,et al.  Specification and implementation of directional operators in a 3D spatial query language for building information models , 2009, Adv. Eng. Informatics.

[61]  Kourosh Khoshelham Building extraction from multiple data sources : a data fusion framework for reconstruction of generic models , 2004 .

[62]  Wolfram Burgard,et al.  A real-time expectation-maximization algorithm for acquiring multiplanar maps of indoor environments with mobile robots , 2004, IEEE Transactions on Robotics and Automation.

[63]  Hans-Gerd Maas,et al.  3D BUILDING MODEL GENERATION FROM AIRBORNE LASER SCANNER DATA USING 2D GIS DATA AND ORTHOGONAL POINT CLOUD PROJECTIONS , 2005 .

[64]  Linda G. Shapiro,et al.  Symbolic signatures for deformable shapes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  F. Tarsha-Kurdi,et al.  Hough-Transform and Extended RANSAC Algorithms for Automatic Detection of 3D Building Roof Planes from Lidar Data , 2007 .

[66]  Frédéric Bosché,et al.  Automated retrieval of 3D CAD model objects in construction range images , 2008 .

[67]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[68]  P. Besl Surfaces in early range image understanding , 1986 .

[69]  Berthold K. P. Horn,et al.  The Mechanical Manipulation of Randomly Oriented Parts , 1984 .

[70]  Martial Hebert,et al.  Scale selection for classification of point-sampled 3D surfaces , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[71]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[72]  Sheryl Staub-French,et al.  Deriving construction features from an IFC model , 2008 .

[73]  Norbert Haala,et al.  Model refinement by integrated processing of laser scanning and photogrammetry , 2007 .

[74]  Gene H. Golub,et al.  An analysis of the total least squares problem , 1980, Milestones in Matrix Computation.

[75]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[76]  Robert B. Fisher Solving architectural modelling problems using knowledge , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[77]  François Goulette,et al.  Automatic CAD modeling of industrial pipes from range images , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[78]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[79]  Daniel Hernández,et al.  Qualitative Representation of Spatial Knowledge , 1994, Lecture Notes in Computer Science.

[80]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[81]  Bruce G. Baumgart Winged edge polyhedron representation. , 1972 .

[82]  Darwin T. Kuan,et al.  Model-Based Interpretation of Range Imagery , 1983, AAAI.

[83]  Avinash C. Kak,et al.  Fast Vision-guided Mobile Robot Navigation Using Model-based Reasoning And Prediction Of Uncertainties , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[84]  Martial Hebert,et al.  A system for semi-automatic modeling of complex environments , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[85]  Mohammed Bennamoun,et al.  Automatic Correspondence for 3d Modeling: an Extensive Review , 2005, Int. J. Shape Model..

[86]  Szymon Rusinkiewicz,et al.  Estimating curvatures and their derivatives on triangle meshes , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[87]  Matthias Eck,et al.  Automatic reconstruction of B-spline surfaces of arbitrary topological type , 1996, SIGGRAPH.

[88]  George Vosselman,et al.  Reconstruction of 3D building models from aerial images and maps , 2003 .

[89]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[90]  J. Kruth,et al.  NURBS curve and surface fitting for reverse engineering , 1998 .

[91]  Sunghee Choi,et al.  The power crust, unions of balls, and the medial axis transform , 2001, Comput. Geom..

[92]  In-Kwon Lee,et al.  Curve reconstruction from unorganized points , 2000, Comput. Aided Geom. Des..

[93]  Ioannis Stamos,et al.  3D Modeling Using Planar Segments and Mesh Elements , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).