Toward Building and Civil Infrastructure Reconstruction From Point Clouds: A Review on Data and Key Techniques

Nowadays, point clouds acquired through laser scanning and stereo matching have deemed to be one of the best sources for mapping urban scenes. Spatial coordinates of 3-D points directly reflect the geometry of object surfaces, which significantly streamlining the 3-D reconstruction and modeling of objects. The construction industry has utilized point clouds in various tasks, including but not limited to, building reconstruction, field inspection, and construction progress tracking. However, it is mandatory to generate a high-level (i.e., geometrically accurate, semantically rich, and simply described) representation of 3-D objects from those 3-D measurements (i.e., points), so that the acquired information can be fully utilized. The reconstruction of 3-D objects in a scene of man-made infrastructure and buildings is one of the core tasks using point clouds, which involves both the 3-D data acquisition and processing. There are few systematic reviews summarizing the ways of acquiring 3-D points and the techniques for reconstructing 3-D objects from point clouds for application scenarios in a built environment or construction site. This article therefore intends to provide a thorough review of the state-of-the-art acquisition and processing techniques for building reconstruction using point clouds. It places particular focus on data acquisition and on the strengths and weaknesses of key processing techniques. This review work will discuss the limitations of current data acquisition and processing techniques, as well as the current research gap, ultimately providing recommendations on future research directions in order to fulfill the pressing needs of the intended construction applications in the foreseeable future.

[1]  Siyuan Chen,et al.  UAV Bridge Inspection through Evaluated 3D Reconstructions , 2019, Journal of Bridge Engineering.

[2]  Maarten Vergauwen,et al.  Comparison of 2D and 3D wall reconstruction algorithms from point cloud data for as-built BIM , 2020, J. Inf. Technol. Constr..

[3]  Frédéric Bosché,et al.  Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction , 2010, Adv. Eng. Informatics.

[4]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2011 .

[5]  Jian Liang,et al.  Point Cloud Segmentation and Denoising via Constrained Nonlinear Least Squares Normal Estimates , 2013, Innovations for Shape Analysis, Models and Algorithms.

[6]  Junhao Xiao,et al.  Planar Segment Based Three‐dimensional Point Cloud Registration in Outdoor Environments , 2013, J. Field Robotics.

[7]  Yuri Boykov,et al.  Energy-Based Geometric Multi-model Fitting , 2012, International Journal of Computer Vision.

[8]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[9]  Avideh Zakhor,et al.  Tree Detection in Aerial Lidar and Image Data , 2006, 2006 International Conference on Image Processing.

[10]  Naoto Yokoya,et al.  Learning to propagate labels on graphs: An iterative multitask regression framework for semi-supervised hyperspectral dimensionality reduction , 2019, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[11]  Jihua Zhu,et al.  Efficient registration of multi-view point sets by K-means clustering , 2019, Inf. Sci..

[12]  Max Q.-H. Meng,et al.  Joint Rigid Registration of Multiple Generalized Point Sets With Hybrid Mixture Models , 2020, IEEE Transactions on Automation Science and Engineering.

[13]  Claus Brenner,et al.  Coarse orientation of terrestrial laser scans in urban environments , 2008 .

[14]  Giorgio Grisetti,et al.  NICP: Dense normal based point cloud registration , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Lianru Gao,et al.  Graph Convolutional Networks for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Yusheng Xu,et al.  Reconstruction of scaffolds from a photogrammetric point cloud of construction sites using a novel 3D local feature descriptor , 2018 .

[17]  Clive S. Fraser,et al.  RULE-BASED SEGMENTATION OF LIDAR POINT CLOUD FOR AUTOMATIC EXTRACTION OF BUILDING ROOF PLANES , 2013 .

[18]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Bisheng Yang,et al.  A shape-based segmentation method for mobile laser scanning point clouds , 2013 .

[20]  Nico Blodow,et al.  Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Thomas H. Kolbe,et al.  Representing and Exchanging 3D City Models with CityGML , 2009 .

[22]  J. Shan,et al.  A global optimization approach to roof segmentation from airborne lidar point clouds , 2014 .

[23]  Fabio Remondino,et al.  A REVIEW OFPOINT CLOUDS SEGMENTATION AND CLASSIFICATION ALGORITHMS , 2017 .

[24]  Jan Dirk Wegner,et al.  Contour Detection in Unstructured 3D Point Clouds , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Carl T. Haas,et al.  Comparison of Methods Used for Detecting Unknown Structural Elements in Three-dimensional Point Clouds , 2014 .

[26]  Uwe Stilla,et al.  WINDOW DETECTION IN SPARSE POINT CLOUDS USING INDOOR POINTS , 2013, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[27]  Jaehoon Jung,et al.  Productive modeling for development of as-built BIM of existing indoor structures , 2014 .

[28]  Martin Simonovsky,et al.  Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Sven Oesau,et al.  Indoor scene reconstruction using feature sensitive primitive extraction and graph-cut , 2014 .

[30]  Yusheng Xu,et al.  Unsupervised Segmentation of Point Clouds From Buildings Using Hierarchical Clustering Based on Gestalt Principles , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[33]  Burcu Akinci,et al.  Automatic Reconstruction of As-Built Building Information Models from Laser-Scanned Point Clouds: A Review of Related Techniques | NIST , 2010 .

[34]  Hyojoo Son,et al.  3D structural component recognition and modeling method using color and 3D data for construction progress monitoring , 2010 .

[35]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[36]  W. R. Green,et al.  Normal distribution transform graph-based point cloud segmentation , 2015, 2015 Pattern Recognition Association of South Africa and Robotics and Mechatronics International Conference (PRASA-RobMech).

[37]  Hanns-F. Schuster SEGMENTATION OF LIDAR DATA USING THE TENSOR VOTING FRAMEWORK , 2004 .

[38]  Hermann Gross,et al.  LINE-BASED REGISTRATION OF TERRESTRIAL AND AIRBORNE LIDAR DATA , 2008 .

[39]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[40]  N. Pfeifer,et al.  SEGMENTATION BASED ROBUST INTERPOLATION - A NEW APPROACH TO LASER DATA FILTERING , 2005 .

[41]  Claus Brenner,et al.  Registration of terrestrial laser scanning data using planar patches and image data , 2006 .

[42]  Zoltan-Csaba Marton,et al.  Tutorial: Point Cloud Library: Three-Dimensional Object Recognition and 6 DOF Pose Estimation , 2012, IEEE Robotics & Automation Magazine.

[43]  David Suter,et al.  3D terrestrial LIDAR classifications with super-voxels and multi-scale Conditional Random Fields , 2009, Comput. Aided Des..

[44]  Xianfeng Huang,et al.  A Methodology for Automated Segmentation and Reconstruction of Urban 3-D Buildings from ALS Point Clouds , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  K. Bang,et al.  A COMPARATIVE ANALYSIS OF TWO APPROACHES FOR MULTIPLE-SURFACE REGISTRATION OF IRREGULAR POINT CLOUDS , 2010 .

[46]  S. J. Oude Elberink,et al.  A graph edit dictionary for correcting errors in roof topology graphs reconstructed from point clouds , 2014 .

[47]  Ji Wan,et al.  Multi-view 3D Object Detection Network for Autonomous Driving , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Niloy J. Mitra,et al.  Super4PCS: Fast Global Pointcloud Registration via Smart Indexing , 2019 .

[49]  Pengcheng Wei,et al.  An Efficient Encoding Voxel-Based Segmentation (EVBS) Algorithm Based on Fast Adjacent Voxel Search for Point Cloud Plane Segmentation , 2019, Remote. Sens..

[50]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Naoto Yokoya,et al.  X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing data , 2020, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[52]  Susanne Becker,et al.  Automatic Marker-Free Registration of Terrestrial Laser Scans using Reflectance Features , 2007 .

[53]  Konrad Schindler,et al.  Keypoint-based 4-Points Congruent Sets – Automated marker-less registration of laser scans , 2014 .

[54]  Lin Cao,et al.  Marker-free coregistration of UAV and backpack LiDAR point clouds in forested areas , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[55]  David P. Helmbold,et al.  Aerial LiDAR Data Classification Using Support Vector Machines (SVM) , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[56]  Ayman Habib,et al.  RANSAC approach for automated registration of terrestrial laser scans using linear features , 2013 .

[57]  Frank Schultmann,et al.  Building Information Modeling (BIM) for existing buildings — Literature review and future needs , 2014 .

[58]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Debra F. Laefer,et al.  Combining an Angle Criterion with Voxelization and the Flying Voxel Method in Reconstructing Building Models from LiDAR Data , 2013, Comput. Aided Civ. Infrastructure Eng..

[60]  Carl T. Haas,et al.  State of research in automatic as-built modelling , 2015, Adv. Eng. Informatics.

[61]  Qian Wang,et al.  Automated quality assessment of precast concrete elements with geometry irregularities using terrestrial laser scanning , 2016 .

[62]  Boris Jutzi,et al.  Semantic 3D scene interpretation: A framework combining optimal neighborhood size selection with relevant features , 2014 .

[63]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[64]  Chih-Chen Chang,et al.  Automated dimensional quality assurance of full-scale precast concrete elements using laser scanning and BIM , 2016 .

[65]  Yusheng Xu,et al.  Pairwise coarse registration of point clouds in urban scenes using voxel-based 4-planes congruent sets , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[66]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.

[67]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[68]  Debra F. Laefer,et al.  Slicing Method for curved façade and window extraction from point clouds , 2016 .

[69]  Samia Boukir,et al.  Relevance of airborne lidar and multispectral image data for urban scene classification using Random Forests , 2011 .

[70]  Florentin Wörgötter,et al.  Voxel Cloud Connectivity Segmentation - Supervoxels for Point Clouds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[71]  Loic Landrieu,et al.  WEAKLY SUPERVISED SEGMENTATION-AIDED CLASSIFICATION OF URBAN SCENES FROM 3D LIDAR POINT CLOUDS , 2017 .

[72]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[73]  Rong Huang,et al.  RIDF: A ROBUST ROTATION-INVARIANT DESCRIPTOR FOR 3D POINT CLOUD REGISTRATION IN THE FREQUENCY DOMAIN , 2020 .

[74]  Florent Lafarge,et al.  Building large urban environments from unstructured point data , 2011, 2011 International Conference on Computer Vision.

[75]  T. Rabbani,et al.  SEGMENTATION OF POINT CLOUDS USING SMOOTHNESS CONSTRAINT , 2006 .

[76]  Florentin Wörgötter,et al.  Object Partitioning Using Local Convexity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[77]  Lixin Fan,et al.  Urban 3D segmentation and modelling from street view images and LiDAR point clouds , 2017, Machine Vision and Applications.

[78]  Wei Huang,et al.  A Convolutional Neural Network-Based 3D Semantic Labeling Method for ALS Point Clouds , 2017, Remote. Sens..

[79]  Wei Yao,et al.  Semantic labelling of ultra dense MLS point clouds in urban road corridors based on fusing CRF with shape priors , 2017 .

[80]  Ralph R. Martin,et al.  Robust Segmentation of Primitives from Range Data in the Presence of Geometric Degeneracy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[81]  Chao Wang,et al.  Automatic BIM component extraction from point clouds of existing buildings for sustainability applications , 2015 .

[82]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[83]  Nico Blodow,et al.  Model-based and learned semantic object labeling in 3D point cloud maps of kitchen environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[84]  Hongbin Zha,et al.  Automatic registration of range images based on correspondence of complete plane patches , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[85]  Konrad Schindler,et al.  AUTOMATIC REGISTRATION OF TERRESTRIAL LASER SCANNER POINT CLOUDS USING NATURAL PLANAR SURFACES , 2012 .

[86]  Xiangyu Wang,et al.  Integrating BIM and LiDAR for Real-Time Construction Quality Control , 2015, J. Intell. Robotic Syst..

[87]  Ioannis Stamos,et al.  Automated feature-based range registration of urban scenes of large scale , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[88]  C. Mallet,et al.  A structured regularization framework for spatially smoothing semantic labelings of 3D point clouds , 2017 .

[89]  Uwe Stilla,et al.  Object extraction based on 3D-segmentation of LiDAR data by combining mean shift with normalized cuts: Two examples from urban areas , 2009, 2009 Joint Urban Remote Sensing Event.

[90]  Charalambos Poullis,et al.  A Framework for Automatic Modeling from Point Cloud Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[91]  Junhao Xiao,et al.  3D point cloud registration based on planar surfaces , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[92]  Xinchang Zhang,et al.  Geometric Primitives in LiDAR Point Clouds: A Review , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[93]  Jianping Wu,et al.  A Voxel-Based Method for Automated Identification and Morphological Parameters Estimation of Individual Street Trees from Mobile Laser Scanning Data , 2013, Remote. Sens..

[94]  Higinio González-Jorge,et al.  4-Plane congruent sets for automatic registration of as-is 3D point clouds with 3D BIM models , 2018 .

[95]  André Borrmann,et al.  Combining inverse photogrammetry and BIM for automated labeling of construction site images for machine learning , 2019, Automation in Construction.

[96]  Michela Bertolotto,et al.  Octree-based region growing for point cloud segmentation , 2015 .

[97]  Uwe Stilla,et al.  CONTOUR EXTRACTION OF PLANAR ELEMENTS OF BUILDING FACADES FROM POINT CLOUDS USING GLOBAL GRAPH-BASED CLUSTERING , 2019 .

[98]  Pedro Arias,et al.  Transfer Learning in urban object classification: Online images to recognize point clouds , 2020 .

[99]  Ben Gorte,et al.  Automatic Building Outline Extraction from ALS Point Clouds by Ordered Points Aided Hough Transform , 2019, Remote. Sens..

[100]  Nikos Komodakis,et al.  Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[101]  Uwe Stilla,et al.  Detection of fallen trees in ALS point clouds using a Normalized Cut approach trained by simulation , 2015 .

[102]  Bisheng Yang,et al.  Semi-automated extraction and delineation of 3D roads of street scene from mobile laser scanning point clouds , 2013 .

[103]  Youichi Nonaka,et al.  Recognition of complex engineering objects from large-scale point clouds , 2015 .

[104]  Mohammed Bennamoun,et al.  Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[105]  Zhen Wang,et al.  A Multiscale and Hierarchical Feature Extraction Method for Terrestrial Laser Scanning Point Cloud Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[106]  Harith T. Al-Jumaily,et al.  Urban Point Cloud Mining Based on Density Clustering and MapReduce , 2017, J. Comput. Civ. Eng..

[107]  Hao Xu,et al.  Registration of Laser Scanning Point Clouds: A Review , 2018, Sensors.

[108]  Jonathan Li,et al.  Pairwise registration of TLS point clouds using covariance descriptors and a non-cooperative game , 2017 .

[109]  Mohammed Bennamoun,et al.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[110]  Tat-Jun Chin,et al.  Efficient Point Process Inference for Large-Scale Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[111]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[112]  M. Bassier,et al.  IFCWALL RECONSTRUCTION FROM UNSTRUCTURED POINT CLOUDS , 2018 .

[113]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[114]  André Borrmann,et al.  Formwork detection in UAV pictures of construction sites , 2018 .

[115]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[116]  Yong-Jin Liu,et al.  Cylinder Detection in Large-Scale Point Cloud of Pipeline Plant , 2013, IEEE Transactions on Visualization and Computer Graphics.

[117]  Ulrich Neumann,et al.  Complete residential urban area reconstruction from dense aerial LiDAR point clouds , 2013, Graph. Model..

[118]  Fernanda Leite,et al.  Evaluation of accuracy of as-built 3D modeling from photos taken by handheld digital cameras , 2012 .

[119]  Y. Tseng,et al.  Incremental segmentation of lidar point clouds with an octree‐structured voxel space , 2011 .

[120]  Rong Huang,et al.  Robust global registration of point clouds by closed-form solution in the frequency domain , 2021 .

[121]  Brian Okorn,et al.  Methods for Automatically Modeling and Representing As-built Building Information Models , 2011 .

[122]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[123]  Xiaoxiang Zhu,et al.  Robust Reconstruction of Building Facades for Large Areas Using Spaceborne TomoSAR Point Clouds , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[124]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[125]  Lin Wang,et al.  Local to global registration of multi-view range scans using spanning tree , 2017, Comput. Electr. Eng..

[126]  B. Jutzi,et al.  NEAREST NEIGHBOUR CLASSIFICATION ON LASER POINT CLOUDS TO GAIN OBJECT STRUCTURES FROM BUILDINGS , 2009 .

[127]  Ian D. Reid,et al.  Geometrically consistent plane extraction for dense indoor 3D maps segmentation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[128]  Ioannis Stamos,et al.  Detection of windows in point clouds of urban scenes , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[129]  Michael Hahn,et al.  Large-Scale Accurate Reconstruction of Buildings Employing Point Clouds Generated from UAV Imagery , 2018, Remote. Sens..

[130]  Rama Rao Nidamanuri,et al.  A supervoxel-based spectro-spatial approach for 3D urban point cloud labelling , 2016 .

[131]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .

[132]  Aleksandr V. Segal,et al.  Generalized-ICP , 2009, Robotics: Science and Systems.

[133]  Kourosh Khoshelham,et al.  Automated localization of a laser scanner in indoor environments using planar objects , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[134]  Norbert Pfeifer,et al.  A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[135]  Leonidas J. Guibas,et al.  Frustum PointNets for 3D Object Detection from RGB-D Data , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[136]  Changmin Kim,et al.  Skeleton-based 3D reconstruction of as-built pipelines from laser-scan data , 2013 .

[137]  Dong Chen,et al.  Modeling Indoor Spaces Using Decomposition and Reconstruction of Structural Elements , 2017 .

[138]  Changmin Kim,et al.  3D reconstruction of as-built industrial instrumentation models from laser-scan data and a 3D CAD database based on prior knowledge , 2015 .

[139]  Frédéric Bosché,et al.  Automated progress tracking using 4D schedule and 3D sensing technologies , 2012 .

[140]  Martin Kada,et al.  Scale-Dependent Simplification of 3D Building Models Based on Cell Decomposition and Primitive Instancing , 2007, COSIT.

[141]  Hartmut Prautzsch,et al.  Local Versus Global Triangulations , 2001, Eurographics.

[142]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[143]  Wen Hao,et al.  Structure-based object detection from scene point clouds , 2016, Neurocomputing.

[144]  Franz Rottensteiner,et al.  Modelling of buildings from aerial LiDAR point clouds using TINs and label maps , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[145]  C. Mallet,et al.  AIRBORNE LIDAR FEATURE SELECTION FOR URBAN CLASSIFICATION USING RANDOM FORESTS , 2009 .

[146]  Ping Guo,et al.  Energy-Based Multi-plane Detection from 3D Point Clouds , 2016, ICONIP.

[147]  Marc Pollefeys,et al.  Joint 3D Scene Reconstruction and Class Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[148]  Pedro Arias,et al.  Automatic 3D modelling of metal frame connections from LiDAR data for structural engineering purposes , 2014 .

[149]  Rogério Schmidt Feris,et al.  Fine registration of 3D point clouds with iterative closest point using an RGB-D camera , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[150]  N. Pfeifer,et al.  Neighborhood systems for airborne laser data , 2005 .

[151]  Michael Greenspan,et al.  Super Generalized 4PCS for 3D Registration , 2015, 2015 International Conference on 3D Vision.

[152]  Frédéric Bosché,et al.  Plane-based registration of construction laser scans with 3D/4D building models , 2012, Adv. Eng. Informatics.

[153]  Konrad Schindler,et al.  FAST SEMANTIC SEGMENTATION OF 3D POINT CLOUDS WITH STRONGLY VARYING DENSITY , 2016 .

[154]  Stefan Hinz,et al.  Fast and automatic image-based registration of TLS data , 2011 .

[155]  Xiaoxiang Zhu,et al.  Facade Reconstruction Using Multiview Spaceborne TomoSAR Point Clouds , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[156]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[157]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[158]  Uwe Stilla,et al.  DIRECT CO-REGISTRATION OF TIR IMAGES AND MLS POINT CLOUDS BY CORRESPONDING KEYPOINTS , 2019 .

[159]  Hui Lin,et al.  Semantic decomposition and reconstruction of residential scenes from LiDAR data , 2013, ACM Trans. Graph..

[160]  Liqiang Zhang,et al.  Large-scale urban point cloud labeling and reconstruction , 2018 .

[161]  G. Toussaint Solving geometric problems with the rotating calipers , 1983 .

[162]  Hui Huang,et al.  Data-driven contextual modeling for 3D scene understanding , 2016, Comput. Graph..

[163]  Rong Huang,et al.  Temporal comparison of construction sites using photogrammetric point cloud sequences and robust phase correlation , 2020 .

[164]  Uwe Stilla,et al.  Automatic vehicle extraction from airborne LiDAR data of urban areas aided by geodesic morphology , 2010, Pattern Recognit. Lett..

[165]  Li Li,et al.  PAIRWISE LINKAGE FOR POINT CLOUD SEGMENTATION , 2016 .

[166]  Martin Fischer,et al.  UAV-Enabled Site-to-BIM Automation: Aerial Robotic- and Computer Vision-Based Development of As-Built/As-Is BIMs and Quality Control , 2018 .

[167]  Michael Greenspan,et al.  Generalized 4-Points Congruent Sets for 3D Registration , 2014, 2014 2nd International Conference on 3D Vision.

[168]  Derek D. Lichti,et al.  A method for automated registration of unorganised point clouds , 2008 .

[169]  G. Sithole,et al.  Recognising structure in laser scanning point clouds , 2004 .

[170]  Shaohui Sun,et al.  Aerial 3D Building Detection and Modeling From Airborne LiDAR Point Clouds , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[171]  Mohannad Al-Durgham,et al.  A Framework for the Registration and Segmentation of Heterogeneous Lidar Data , 2013 .

[172]  Quan Li,et al.  Automatic Registration of Terrestrial and Airborne Point Clouds Using Building Outline Features , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[173]  Uwe Stilla,et al.  ADABOOST-BASED FEATURE RELEVANCE ASSESSMENT IN FUSING LIDAR AND IMAGE DATA FOR CLASSIFICATION OF TREES AND VEHICLES IN URBAN SCENES , 2012 .

[174]  Bisheng Yang,et al.  Automatic registration of large-scale urban scene point clouds based on semantic feature points , 2016 .

[175]  Uwe Stilla,et al.  Segmentation of 3D outdoor scenes using hierarchical clustering structure and perceptual grouping laws , 2016, 2016 9th IAPR Workshop on Pattern Recogniton in Remote Sensing (PRRS).

[176]  Bisheng Yang,et al.  An efficient global energy optimization approach for robust 3D plane segmentation of point clouds , 2018 .

[177]  U. Stilla,et al.  EFFICIENT ESTIMATION OF 3D SHIFTS BETWEEN POINT CLOUDS USING LOW-FREQUENCY COMPONENTS OF PHASE CORRELATION , 2020 .

[178]  Reinhard Klein,et al.  Automatic reconstruction of parametric building models from indoor point clouds , 2016, Comput. Graph..

[179]  Kok-Lim Low Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration , 2004 .

[180]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[181]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[182]  David Belton,et al.  Comparative Study of Automatic Plane Fitting Registration for Mls Sparse Point Clouds with Different Plane Segmentation Methods , 2017 .

[183]  C. Brenner,et al.  A generative statistical approach to automatic 3D building roof reconstruction from laser scanning data , 2013 .

[184]  Wei Song,et al.  Deep learning-based roadway crack classification using laser-scanned range images: A comparative study on hyperparameter selection , 2020, Automation in Construction.

[185]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[186]  Mattia Previtali,et al.  Indoor Building Reconstruction from Occluded Point Clouds Using Graph-Cut and Ray-Tracing , 2018 .

[187]  Henrique Lorenzo,et al.  Automatic point cloud coarse registration using geometric keypoint descriptors for indoor scenes , 2017 .

[188]  Ahmad Kamal Aijazi,et al.  Segmentation Based Classification of 3D Urban Point Clouds: A Super-Voxel Based Approach with Evaluation , 2013, Remote. Sens..

[189]  Uwe Stilla,et al.  VOXEL- AND GRAPH-BASED POINT CLOUD SEGMENTATION OF 3D SCENES USING PERCEPTUAL GROUPING LAWS , 2017 .

[190]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[191]  Uwe Stilla,et al.  Acquisition and Consecutive Registration of Photogrammetric Point Clouds for Construction Progress Monitoring Using a 4D BIM , 2017, PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science.

[192]  Abdul Nurunnabi,et al.  Robust segmentation for multiple planar surface extraction in laser scanning 3D point cloud data , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[193]  Hao Liu,et al.  A hierarchical methodology for urban facade parsing from TLS point clouds , 2017 .

[194]  Derek D. Lichti,et al.  Robust Segmentation of Planar and Linear Features of Terrestrial Laser Scanner Point Clouds Acquired from Construction Sites , 2018, Sensors.

[195]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[196]  Thomas A. Funkhouser,et al.  Min-cut based segmentation of point clouds , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[197]  M. Menenti,et al.  COARSE POINT CLOUD REGISTRATION BY EGI MATCHING OF VOXEL CLUSTERS , 2016 .

[198]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[199]  Ahmad Kamal Aijazi,et al.  Super-Voxel Based Segmentation and Classification of 3D Urban Landscapes with Evaluation and Comparison , 2012, FSR.

[200]  Takeo Kanade,et al.  A Correlation-Based Approach to Robust Point Set Registration , 2004, ECCV.

[201]  F. Tarsha-Kurdi,et al.  Hough-Transform and Extended RANSAC Algorithms for Automatic Detection of 3D Building Roof Planes from Lidar Data , 2007 .

[202]  Uwe Stilla,et al.  CLASSIFICATION OF MLS POINT CLOUDS IN URBAN SCENES USING DETRENDED GEOMETRIC FEATURES FROM SUPERVOXEL-BASED LOCAL CONTEXTS , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[203]  M. Kada,et al.  Feature-Driven 3D Building Modeling using Planar Halfspaces , 2013 .

[204]  R. Brumana,et al.  Generative HBIM modelling to embody complexity (LOD, LOG, LOA, LOI): surveying, preservation, site intervention—the Basilica di Collemaggio (L’Aquila) , 2018, Applied Geomatics.

[205]  Dong Chen,et al.  LiDAR Point Clouds to 3-D Urban Models$:$ A Review , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[206]  Bisheng Yang,et al.  Automated registration of dense terrestrial laser-scanning point clouds using curves , 2014 .

[207]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[208]  Yusheng Xu,et al.  Voxel-based segmentation of 3D point clouds from construction sites using a probabilistic connectivity model , 2018, Pattern Recognit. Lett..

[209]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[210]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[211]  Bisheng Yang,et al.  Hierarchical extraction of urban objects from mobile laser scanning data , 2015 .

[212]  Wolfgang von Hansen ROBUST AUTOMATIC MARKER-FREE REGISTRATION OF TERRESTRIAL SCAN DATA , 2006 .

[213]  Jouko Lampinen,et al.  Object Classification and Recognition From Mobile Laser Scanning Point Clouds in a Road Environment , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[214]  Airong Chen,et al.  Three-Dimensional Reconstruction of Structural Surface Model of Heritage Bridges Using UAV-Based Photogrammetric Point Clouds , 2019, Remote. Sens..

[215]  Khalid M. Mosalam,et al.  Deep leaf‐bootstrapping generative adversarial network for structural image data augmentation , 2019, Comput. Aided Civ. Infrastructure Eng..

[216]  Majd Alshawa lCL: Iterative closest line A novel point cloud registration algorithm based on linear features , 2007 .

[217]  Debra F. Laefer,et al.  Toward automatic generation of 3D steel structures for building information modelling , 2017 .

[218]  Fei Su,et al.  Reconstruction of Three-Dimensional (3D) Indoor Interiors with Multiple Stories via Comprehensive Segmentation , 2018, Remote. Sens..

[219]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[220]  Liqiang Zhang,et al.  Urban building roof segmentation from airborne lidar point clouds , 2012 .

[221]  Xiao Xiang Zhu,et al.  A Review of Point Cloud Semantic Segmentation , 2019, ArXiv.

[222]  Peter Wonka,et al.  PolyFit: Polygonal Surface Reconstruction from Point Clouds , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[223]  Bisheng Yang,et al.  Hierarchical registration of unordered TLS point clouds based on binary shape context descriptor , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[224]  Neil Smith,et al.  Reconstructing building mass models from UAV images , 2016, Comput. Graph..

[225]  Fernanda Leite,et al.  Semantic segmentation of point clouds of building interiors with deep learning: Augmenting training datasets with synthetic BIM-based point clouds , 2020 .

[226]  Weihua Dong,et al.  Selection of LiDAR geometric features with adaptive neighborhood size for urban land cover classification , 2017, Int. J. Appl. Earth Obs. Geoinformation.

[227]  Tat-Jun Chin,et al.  Practical optimal registration of terrestrial LiDAR scan pairs , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[228]  Peter Wonka,et al.  PLADE: A Plane-Based Descriptor for Point Cloud Registration With Small Overlap , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[229]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[230]  Nadisson Luis Pavan,et al.  A Global Closed-Form Refinement for Consistent TLS Data Registration , 2017, IEEE Geoscience and Remote Sensing Letters.

[231]  Vladlen Koltun,et al.  Fast Global Registration , 2016, ECCV.

[232]  Jie Shan,et al.  Building roof modeling from airborne laser scanning data based on level set approach , 2011 .

[233]  Reinhard Klein,et al.  Automatic reconstruction of fully volumetric 3D building models from oriented point clouds , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[234]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[235]  Jaehoon Jung,et al.  Object Recognition, Segmentation, and Classification of Mobile Laser Scanning Point Clouds: A State of the Art Review , 2019, Sensors.

[236]  Anath Fischer,et al.  3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[237]  David P. Helmbold,et al.  Aerial Lidar Data Classification using AdaBoost , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[238]  George Vosselman,et al.  Contextual segment-based classification of airborne laser scanner data , 2017 .

[239]  Anthony Mandow,et al.  Voxel-Based Neighborhood for Spatial Shape Pattern Classification of Lidar Point Clouds with Supervised Learning , 2017, Sensors.

[240]  Qian Wang,et al.  Applications of 3D point cloud data in the construction industry: A fifteen-year review from 2004 to 2018 , 2019, Adv. Eng. Informatics.

[241]  Olaf Hellwich,et al.  Automatic registration of unordered point clouds acquired by Kinect sensors using an overlap heuristic , 2015 .

[242]  Cheng Wang,et al.  Semantic line framework-based indoor building modeling using backpacked laser scanning point cloud , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[243]  Jen-Jer Jaw,et al.  Registration of ground‐based LiDAR point clouds by means of 3D line features , 2008 .

[244]  Yu Liu,et al.  Automatic segmentation of unorganized noisy point clouds based on the Gaussian map , 2008, Comput. Aided Des..

[245]  Manolis I. A. Lourakis,et al.  Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges , 2015, Adv. Eng. Informatics.

[246]  Olaf Kähler,et al.  Efficient 3D Scene Labeling Using Fields of Trees , 2013, 2013 IEEE International Conference on Computer Vision.

[247]  Jie Shan,et al.  Segmentation and Reconstruction of Polyhedral Building Roofs From Aerial Lidar Point Clouds , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[248]  SuterDavid,et al.  3D terrestrial LIDAR classifications with super-voxels and multi-scale Conditional Random Fields , 2009 .

[249]  Avideh Zakhor,et al.  Planar 3D modeling of building interiors from point cloud data , 2012, 2012 19th IEEE International Conference on Image Processing.

[250]  Uwe Stilla,et al.  AUTOMATED COARSE REGISTRATION OF POINT CLOUDS IN 3D URBAN SCENESUSING VOXEL BASED PLANE CONSTRAINT , 2017 .

[251]  J. D. Wegner,et al.  Globally consistent registration of terrestrial laser scans via graph optimization , 2015 .

[252]  Shuowen Hu,et al.  Octree-based segmentation for terrestrial LiDAR point cloud data in industrial applications , 2016 .

[253]  David Zhang,et al.  A survey of graph theoretical approaches to image segmentation , 2013, Pattern Recognit..

[254]  George Vosselman,et al.  Airborne and terrestrial laser scanning , 2011, Int. J. Digit. Earth.

[255]  Silvio Savarese,et al.  3D Scene Understanding by Voxel-CRF , 2013, 2013 IEEE International Conference on Computer Vision.

[256]  Impyeong Lee,et al.  PERCEPTUAL ORGANIZATION OF 3D SURFACE POINTS , 2002 .