Robust normal estimation and region growing segmentation of infrastructure 3D point cloud models

Modern remote sensing technologies such as three-dimensional (3D) laser scanners and image-based 3D scene reconstruction are in increasing demand for applications in civil infrastructure design, maintenance, operation, and as-built construction verification. The complex nature of the 3D point clouds these technologies generate, as well as the often massive scale of the 3D data, make it inefficient and time consuming to manually analyze and manipulate point clouds, and highlights the need for automated analysis techniques. This paper presents one such technique, a new region growing algorithm for the automated segmentation of both planar and non-planar surfaces in point clouds. A core component of the algorithm is a new point normal estimation method, an essential task for many point cloud processing algorithms. The newly developed estimation method utilizes robust multivariate statistical outlier analysis for reliable normal estimation in complex 3D models, considering that these models often contain regions of varying surface roughness, a mixture of high curvature and low curvature regions, and sharp features. An adaptation of Mahalanobis distance, in which the mean vector and covariance matrix are derived from a high-breakdown multivariate location and scale estimator called Deterministic MM-estimator (DetMM) is used to find and discard outlier points prior to estimating the best local tangent plane around any point in a cloud. This approach is capable of more accurately estimating point normals located in highly curved regions or near sharp features. Thereafter, the estimated point normals serve a region growing segmentation algorithm that only requires a single input parameter, an improvement over existing methods which typically require two control parameters. The reliability and robustness of the normal estimation subroutine was compared against well-known normal estimation methods including the Minimum Volume Ellipsoid (MVE) and Minimum Covariance Determinant (MCD) estimators, along with Maximum Likelihood Sample Consensus (MLESAC). The overall region growing segmentation algorithm was then experimentally validated on several challenging 3D point clouds of real-world infrastructure systems. The results indicate that the developed approach performs more accurately and robustly in comparison with conventional region growing methods, particularly in the presence of sharp features, outliers and noise.

[1]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[2]  Changmin Kim,et al.  Fully Automated As-Built 3D Pipeline Extraction Method from Laser-Scanned Data Based on Curvature Computation , 2015, J. Comput. Civ. Eng..

[3]  Carl T. Haas,et al.  Pipe spool recognition in cluttered point clouds using a curvature-based shape descriptor , 2016 .

[4]  Mia Hubert,et al.  The DetS and DetMM estimators for multivariate location and scatter , 2015, Comput. Stat. Data Anal..

[5]  Abdul Nurunnabi,et al.  Robust Segmentation in Laser Scanning 3D Point Cloud Data , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[6]  F. Tarsha-Kurdi,et al.  Hough-Transform and Extended RANSAC Algorithms for Automatic Detection of 3D Building Roof Planes from Lidar Data , 2007 .

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Fengfeng Xi,et al.  A comparison study of algorithms for surface normal determination based on point cloud data , 2015 .

[9]  Changmin Kim,et al.  3D reconstruction of as-built industrial instrumentation models from laser-scan data and a 3D CAD database based on prior knowledge , 2015 .

[10]  Frédéric Bosché,et al.  As-built data acquisition and its use for production monitoring and automated layout in civil infrastructure: a survey , 2015 .

[11]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[12]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[14]  Jaehoon Jung,et al.  Automated 3D Wireframe Modeling of Indoor Structures from Point Clouds Using Constrained Least-Squares Adjustment for As-Built BIM , 2016, J. Comput. Civ. Eng..

[15]  Hendrik P. Lopuhaä Multivariate τ-Estimators for Location and Scatter@@@Multivariate t-Estimators for Location and Scatter , 1991 .

[16]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[17]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[18]  Martin Buss,et al.  Comparison of surface normal estimation methods for range sensing applications , 2009, 2009 IEEE International Conference on Robotics and Automation.

[19]  Alexandre Boulch,et al.  Fast and Robust Normal Estimation for Point Clouds with Sharp Features , 2012, Comput. Graph. Forum.

[20]  Pedro Arias,et al.  Algorithm for beam deformation modeling from LiDAR data , 2015 .

[21]  T. Rabbani,et al.  SEGMENTATION OF POINT CLOUDS USING SMOOTHNESS CONSTRAINT , 2006 .

[22]  Peter J. Rousseeuw,et al.  ROBUST REGRESSION BY MEANS OF S-ESTIMATORS , 1984 .

[23]  Carl T. Haas,et al.  Automatic Detection of Cylindrical Objects in Built Facilities , 2014, J. Comput. Civ. Eng..

[24]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[25]  Patricio A. Vela,et al.  A Sparsity‐Inducing Optimization‐Based Algorithm for Planar Patches Extraction from Noisy Point‐Cloud Data , 2015, Comput. Aided Civ. Infrastructure Eng..

[26]  Hans-Peter Seidel,et al.  Surface and normal ensembles for surface reconstruction , 2007, Comput. Aided Des..

[27]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[28]  Clive S. Fraser,et al.  An Automatic and Threshold-Free Performance Evaluation System for Building Extraction Techniques From Airborne LIDAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Burcu Akinci,et al.  Evaluation of Different Features for Matching Point Clouds to Building Information Models , 2016, J. Comput. Civ. Eng..

[30]  Tamal K. Dey,et al.  Eurographics Symposium on Point-based Graphics (2005) Normal Estimation for Point Clouds: a Comparison Study for a Voronoi Based Method , 2022 .

[31]  P. Rousseeuw,et al.  Alternatives to the Median Absolute Deviation , 1993 .

[32]  Andrey Dimitrov,et al.  Non‐Uniform B‐Spline Surface Fitting from Unordered 3D Point Clouds for As‐Built Modeling , 2016, Comput. Aided Civ. Infrastructure Eng..

[33]  P. Rousseeuw,et al.  Minimum volume ellipsoid , 2009 .

[34]  David E. Tyler,et al.  On the uniqueness of S-functionals and M-functionals under nonelliptical distributions , 2000 .

[35]  Hsi-Yung Feng,et al.  An adaptive normal estimation method for scanned point clouds with sharp features , 2013, Comput. Aided Des..

[36]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[37]  Carl T. Haas,et al.  State of research in automatic as-built modelling , 2015, Adv. Eng. Informatics.

[38]  Jerome F. Hajjar,et al.  Data Processing of Point Clouds for Object Detection for Structural Engineering Applications , 2013, Comput. Aided Civ. Infrastructure Eng..

[39]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[40]  Leonidas J. Guibas,et al.  Estimating surface normals in noisy point cloud data , 2004, Int. J. Comput. Geom. Appl..

[41]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[42]  Markus H. Gross,et al.  Efficient simplification of point-sampled surfaces , 2002, IEEE Visualization, 2002. VIS 2002..

[43]  José Luis Lerma,et al.  Unsupervised robust planar segmentation of terrestrial laser scanner point clouds based on fuzzy clustering methods , 2008 .

[44]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[45]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[46]  D. Lague,et al.  Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z) , 2013, 1302.1183.

[47]  A. Patil,et al.  An adaptive approach for the reconstruction and modeling of as-built 3D pipelines from point clouds , 2017 .

[48]  P. Rousseeuw,et al.  A fast algorithm for the minimum covariance determinant estimator , 1999 .

[49]  Victor J. Yohai,et al.  Robust and efficient estimation of multivariate scatter and location , 2017, Comput. Stat. Data Anal..

[50]  Ali Khaloo,et al.  Hierarchical Dense Structure-from-Motion Reconstructions for Infrastructure Condition Assessment , 2017, J. Comput. Civ. Eng..

[51]  S. Filin SURFACE CLUSTERING FROM AIRBORNE LASER SCANNING DATA , 2002 .

[52]  Bogdan Savchynskyy,et al.  Towards Globally Optimal Normal Orientations for Large Point Clouds , 2017, Comput. Graph. Forum.

[53]  V. Yohai HIGH BREAKDOWN-POINT AND HIGH EFFICIENCY ROBUST ESTIMATES FOR REGRESSION , 1987 .

[54]  Mani Golparvar-Fard,et al.  Segmentation of building point cloud models including detailed architectural/structural features and MEP systems , 2015 .

[55]  Mani Golparvar-Fard,et al.  Image-Based Automated 3D Crack Detection for Post-disaster Building Assessment , 2014, J. Comput. Civ. Eng..

[56]  Bahman Jafari,et al.  Tracking Structural Deformations via Automated Sample-Based Point Cloud Analysis , 2017 .

[57]  Sunglok Choi,et al.  Performance Evaluation of RANSAC Family , 2009, BMVC.

[58]  Jian Liang,et al.  Point Cloud Segmentation and Denoising via Constrained Nonlinear Least Squares Normal Estimates , 2013, Innovations for Shape Analysis, Models and Algorithms.

[59]  Bao Li,et al.  Robust normal estimation for point clouds with sharp features , 2010, Comput. Graph..