A Sparsity‐Inducing Optimization‐Based Algorithm for Planar Patches Extraction from Noisy Point‐Cloud Data

Currently, much of the manual labor needed to generate as-built building information models (BIMs) of existing facilities is spent converting raw point cloud data sets (PCDs) to BIM descriptions. Automating the PCD conversion process can drastically reduce the cost of generating as-built BIMs. Due to the widespread existence of planar structures in civil infrastructures, detecting and extracting planar patches from raw PCDs is a fundamental step in the conversion pipeline from PCDs to BIMs. However, existing methods cannot effectively address both automatically detecting and extracting planar patches from infrastructure PCDs. The existing methods cannot resolve the problem due to the large scale and model complexity of civil infrastructure, or due to the requirements of extra constraints or known information. To address the problem, this article presents a novel framework for automatically detecting and extracting planar patches from large-scale and noisy raw PCDs. The proposed method automatically detects planar structures, estimates the parametric plane models, and determines the boundaries of the planar patches. The first step recovers existing linear dependence relationships amongst points in the PCD by solving a group-sparsity inducing optimization problem. Next, a spectral clustering procedure based on the recovered linear dependence relationships segments the PCD. Then, for each segmented group, model parameters of the extracted planes are estimated via singular value decomposition (SVD) and maximum likelihood estimation sample consensus (MLESAC). Finally, the α-shape algorithm detects the boundaries of planar structures based on a projection of the data to the planar model. The proposed approach is evaluated comprehensively by experiments on two types of PCDs from real-world infrastructures, one captured directly by laser scanners and the other reconstructed from video using structure-from-motion techniques. To evaluate the performance comprehensively, five evaluation metrics are proposed which measure different aspects of performance. Experimental results reveal that the proposed method outperforms the existing methods, in the sense that the method automatically and accurately extracts planar patches from large-scaled raw PCDs without any extra constraints nor user assistance.

[1]  R. Chellappa Introduction of New Editor-in-Chief , 2005 .

[2]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[4]  Jerome F. Hajjar,et al.  Data Processing of Point Clouds for Object Detection for Structural Engineering Applications , 2013, Comput. Aided Civ. Infrastructure Eng..

[5]  Debra F. Laefer,et al.  Combining an Angle Criterion with Voxelization and the Flying Voxel Method in Reconstructing Building Models from LiDAR Data , 2013, Comput. Aided Civ. Infrastructure Eng..

[6]  Brian Okorn,et al.  Toward Automated Modeling of Floor Plans , 2010 .

[7]  Wolfram Burgard,et al.  Using Hierarchical EM to Extract Planes from 3D Range Scans , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Hans-Peter Kriegel,et al.  Subspace clustering , 2012, WIREs Data Mining Knowl. Discov..

[9]  Chunsun Zhang,et al.  An Unmanned Aerial Vehicle‐Based Imaging System for 3D Measurement of Unpaved Road Surface Distresses 1 , 2012, Comput. Aided Civ. Infrastructure Eng..

[10]  Gilad Lerman,et al.  Median K-Flats for hybrid linear modeling with many outliers , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[11]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[12]  Jan Boehm,et al.  Toward automatic reconstruction of interiors from laser data , 2009 .

[13]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[15]  S. Shankar Sastry,et al.  Generalized principal component analysis (GPCA) , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Takeo Kanade,et al.  A Multibody Factorization Method for Independently Moving Objects , 1998, International Journal of Computer Vision.

[17]  Wolfram Burgard,et al.  A real-time expectation-maximization algorithm for acquiring multiplanar maps of indoor environments with mobile robots , 2004, IEEE Transactions on Robotics and Automation.

[18]  F. Tarsha-Kurdi,et al.  Hough-Transform and Extended RANSAC Algorithms for Automatic Detection of 3D Building Roof Planes from Lidar Data , 2007 .

[19]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[20]  Ioannis Stamos,et al.  3-D model construction using range and image data , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  D. Donoho For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution , 2006 .

[22]  Brian Okorn,et al.  Methods for Automatically Modeling and Representing As-built Building Information Models , 2011 .

[23]  René Vidal,et al.  Motion segmentation via robust subspace separation in the presence of outlying, incomplete, or corrupted trajectories , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  James D. Goedert,et al.  Integrating Laser Scanning and Rapid Prototyping to Enhance Construction Modeling , 2005 .

[25]  Gerald E. Farin,et al.  Curves and surfaces for computer-aided geometric design - a practical guide, 4th Edition , 1997, Computer science and scientific computing.

[26]  John Wright,et al.  Segmentation of multivariate mixed data via lossy coding and compression , 2007, Electronic Imaging.

[27]  Frédéric Bosché,et al.  Plane-based registration of construction laser scans with 3D/4D building models , 2012, Adv. Eng. Informatics.

[28]  Sunglok Choi,et al.  Performance Evaluation of RANSAC Family , 2009, BMVC.

[29]  F. Tarsha-Kurdi,et al.  EXTENDED RANSAC ALGORITHM FOR AUTOMATIC DETECTION OF BUILDING ROOF PLANES FROM LIDAR DATA , 2008 .

[30]  George K. Knopf,et al.  Consistent Point Clouds of Narrow Spaces Using Multiscan Domain Mapping , 2012, Comput. Aided Civ. Infrastructure Eng..

[31]  Gerald E. Farin,et al.  From conics to NURBS: A tutorial and survey , 1992, IEEE Computer Graphics and Applications.

[32]  Gilad Lerman,et al.  Hybrid Linear Modeling via Local Best-Fit Flats , 2010, International Journal of Computer Vision.

[33]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Emmanuel J. Candès,et al.  A Geometric Analysis of Subspace Clustering with Outliers , 2011, ArXiv.

[35]  George Vosselman,et al.  Advanced point cloud processing , 2009 .

[36]  Wolfram Burgard,et al.  Learning compact 3D models of indoor and outdoor environments with a mobile robot , 2003, Robotics Auton. Syst..

[37]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[38]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[39]  Gilad Lerman,et al.  Randomized hybrid linear modeling by local best-fit flats , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Norbert Pfeifer,et al.  A Comprehensive Automated 3D Approach for Building Extraction, Reconstruction, and Regularization from Airborne Laser Scanning Point Clouds , 2008, Sensors.

[41]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[42]  René Vidal,et al.  Sparse subspace clustering , 2009, CVPR.

[43]  Sagar S. Deshpande,et al.  Improved Floodplain Delineation Method Using High‐Density LiDAR Data , 2013, Comput. Aided Civ. Infrastructure Eng..

[44]  M Martinnevado,et al.  Obtaining 3D models of indoor environments with a mobile robot by estimating local surface directions , 2004 .

[45]  Patricio A. Vela,et al.  A Sparsity-Inducing Optimization Algorithm for the Extraction of Planar Structures in Noisy Point-Cloud Data , 2012 .

[46]  John Wright,et al.  Segmentation of Multivariate Mixed Data via Lossy Data Coding and Compression , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  René Vidal,et al.  Combined central and subspace clustering for computer vision applications , 2006, ICML.

[48]  Nabil H. Mustafa,et al.  k-means projective clustering , 2004, PODS.

[49]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[50]  S. Shankar Sastry,et al.  Generalized Principal Component Analysis , 2016, Interdisciplinary applied mathematics.