Extracting Individual Bricks from a Laser Scan Point Cloud of an Unorganized Pile of Bricks

Bricks are the vital component of most masonry structures. Their maintenance is critical to the protection of masonry buildings. Terrestrial Light Detection and Ranging (TLidar) systems provide massive point cloud data in an accurate and fast way. TLidar enables us to sample and store the state of a brick surface in a practical way. This article aims to extract individual bricks from an unorganized pile of bricks sampled by a dense point cloud. The method automatically segments and models the individual bricks. The methodology is divided into five main steps: Filter needless points, brick boundary points removal, coarse segmentation using 3D component analysis, planar segmentation and grouping, and brick reconstruction. A novel voting scheme is used to segment the planar patches in an effective way. Brick reconstruction is based on the geometry of single brick and its corresponding nominal size (length, width and height). The number of bricks reconstructed is around 75%. An accuracy assessment is performed by comparing 3D coordinates of the reconstructed vertices to the manually picked vertices. The standard deviations of differences along x, y and z axes are 4.55 mm, 4.53 mm and 4.60 mm, respectively. The comparison results indicate that the accuracy of reconstruction based on the introduced methodology is high and reliable. The work presented in this paper provides a theoretical basis and reference for large scene applications in brick-like structures. Meanwhile, the high-accuracy brick reconstruction lays the foundation for further brick displacement estimation.

[1]  Clive S. Fraser,et al.  Automatic Segmentation of Raw LIDAR Data for Extraction of Building Roofs , 2014, Remote. Sens..

[2]  Juha Hyyppä,et al.  Detection of Vertical Pole-Like Objects in a Road Environment Using Vehicle-Based Laser Scanning Data , 2010, Remote. Sens..

[3]  Michela Bertolotto,et al.  Octree-based region growing for point cloud segmentation , 2015 .

[4]  Chia-Hsiang Menq,et al.  Automatic data segmentation for geometric feature extraction from unorganized 3-D coordinate points , 2001, IEEE Trans. Robotics Autom..

[5]  George Vosselman,et al.  Airborne and terrestrial laser scanning , 2011, Int. J. Digit. Earth.

[6]  Danica Kragic,et al.  Attention-based active 3D point cloud segmentation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Gérard G. Medioni,et al.  Stereo using monocular cues within the tensor voting framework , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Gérard G. Medioni,et al.  Inference of Surfaces, 3D Curves, and Junctions From Sparse, Noisy, 3D Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Belén Riveiro,et al.  Automated processing of large point clouds for structural health monitoring of masonry arch bridges , 2016 .

[10]  Hanan Samet,et al.  A general approach to connected-component labeling for arbitrary image representations , 1992, JACM.

[11]  Rita Cucchiara,et al.  3D Hough transform for sphere recognition on point clouds , 2014, Machine Vision and Applications.

[12]  Xiaolong Xu,et al.  Automatic surface reconstruction with alpha-shape method , 2003, The Visual Computer.

[13]  Joaquín Martínez-Sánchez,et al.  Automatic modelling of rubble mound breakwaters from LiDAR data , 2015 .

[14]  Peter Teunissen,et al.  Incidence angle influence on the quality of terrestrial laser scanning points , 2009 .

[15]  Bruce G. Batchelor,et al.  Edge-Region-Based Segmentation of Range Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  L. Rosasco,et al.  Multiscale geometric methods for data sets I: Multiscale SVD, noise and curvature , 2017 .

[17]  Benjamin T. Crosby,et al.  Comparing Two Methods of Surface Change Detection on an Evolving Thermokarst Using High-Temporal-Frequency Terrestrial Laser Scanning, Selawik River, Alaska , 2013, Remote. Sens..

[18]  Diego González-Aguilera,et al.  Mobile LiDAR System: New Possibilities for the Documentation and Dissemination of Large Cultural Heritage Sites , 2017, Remote. Sens..

[19]  Hubo Cai,et al.  Modeling Road Centerlines and Predicting Lengths in 3‐D Using LIDAR Point Cloud and Planimetric Road Centerline Data , 2008, Comput. Aided Civ. Infrastructure Eng..

[20]  Hanan Samet,et al.  Efficient Component Labeling of Images of Arbitrary Dimension Represented by Linear Bintrees , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Pedro Arias,et al.  Terrestrial laser scanning for geometry extraction and change monitoring of rubble mound breakwaters , 2014 .

[22]  Deng Min,et al.  The Study on Point Cloud Data Surface Reconstruction Based on Power Crust Algorithm , 2013 .

[23]  B. Pradhan,et al.  Application of LiDAR in Rockfall Hazard Assessment in Tropical Region , 2017 .

[24]  Juha Hyyppä,et al.  Individual Tree Detection and Classification with UAV-Based Photogrammetric Point Clouds and Hyperspectral Imaging , 2017, Remote. Sens..

[25]  Semyung Wang,et al.  A new segmentation method for point cloud data , 2002 .

[26]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Andrea Montanari,et al.  Reconstruction for Models on Random Graphs , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[28]  Alexandre Bernardino,et al.  Robust cylinder detection and pose estimation using 3D point cloud information , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[29]  Adrián J. Riquelme,et al.  3-D Morphological Change Analysis of a Beach with Seagrass Berm Using a Terrestrial Laser Scanner , 2018, ISPRS Int. J. Geo Inf..

[30]  Piyush Kumar,et al.  Fast construction of k-nearest neighbor graphs for point clouds , 2010, IEEE Transactions on Visualization and Computer Graphics.

[31]  Ran Wang,et al.  Tridimensional Reconstruction Applied to Cultural Heritage with the Use of Camera-Equipped UAV and Terrestrial Laser Scanner , 2014, Remote. Sens..

[32]  Jean-Daniel Boissonnat,et al.  Geometric structures for three-dimensional shape representation , 1984, TOGS.

[33]  Hojjat Adeli,et al.  A New Approach for Health Monitoring of Structures: Terrestrial Laser Scanning , 2007, Comput. Aided Civ. Infrastructure Eng..

[34]  Boris Jutzi,et al.  SHAPE DISTRIBUTION FEATURES FOR POINT CLOUD ANALYSIS - A GEOMETRIC HISTOGRAM APPROACH ON MULTIPLE SCALES , 2014 .

[35]  Abdul Nurunnabi,et al.  Outlier detection and robust normal-curvature estimation in mobile laser scanning 3D point cloud data , 2015, Pattern Recognit..

[36]  G. Medioni,et al.  Tensor Voting : Theory and Applications , 2000 .

[37]  Atilla Baskurt,et al.  A new CAD mesh segmentation method, based on curvature tensor analysis , 2005, Comput. Aided Des..

[38]  Stéphane Jaillet,et al.  Multi-Annual Kinematics of an Active Rock Glacier Quantified from Very High-Resolution DEMs: An Application-Case in the French Alps , 2018, Remote. Sens..

[39]  Baoqian Wang,et al.  Continuous Extraction of Subway Tunnel Cross Sections Based on Terrestrial Point Clouds , 2014, Remote. Sens..

[40]  Keith Bugeja,et al.  Point Cloud Segmentation for Cultural Heritage Sites , 2011, VAST.

[41]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[42]  Sven Behnke,et al.  Approximate triangulation and region growing for efficient segmentation and smoothing of range images , 2014, Robotics Auton. Syst..

[43]  Jaehoon Jung,et al.  Segmentation of Planar Surfaces from Laser Scanning Data Using the Magnitude of Normal Position Vector for Adaptive Neighborhoods , 2016, Sensors.

[44]  Emmanuel Maggiori,et al.  Comments on “A Closed-Form Solution to Tensor Voting: Theory and Applications” , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Qin Yan,et al.  Automatic Vehicle Extraction from Airborne LiDAR Data Using an Object-Based Point Cloud Analysis Method , 2014, Remote. Sens..

[46]  Akio Gofuku,et al.  Evaluation of Plane Detection with RANSAC According to Density of 3D Point Clouds , 2013, ArXiv.

[47]  Kai Tan,et al.  Correction of Incidence Angle and Distance Effects on TLS Intensity Data Based on Reference Targets , 2016, Remote. Sens..

[48]  Tom Edwards,et al.  A 4D Filtering and Calibration Technique for Small-Scale Point Cloud Change Detection with a Terrestrial Laser Scanner , 2015, Remote. Sens..

[49]  Y. H. Chen,et al.  Quadric surface extraction using genetic algorithms , 1999, Comput. Aided Des..

[50]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[51]  Adrián J. Riquelme,et al.  A new approach for semi-automatic rock mass joints recognition from 3D point clouds , 2014, Comput. Geosci..

[52]  Zhizhong Kang,et al.  Range Image Techniques for Fast Detection and Quantification of Changes in Repeatedly Scanned Buildings , 2013 .

[53]  Weiguo Zhang,et al.  Investigation of TLS Intensity Data and Distance Measurement Errors from Target Specular Reflections , 2018, Remote. Sens..

[54]  Ingela Nyström,et al.  Connected Components in 3D Neighbourhoods , 1997 .

[55]  Paulo F. U. Gotardo,et al.  Range image segmentation into planar and quadric surfaces using an improved robust estimator and genetic algorithm , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[56]  Les A. Piegl,et al.  Algorithm for finding all k nearest neighbors , 2002, Comput. Aided Des..

[57]  Jinhu Wang,et al.  Change Analysis in Structural Laser Scanning Point Clouds: The Baseline Method , 2016, Sensors.

[58]  Jaromír Landa,et al.  POINT CLOUD PROCESSING FOR SMART SYSTEMS , 2013 .

[59]  Wei Wu,et al.  Rapid Delaunay triangulation for randomly distributed point cloud data using adaptive Hilbert curve , 2016, Comput. Graph..

[60]  Pavel Smrz,et al.  Continuous plane detection in point-cloud data based on 3D Hough Transform , 2014, J. Vis. Commun. Image Represent..

[61]  Norbert Pfeifer,et al.  Landslide Displacement Monitoring Using 3D Range Flow on Airborne and Terrestrial LiDAR Data , 2013, Remote. Sens..

[62]  Yu Liu,et al.  Automatic segmentation of unorganized noisy point clouds based on the Gaussian map , 2008, Comput. Aided Des..

[63]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.