Multi-Class Simultaneous Adaptive Segmentation and Quality Control of Point Cloud Data

3D modeling of a given site is an important activity for a wide range of applications including urban planning, as-built mapping of industrial sites, heritage documentation, military simulation, and outdoor/indoor analysis of airflow. Point clouds, which could be either derived from passive or active imaging systems, are an important source for 3D modeling. Such point clouds need to undergo a sequence of data processing steps to derive the necessary information for the 3D modeling process. Segmentation is usually the first step in the data processing chain. This paper presents a region-growing multi-class simultaneous segmentation procedure, where planar, pole-like, and rough regions are identified while considering the internal characteristics (i.e., local point density/spacing and noise level) of the point cloud in question. The segmentation starts with point cloud organization into a kd-tree data structure and characterization process to estimate the local point density/spacing. Then, proceeding from randomly-distributed seed points, a set of seed regions is derived through distance-based region growing, which is followed by modeling of such seed regions into planar and pole-like features. Starting from optimally-selected seed regions, planar and pole-like features are then segmented. The paper also introduces a list of hypothesized artifacts/problems that might take place during the region-growing process. Finally, a quality control process is devised to detect, quantify, and mitigate instances of partially/fully misclassified planar and pole-like features. Experimental results from airborne and terrestrial laser scanning as well as image-based point clouds are presented to illustrate the performance of the proposed segmentation and quality control framework.

[1]  Peter J. A. Shaw,et al.  Multivariate Statistics for the Environmental Sciences , 2003 .

[2]  Norbert Pfeifer,et al.  A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Ayman Habib,et al.  An adaptive approach for the segmentation and extraction of planar and linear/cylindrical features from laser scanning data , 2014 .

[4]  Primo Zingaretti,et al.  Complete classification of raw LIDAR data and 3D reconstruction of buildings , 2006, Pattern Analysis and Applications.

[5]  Christian Heipke,et al.  EVALUATION OF AUTOMATIC ROAD EXTRACTION , 2007 .

[6]  Xiaoye Liu,et al.  Airborne LiDAR for DEM generation: some critical issues , 2008 .

[7]  Linda G. Shapiro,et al.  Robust meshes from multiple range maps , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  K. Moffett,et al.  Remote Sens , 2015 .

[10]  N. Haala.  The Landscape of Dense Image Matching Algorithms , 2013 .

[11]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[12]  Mani Golparvar-Fard,et al.  Segmentation of building point cloud models including detailed architectural/structural features and MEP systems , 2015 .

[13]  I. Moore,et al.  Digital terrain modelling: A review of hydrological, geomorphological, and biological applications , 1991 .

[14]  G. Sithole,et al.  Recognising structure in laser scanning point clouds , 2004 .

[15]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[16]  Mani Golparvar-Fard,et al.  Segmentation and Recognition of Highway Assets Using Image-Based 3D Point Clouds and Semantic Texton Forests , 2015, J. Comput. Civ. Eng..

[17]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[18]  Derek D. Lichti,et al.  DETECTION OF ROAD CURB FROM MOBILE TERRESTRIAL LASER SCANNER POINT CLOUD , 2012 .

[19]  T. Rabbani,et al.  SEGMENTATION OF POINT CLOUDS USING SMOOTHNESS CONSTRAINT , 2006 .

[20]  Mohannad Al-Durgham,et al.  A Framework for the Registration and Segmentation of Heterogeneous Lidar Data , 2013 .

[21]  Bisheng Yang,et al.  A shape-based segmentation method for mobile laser scanning point clouds , 2013 .

[22]  Eunju Kwak,et al.  Automatic representation and reconstruction of DBM from LiDAR data using Recursive Minimum Bounding Rectangle , 2014 .

[23]  José Luis Lerma,et al.  Unsupervised robust planar segmentation of terrestrial laser scanner point clouds based on fuzzy clustering methods , 2008 .

[24]  A. Habib,et al.  Linear Approach for Initial Recovery of the Exterior Orientation Parameters of Randomly Captured Images by Low-Cost Mobile Mapping Systems , 2014 .

[25]  J. Hyyppä,et al.  Airborne Laser Scanning , 2009 .

[26]  C. Briese,et al.  A NEW METHOD FOR BUILDING EXTRACTION IN URBAN AREAS FROM HIGH-RESOLUTION LIDAR DATA , 2002 .

[27]  J. Shan,et al.  SEGMENTATION OF LIDAR POINT CLOUDS FOR BUILDING EXTRACTION , 2009 .

[28]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[29]  Yahya Alshawabkeh,et al.  Integration of Digital Photogrammetry and Laser Scanning for Heritage Documentation , 2004 .

[30]  Changjae Kim,et al.  Generation of Complex Polyhedral Building Models by Integrating Stereo-Aerial Imagery and Lidar Data , 2010 .

[31]  Norbert Pfeifer,et al.  New Associate Editor pp iii-iv Segmentation of airborne laser scanning data using a slope adaptive neighborhood , 2006 .

[32]  Abdul Nurunnabi,et al.  Robust segmentation for multiple planar surface extraction in laser scanning 3D point cloud data , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[33]  George Vosselman,et al.  Experimental comparison of filter algorithms for bare-Earth extraction from airborne laser scanning point clouds , 2004 .

[34]  G. Priestnalla,et al.  Extracting urban features from LiDAR digital surface models , 2022 .

[35]  David Hernández-López,et al.  Automated Urban Analysis Based on LiDAR-Derived Building Models , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[36]  T. Awwad,et al.  An improved segmentation approach for planar surfaces from unstructured 3D point clouds , 2010 .

[37]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[38]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  A. Gruen.  Development and Status of Image Matching in Photogrammetry , 2012 .

[40]  Ayman Habib,et al.  New Approaches for Estimating the Local Point Density and its Impact on Lidar Data Segmentation , 2013 .

[41]  Ulrich Neumann,et al.  Pipe-Run Extraction and Reconstruction from Point Clouds , 2014, ECCV.

[42]  J. Reitberger,et al.  3D segmentation of single trees exploiting full waveform LIDAR data , 2009 .

[43]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[44]  D. Lichti,et al.  CLASSIFICATION AND SEGMENTATION OF TERRESTRIAL LASER SCANNER POINT CLOUDS USING LOCAL VARIANCE INFORMATION , 2006 .

[45]  Changmin Kim,et al.  Fully Automated As-Built 3D Pipeline Extraction Method from Laser-Scanned Data Based on Curvature Computation , 2015, J. Comput. Civ. Eng..

[46]  George Vosselman,et al.  Automatic extraction of building features from terrestrial laser scanning , 2006 .

[47]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[48]  Norbert Haala,et al.  GRAMMAR SUPPORTED FACADE RECONSTRUCTION FROM MOBILE LIDAR MAPPING , 2009 .