Point cloud segmentation for urban scene classification

Abstract. High density point clouds of urban scenes are used to identify object classes like buildings, vegetation, vehicles, ground, and water. Point cloud segmentation can support classification and further feature extraction provided that the segments are logical groups of points belonging to the same object class. A single segmentation method will typically not provide a satisfactory segmentation for a variety of classes. This paper explores the combination of various segmentation and post-processing methods to arrive at useful point cloud segmentations. A feature based on the normal vector and flatness of a point neighbourhood is used to group cluttered points in trees as well as points on surfaces in areas where the extraction of planes was not successful. Combined with segment merging and majority filtering large segments can be obtained allowing the derivation of accurate segment feature values. Results are presented and discussed for a 70 million point dataset over a part of Rotterdam.

[1]  Nicolas David,et al.  Large-scalewater classification of coastal areas using airborne topographic lidar data , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[2]  Ahmad Kamal Aijazi,et al.  Segmentation Based Classification of 3D Urban Point Clouds: A Super-Voxel Based Approach with Evaluation , 2013, Remote. Sens..

[3]  Norman Kerle,et al.  Object-oriented identification of forested landslides with derivatives of single pulse LiDAR data , 2012 .

[4]  S. J. Oude Elberink,et al.  Entities and Features for Classifcation of Airborne Laser Scanning Data in Urban Area , 2012 .

[5]  Uwe Soergel,et al.  CONDITIONAL RANDOM FIELDS for LIDAR POINT CLOUD CLASSIFICATION in COMPLEX URBAN AREAS , 2012 .

[6]  Konrad Schindler,et al.  IMPLICIT SHAPE MODELS FOR OBJECT DETECTION IN 3D POINT CLOUDS , 2012, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[7]  George Vosselman,et al.  Recognizing basic structures from mobile laser scanning data for road inventory studies , 2011 .

[8]  Dimitri Lague,et al.  3D Terrestrial LiDAR data classification of complex natural scenes using a multi-scale dimensionality criterion: applications in geomorphology , 2011, ArXiv.

[9]  Frédéric Bretar,et al.  3D segmentation of forest structure using a mean-shift based algorithm , 2010, 2010 IEEE International Conference on Image Processing.

[10]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[11]  George Vosselman,et al.  Visualisation and structuring of point clouds , 2010 .

[12]  Surya P. N. Singh,et al.  A Pipeline for the Segmentation and Classification of 3D Point Clouds , 2010, ISER.

[13]  Thomas A. Funkhouser,et al.  Min-cut based segmentation of point clouds , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[14]  David Suter,et al.  3D terrestrial LIDAR classifications with super-voxels and multi-scale Conditional Random Fields , 2009, Comput. Aided Des..

[15]  Uwe Stilla,et al.  Object extraction based on 3D-segmentation of LiDAR data by combining mean shift with normalized cuts: Two examples from urban areas , 2009, 2009 Joint Urban Remote Sensing Event.

[16]  C. Mallet,et al.  AIRBORNE LIDAR FEATURE SELECTION FOR URBAN CLASSIFICATION USING RANDOM FORESTS , 2009 .

[17]  Markus Hollaus,et al.  Object-Based Point Cloud Analysis of Full-Waveform Airborne Laser Scanning Data for Urban Vegetation Classification , 2008, Sensors.

[18]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[19]  Thomas Melzer,et al.  Non-parametric segmentation of ALS point clouds using mean shift , 2007 .

[20]  Geoffrey J. Hay,et al.  Object-based Image Analysis : Strengths , Weaknesses , Opportunities and Threats ( Swot ) , 2006 .

[21]  George Vosselman,et al.  Change detection for updating medium scale maps using laster altimetry , 2004 .

[22]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..