Using Training Samples Retrieved from a Topographic Map and Unsupervised Segmentation for the Classification of Airborne Laser Scanning Data

The labeling of point clouds is the fundamental task in airborne laser scanning (ALS) point clouds processing. Many supervised methods have been proposed for the point clouds classification work. Training samples play an important role in the supervised classification. Most of the training samples are generated by manual labeling, which is time-consuming. To reduce the cost of manual annotating for ALS data, we propose a framework that automatically generates training samples using a two-dimensional (2D) topographic map and an unsupervised segmentation step. In this approach, input point clouds, at first, are separated into the ground part and the non-ground part by a DEM filter. Then, a point-in-polygon operation using polygon maps derived from a 2D topographic map is used to generate initial training samples. The unsupervised segmentation method is applied to reduce the noise and improve the accuracy of the point-in-polygon training samples. Finally, the super point graph is used for the training and testing procedure. A comparison with the point-based deep neural network Pointnet++ (average F1 score 59.4%) shows that the segmentation based strategy improves the performance of our initial training samples (average F1 score 65.6%). After adding the intensity value in unsupervised segmentation, our automatically generated training samples have competitive results with an average F1 score of 74.8% for ALS data classification while using the ground truth training samples the average F1 score is 75.1%. The result shows that our framework is feasible to automatically generate and improve the training samples with low time and labour costs.

[1]  Jiann-Yeou Rau,et al.  Analysis of Oblique Aerial Images for Land Cover and Point Cloud Classification in an Urban Environment , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Guillaume Obozinski,et al.  Cut Pursuit: Fast Algorithms to Learn Piecewise Constant Functions , 2016, AISTATS.

[3]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[4]  C. Mallet,et al.  AIRBORNE LIDAR FEATURE SELECTION FOR URBAN CLASSIFICATION USING RANDOM FORESTS , 2009 .

[5]  Wei Huang,et al.  A Convolutional Neural Network-Based 3D Semantic Labeling Method for ALS Point Clouds , 2017, Remote. Sens..

[6]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[7]  George Vosselman,et al.  Contextual segment-based classification of airborne laser scanner data , 2017 .

[8]  Shi-Min Hu,et al.  Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing , 2020, IEEE Transactions on Visualization and Computer Graphics.

[9]  Godfried T. Toussaint,et al.  Relative neighborhood graphs and their relatives , 1992, Proc. IEEE.

[10]  Andrés Serna,et al.  Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning , 2014 .

[11]  Roland Billen,et al.  Voxel-based 3D Point Cloud Semantic Segmentation: Unsupervised Geometric and Relationship Featuring vs Deep Learning Methods , 2019, ISPRS Int. J. Geo Inf..

[12]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[13]  Zhen Wang,et al.  A mathematical morphology-based multi-level filter of LiDAR data for generating DTMs , 2013, Science China Information Sciences.

[14]  Markus Hollaus,et al.  Object-Based Point Cloud Analysis of Full-Waveform Airborne Laser Scanning Data for Urban Vegetation Classification , 2008, Sensors.

[15]  Wanshou Jiang,et al.  Segmentation and Multi-Scale Convolutional Neural Network-Based Classification of Airborne Laser Scanner Data , 2018, Sensors.

[16]  Chao Luo,et al.  SCENE-LAYOUT COMPATIBLE CONDITIONAL RANDOM FIELD FOR CLASSIFYING TERRESTRIAL LASER POINT CLOUDS , 2014 .

[17]  Jing Xiao,et al.  Fusion of airborne laserscanning point clouds and images for supervised and unsupervised scene classification , 2014 .

[18]  Leonidas J. Guibas,et al.  KPConv: Flexible and Deformable Convolution for Point Clouds , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Ruofei Zhong,et al.  Classification of Urban Point Clouds: A Robust Supervised Approach With Automatically Generating Training Data , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  G. Vosselman SLOPE BASED FILTERING OF LASER ALTIMETRY DATA , 2000 .

[21]  Shaohui Sun,et al.  Aerial 3D Building Detection and Modeling From Airborne LiDAR Point Clouds , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Uwe Soergel,et al.  Relevance assessment of full-waveform lidar data for urban area classification , 2011 .

[23]  S. J. Oude Elberink,et al.  Multiple-entity based classification of airborne laser scanning data in urban areas , 2014 .

[24]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .