Airborne LiDAR Point Cloud Classification with Graph Attention Convolution Neural Network

Airborne light detection and ranging (LiDAR) plays an increasingly significant role in urban planning, topographic mapping, environmental monitoring, power line detection and other fields thanks to its capability to quickly acquire large-scale and high-precision ground information. To achieve point cloud classification, previous studies proposed point cloud deep learning models that can directly process raw point clouds based on PointNet-like architectures. And some recent works proposed graph convolution neural network based on the inherent topology of point clouds. However, the above point cloud deep learning models only pay attention to exploring local geometric structures, yet ignore global contextual relationships among all points. In this paper, we present a graph attention convolution neural network (GACNN) that can be directly applied to the classification of unstructured 3D point clouds obtained by airborne LiDAR. Specifically, we first introduce a graph attention convolution module that incorporates global contextual information and local structural features. Based on the proposed graph attention convolution module, we further design an end-to-end encoder-decoder network, named GACNN, to capture multiscale features of the point clouds and therefore enable more accurate airborne point cloud classification. Experiments on the ISPRS 3D labeling dataset show that the proposed model achieves a new state-of-the-art performance in terms of average F1 score (71.5\%) and a satisfying overall accuracy (83.2\%). Additionally, experiments further conducted on the 2019 Data Fusion Contest Dataset by comparing with other prevalent point cloud deep learning models demonstrate the favorable generalization capability of the proposed model.

[1]  Kaleem Siddiqi,et al.  Local Spectral Graph Convolution for Point Set Feature Learning , 2018, ECCV.

[2]  Yoonseok Jwa,et al.  AUTOMATIC POWERLINE SCENE CLASSIFICATION AND RECONSTRUCTION USING AIRBORNE LIDAR DATA , 2012 .

[3]  Liang Zhang,et al.  A Deep Neural Network With Spatial Pooling (DNNSP) for 3-D Point Cloud Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[5]  Leonidas J. Guibas,et al.  KPConv: Flexible and Deformable Convolution for Point Clouds , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[6]  Xiaoye Liu,et al.  Airborne LiDAR for DEM generation: some critical issues , 2008 .

[7]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[8]  Juha Hyyppä,et al.  Fully-Automated Power Line Extraction from Airborne Laser Scanning Point Clouds in Forest Areas , 2014, Remote. Sens..

[9]  Wei Wu,et al.  PointCNN: Convolution On X-Transformed Points , 2018, NeurIPS.

[10]  Michael Cramer,et al.  The DGPF-Test on Digital Airborne Camera Evaluation - Over- view and Test Design , 2010 .

[11]  Lei Wang,et al.  Appendix for : Graph Attention Convolution for Point Cloud Semantic Segmentation , 2019 .

[12]  L. E. Link,et al.  Airborne laser topographic mapping results , 1984 .

[13]  C. Mallet,et al.  AIRBORNE LIDAR FEATURE SELECTION FOR URBAN CLASSIFICATION USING RANDOM FORESTS , 2009 .

[14]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[15]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[16]  Qi Chen Airborne Lidar Data Processing and Information Extraction , 2007 .

[17]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Xiang Li,et al.  Directionally Constrained Fully Convolutional Neural Network For Airborne Lidar Point Cloud Classification , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[20]  Carl Salvaggio,et al.  A Fully Convolutional Network for Semantic Labeling of 3D Point Clouds , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[21]  Wei Huang,et al.  A Convolutional Neural Network-Based 3D Semantic Labeling Method for ALS Point Clouds , 2017, Remote. Sens..

[22]  Uwe Soergel,et al.  HIERARCHICAL HIGHER ORDER CRF FOR THE CLASSIFICATION OF AIRBORNE LIDAR POINT CLOUDS IN URBAN AREAS , 2016 .

[23]  Heiko Balzter,et al.  Modelling relationships between birds and vegetation structure using airborne LiDAR data: a review with case studies from agricultural and woodland environments , 2005 .

[24]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[25]  Antonios Tsourdos,et al.  GAPNet: Graph Attention based Point Neural Network for Exploiting Local Feature of Point Cloud , 2019, ArXiv.

[26]  P. Axelsson DEM Generation from Laser Scanner Data Using Adaptive TIN Models , 2000 .

[27]  Wanshou Jiang,et al.  Segmentation and Multi-Scale Convolutional Neural Network-Based Classification of Airborne Laser Scanner Data , 2018, Sensors.

[28]  Amin Zheng,et al.  RGCNN: Regularized Graph CNN for Point Cloud Segmentation , 2018, ACM Multimedia.

[29]  O. Barinova,et al.  NON-ASSOCIATIVE MARKOV NETWORKS FOR 3D POINT CLOUD CLASSIFICATION , 2010 .

[30]  Hasan Asy'ari Arief,et al.  Addressing Overfitting on Pointcloud Classification using Atrous XCRF , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[31]  Yi Peng,et al.  Wetland inundation mapping and change monitoring using Landsat and airborne LiDAR data , 2014 .

[32]  Cewu Lu,et al.  PointSIFT: A SIFT-like Network Module for 3D Point Cloud Semantic Segmentation , 2018, ArXiv.

[33]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[34]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[35]  Ruibin Zhao,et al.  Classifying airborne LiDAR point clouds via deep features learned by a multi-scale convolutional neural network , 2018, Int. J. Geogr. Inf. Sci..

[36]  Congcong Wen,et al.  A novel spatiotemporal convolutional long short-term neural network for air pollution prediction. , 2019, The Science of the total environment.

[37]  B. Jutzi,et al.  3D semantic labeling of ALS point clouds by exploiting multi-scale, multi-type neighborhoods for feature extraction , 2016 .

[38]  Domen Mongus,et al.  Context-dependent detection of non-linearly distributed points for vegetation classification in airborne LiDAR , 2016 .

[39]  Uwe Soergel,et al.  Conditional Random Fields for Urban Scene Classification with Full Waveform LiDAR Data , 2011, PIA.

[40]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  David P. Helmbold,et al.  Aerial Lidar Data Classification using AdaBoost , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[42]  Jianping Wu,et al.  Automated derivation of urban building density information using airborne LiDAR data and object-based method , 2010 .

[43]  Xiangguo Lin,et al.  SVM-Based Classification of Segmented Airborne LiDAR Point Clouds in Urban Areas , 2013, Remote. Sens..

[44]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[45]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.