Fisher Vector Encoding of Supervoxel-Based Features for Airborne LiDAR Data Classification

Point cloud feature extraction as a classification task is crucial in maximizing the efficient downstream applicability of raw point clouds. With the goal of learning optimum features for efficient classification of a multi-class point cloud for downstream applications, this letter presents a supervoxel-Fisher vector (FV)-based approach for airborne light detection and ranging (LiDAR) data classification. In our approach, FV encoding is implemented to deduce compact global descriptors from aggregated supervoxels to establish a more descriptive and discriminative representation, transforming the low-level visual features into high-level semantic features. As a result, the proposed approach combines local and global feature properties through the quantization and aggregation of higher order statistics to harnesses their combined advantages for producing good classification results. Experiments were conducted on the international society for photogrammetry and remote sensing 3-D semantic labeling benchmark data set. Results indicate that the proposed approach is robust and efficient, attained the third best position with an overall accuracy of 81.79%, and ranked first with an $\text{F}_{{1}}$ -score of 72.31%.

[1]  Deren Li,et al.  Object Classification of Aerial Images With Bag-of-Visual Words , 2010, IEEE Geoscience and Remote Sensing Letters.

[2]  Cigdem Serifoglu Yilmaz,et al.  Investigating the performances of commercial and non-commercial software for ground filtering of UAV-based point clouds , 2018 .

[3]  Domen Mongus,et al.  Context-dependent detection of non-linearly distributed points for vegetation classification in airborne LiDAR , 2016 .

[4]  Wei Wei,et al.  Local Patch Vectors Encoded by Fisher Vectors for Image Classification , 2018, Inf..

[5]  Ruibin Zhao,et al.  Classifying airborne LiDAR point clouds via deep features learned by a multi-scale convolutional neural network , 2018, Int. J. Geogr. Inf. Sci..

[6]  Bisheng Yang,et al.  Hierarchical extraction of urban objects from mobile laser scanning data , 2015 .

[7]  Hartmut Prautzsch,et al.  Local Versus Global Triangulations , 2001, Eurographics.

[8]  Wuming Zhang,et al.  An Easy-to-Use Airborne LiDAR Data Filtering Method Based on Cloth Simulation , 2016, Remote. Sens..

[9]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[10]  Juntao Yang,et al.  A probabilistic graphical model for the classification of mobile LiDAR point clouds , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[11]  Carl Salvaggio,et al.  A Fully Convolutional Network for Semantic Labeling of 3D Point Clouds , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  Dimitri Lague,et al.  3D Terrestrial LiDAR data classification of complex natural scenes using a multi-scale dimensionality criterion: applications in geomorphology , 2011, ArXiv.

[13]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[14]  Uwe Soergel,et al.  HIERARCHICAL HIGHER ORDER CRF FOR THE CLASSIFICATION OF AIRBORNE LIDAR POINT CLOUDS IN URBAN AREAS , 2016 .

[15]  Rama Rao Nidamanuri,et al.  A supervoxel-based spectro-spatial approach for 3D urban point cloud labelling , 2016 .

[16]  Wei Huang,et al.  A Convolutional Neural Network-Based 3D Semantic Labeling Method for ALS Point Clouds , 2017, Remote. Sens..

[17]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[18]  Qing Zhu,et al.  Robust point cloud classification based on multi-level semantic relationships for urban scenes , 2017 .

[19]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[20]  A. Frick,et al.  A Framework for the Long-term Monitoring of Urban Green Volume Based on Multi-temporal and Multi-sensoral Remote Sensing Data , 2019, Journal of Geovisualization and Spatial Analysis.