A Hybrid Capsule Network for Land Cover Classification Using Multispectral LiDAR Data

Land cover mapping is an effective way to quantify land resources and monitor their changes. It plays an important role in a wide range of applications. This letter proposes a hybrid capsule network for land cover classification using multispectral light detection and ranging (LiDAR) data. First, the multispectral LiDAR data were rasterized into a set of feature images to exploit the geometrical and spectral properties of different types of land covers. Then, a hybrid capsule network composed of an encoder network and a decoder network is trained to extract both high-level local and global entity-oriented capsule features for accurate land cover classification. Quantitative classification evaluations on two data sets show that the overall accuracy, average accuracy, and kappa coefficient of over 97.89%, 94.54%, and 0.9713, respectively, are obtained. Comparative studies with five existing methods confirm that the proposed method performs robustly and accurately in land cover classification using the multispectral LiDAR data.

[1]  Jun Zhou,et al.  Fusion of Hyperspectral and LiDAR Data Using Discriminant Correlation Analysis for Land Cover Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Jun Yu,et al.  Automated Detection of Road Manhole and Sewer Well Covers From Mobile LiDAR Point Clouds , 2014, IEEE Geoscience and Remote Sensing Letters.

[3]  Mihai Datcu,et al.  SAR Image Land Cover Datasets for Classification Benchmarking of Temporal Changes , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Taner Ince,et al.  Sparse Representation-Based Hyperspectral Image Classification Using Multiscale Superpixels and Guided Filter , 2019, IEEE Geoscience and Remote Sensing Letters.

[5]  Yanfeng Gu,et al.  Multiple Kernel Sparse Representation for Airborne LiDAR Data Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Dan Hu,et al.  Semisupervised Hyperspectral Image Classification Based on Generative Adversarial Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[7]  Jon Atli Benediktsson,et al.  A Novel MKL Model of Integrating LiDAR Data and MSI for Urban Area Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Pedram Ghamisi,et al.  LiDAR Data Classification Using Morphological Profiles and Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[9]  Craig Glennie,et al.  Classification of Airborne Multispectral Lidar Point Clouds for Land Cover Mapping , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Wenji Zhao,et al.  Land-cover classification using GF-2 images and airborne lidar data based on Random Forest , 2018, International Journal of Remote Sensing.

[11]  Haiyan Guan,et al.  A Comparative Land-Cover Classification Feature Study of Learning Algorithms: DBM, PCA, and RF Using Multispectral LiDAR Data , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Jie Chen,et al.  GA-SVM Algorithm for Improving Land-Cover Classification Using SAR and Optical Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[13]  Pedram Ghamisi,et al.  LiDAR Data Classification Using Spatial Transformation and CNN , 2019, IEEE Geoscience and Remote Sensing Letters.

[14]  Ahmed El-Rabbany,et al.  Multispectral LiDAR Data for Land Cover Classification of Urban Areas , 2017, Sensors.

[15]  Biswajeet Pradhan,et al.  Integration of Ant Colony Optimization and Object-Based Analysis for LiDAR Data Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Ting Zhu,et al.  Convolutional Neural Network Trained by Joint Loss for Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[17]  Jihao Yin,et al.  Hyperspectral Image Classification Using CapsNet With Well-Initialized Shallow Layers , 2019, IEEE Geoscience and Remote Sensing Letters.

[18]  Pedram Ghamisi,et al.  LiDAR Data Classification Using Extinction Profiles and a Composite Kernel Support Vector Machine , 2017, IEEE Geoscience and Remote Sensing Letters.

[19]  Juha Hyyppä,et al.  Object-based analysis of multispectral airborne laser scanner data for land cover classification and map updating , 2017 .

[20]  Yuan Yan Tang,et al.  Spectral–Spatial Graph Convolutional Networks for Semisupervised Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[21]  Hao Xia,et al.  Land Cover Classification Using Features Generated From Annual Time-Series Landsat Data , 2018, IEEE Geoscience and Remote Sensing Letters.

[22]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[23]  Shaowen Wang,et al.  A 3D convolutional neural network method for land cover classification using LiDAR and multi-temporal Landsat imagery , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[24]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[25]  Jungho Im,et al.  Convolutional Neural Network-Based Land Cover Classification Using 2-D Spectral Reflectance Curve Graphs With Multitemporal Satellite Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Ahmed El-Rabbany,et al.  Using multispectral airborne LiDAR data for land/water discrimination: a case study at Lake Ontario, Canada , 2018 .

[27]  Yanfeng Gu,et al.  Discriminative Graph-Based Fusion of HSI and LiDAR Data for Urban Area Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[28]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[29]  Ruofei Zhong,et al.  A Bayesian-Network-Based Classification Method Integrating Airborne LiDAR Data With Optical Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Wenwen Li,et al.  A Geographic Object-Based Approach for Land Classification Using LiDAR Elevation and Intensity , 2017, IEEE Geoscience and Remote Sensing Letters.

[31]  Peijun Du,et al.  Multisource Earth Observation Data for Land-Cover Classification Using Random Forest , 2018, IEEE Geoscience and Remote Sensing Letters.