Exploiting Spatial-Spectral Feature for Hyperspectral Image Classification Based on 3-D CNN and Bi-LSTM

Hyperspectral remote sensing has been gaining more and more attention in recent years because of the rich spectral and spatial information contained in hyperspectral image (HSI). With the rapid development of deep learning, many deep learning methods have been applied to classify HSI. In the existing 3-D convolution methods, a widely used method is to project the original data into a low-dimensional subspace, so a small amount of the useful spectral information can be lost. To solve this problem, this paper propose a unified network framework using band grouping-based bidirectional long short-term memory (Bi-LSTM) network and 3-D convolutional neural network for HSI classification. In this framework, the issue of spectral feature extraction is considered as a sequence learning problem, and the Bi-LSTM as a spectral feature extractor is adopted to address it. To evaluate the performance of the proposed method, the Indian Pines remote sensing data sets are used for HSI classification experiments. The results demonstrate that the performance of proposed method is better than the state-of-the-art HSI classification methods.

[1]  Bo Du,et al.  Spectral–Spatial Unified Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  André Fenias Moiane,et al.  CLASS-BASED AFFINITY PROPAGATION FOR HYPERSPECTRAL IMAGE DIMENSIONALITY REDUCTION AND IMPROVEMENT OF MAXIMUM LIKELIHOOD CLASSIFICATION ACCURACY , 2019, Boletim de Ciências Geodésicas.

[4]  Bidyut Baran Chaudhuri,et al.  HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[5]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Peter W. T. Yuen,et al.  Endmember Learning with K-Means through SCD Model in Hyperspectral Scene Reconstructions , 2019, J. Imaging.

[7]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[8]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Bin Yong,et al.  Spectral-Similarity-Based Kernel of SVM for Hyperspectral Image Classification , 2020, Remote. Sens..

[10]  Zhou Guo,et al.  On combining multiscale deep learning features for the classification of hyperspectral remote sensing imagery , 2015 .

[11]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[12]  Pieter Abbeel,et al.  Variational Lossy Autoencoder , 2016, ICLR.

[13]  Mercedes Eugenia Paoletti,et al.  Deep learning classifiers for hyperspectral imaging: A review , 2019 .

[14]  Bidyut Baran Chaudhuri,et al.  LiSHT: Non-Parametric Linearly Scaled Hyperbolic Tangent Activation Function for Neural Networks , 2019, CVIP.

[15]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[16]  H. Ghassemian,et al.  Classification of hyperspectral and multispectral images by using fractal dimension of spectral response curve , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).