Spectral–spatial classification of hyperspectral remote sensing image based on capsule network

Hyperspectral image (HSI) classification is a hot topic in remote sensing community; many researchers have made a great deal of effort in this domain. Recently, deep learning-based manner paves a new way to better classification accuracy. However, the flow of information between layers and layers (e.g. max-pooling) in traditional deep architecture turns out to be ineffective. In this study, a novel spectral–spatial classification framework for HSI based on Capsule Network (CapsNet) and dynamic routing algorithm is introduced. The proposed architecture is composed of a hybrid of 1D and 2D convolutional layers and two capsule layers for better and effective mining and combining features. Consequently, experiments on two popular dataset indicate that CapsNet-based framework outperforms traditional CNN-based counterparts. Moreover, this study reveals great potential for CapsNet model in the field of HSI classification.

[1]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[3]  Wei Zhang,et al.  Potential of geosynchronous SAR interferometric measurements in estimating three-dimensional surface displacements , 2016, Science China Information Sciences.

[4]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[5]  Qiang Wang,et al.  Kernel Sparse Multitask Learning for Hyperspectral Image Classification With Empirical Mode Decomposition and Morphological Wavelet-Based Features , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Fabio Rocca,et al.  Options for continuous radar Earth observations , 2016, Science China Information Sciences.

[7]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Francisco Argüello,et al.  Spectral–Spatial Classification of Hyperspectral Images Using Wavelets and Extended Morphological Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[12]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Bor-Chen Kuo,et al.  Feature Mining for Hyperspectral Image Classification , 2013, Proceedings of the IEEE.

[14]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.