Faster Multiscale Capsule Network With Octave Convolution for Hyperspectral Image Classification

Recently proposed capsule networks have revealed powerfulness in various visual tasks. However, the traditional CNNs adopted in the capsule layer of the capsule network have the problem of high parameter redundancy. In this letter, we propose a faster multiscale capsule network with octave convolution (MSOctCaps) for hyperspectral image classification. In the proposed MSOctCaps, we design multiple kernels of different sizes with parallel convolution to extract deep multiscale features. To feasibly reduce the redundancy of parameters and achieve high accuracy, the octave convolution is explored in the capsule layer, instead of the traditional convolution, which improves the accuracy of the capsule layer above predicted by the capsule layer below. The comparison experiments with six state-of-the-arts on two challenging contest data sets demonstrate the proposed MSOctCaps is able to produce competitive advantages in terms of both classification accuracy and computational time.

[1]  Xiao Xiang Zhu,et al.  Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Filiberto Pla,et al.  Capsule Networks for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Shuicheng Yan,et al.  Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[5]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Chein-I. Chang Hyperspectral Data Exploitation: Theory and Applications , 2007 .

[7]  Han Jiang,et al.  Deep residual networks for hyperspectral image classification , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[8]  Shutao Li,et al.  A CNN With Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Chen Xu,et al.  MS-CapsNet: A Novel Multi-Scale Capsule Network , 2018, IEEE Signal Processing Letters.

[11]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[12]  Rama Chellappa,et al.  Joint Sparse Representation for Robust Multimodal Biometrics Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Antonio J. Plaza,et al.  Deep&Dense Convolutional Neural Network for Hyperspectral Image Classification , 2018, Remote. Sens..

[14]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[15]  Qian Du,et al.  Hyperspectral Band Selection: A Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[16]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Qian Du,et al.  Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Ning Zhang,et al.  CoinNet: Copy Initialization Network for Multispectral Imagery Semantic Segmentation , 2019, IEEE Geoscience and Remote Sensing Letters.