Deep Feature Aggregation Network for Hyperspectral Remote Sensing Image Classification

Hyperspectral remote sensing images (HSIs) are rich in spectral–spatial information. The deep learning models can help to automatically extract and discover this rich information from HSIs for classifying HSIs. However, the sampling of the models and the design of the hyperparameters depend on the number of samples and the size of each sample's input space. In the case of limited samples, the description dimension of features is also limited and overfitting to other remote sensing image datasets is evident. This study proposes a novel deep feature aggregation network for HSI classification based on a 3-D convolutional neural network from the perspective of feature aggregation patterns. By introducing the residual learning and dense connectivity strategies, we established a deep feature residual network (DFRN) and a deep feature dense network (DFDN) to exploit the low-, middle-, and high-level features in HSIs. For the Indian Pines and Kennedy Space Center datasets, the DFRN model was determined to be more accurate. On the Pavia University dataset, both the DFDN and DFRN have basically the same accuracy, but the DFDN has faster convergence speed and more stable performance on the validation set than the DFRN. Therefore, when faced with different HSI data, the corresponding aggregation method can be chosen more flexibly according to the requirements on number of training samples and the convergence speed. This is beneficial in the HSI classification.

[1]  Wenju Wang,et al.  A Fast Dense Spectral-Spatial Convolution Network Framework for Hyperspectral Images Classification , 2018, Remote. Sens..

[2]  Shihong Du,et al.  Multi-Scale Dense Networks for Hyperspectral Remote Sensing Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Haokui Zhang,et al.  Hyperspectral Image Classification Based on 3-D Separable ResNet and Transfer Learning , 2019, IEEE Geoscience and Remote Sensing Letters.

[6]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[7]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[8]  Qian Du,et al.  Kernel Collaborative Representation With Local Correlation Features for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Serge J. Belongie,et al.  Residual Networks Behave Like Ensembles of Relatively Shallow Networks , 2016, NIPS.

[10]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Fei Gao,et al.  Three-dimensional densely connected convolutional network for hyperspectral remote sensing image classification , 2019, Journal of Applied Remote Sensing.

[12]  Shutao Li,et al.  Hyperspectral Image Classification With Deep Feature Fusion Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Qian Du,et al.  Multifeature Dictionary Learning for Collaborative Representation Classification of Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[17]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[18]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Yao Yu,et al.  Ensemble Learning for Hyperspectral Image Classification Using Tangent Collaborative Representation , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[22]  Jon Atli Benediktsson,et al.  A spatial-spectral kernel-based approach for the classification of remote-sensing images , 2012, Pattern Recognit..

[23]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[24]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[26]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[27]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Qian Du,et al.  Hyperspectral Band Selection Using Improved Firefly Algorithm , 2016, IEEE Geoscience and Remote Sensing Letters.

[29]  Felix Hueber,et al.  Hyperspectral Imaging Techniques For Spectral Detection And Classification , 2016 .

[30]  Anton van den Hengel,et al.  Wider or Deeper: Revisiting the ResNet Model for Visual Recognition , 2016, Pattern Recognit..

[31]  Liangpei Zhang,et al.  An Adaptive Artificial Immune Network for Supervised Classification of Multi-/Hyperspectral Remote Sensing Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[33]  Shanjun Mao,et al.  Spectral–spatial classification of hyperspectral images using deep convolutional neural networks , 2015 .

[34]  Ping Tan,et al.  Sparsely Connected Convolutional Networks , 2018, ArXiv.