DGPF-RENet: A Low Data Dependence Network With Low Training Iterations for Hyperspectral Image Classification

The classification of ground objects from hyperspectral images (HSIs) is of great importance for human perception of information about the terrain and landscape. HSIs have numerous dimensions, and obtaining the data is difficult. The issue of slow convergence of neural network training is brought on by high-dimensional data, and the neural network’s performance is impacted by the challenging data acquisition process. In order to achieve the effects of low data dependence and rapid convergence, we propose a redundancy elimination network architecture with a decoupled-gaze attention mechanism and phantom fractal modules (DGPF-RENet) for HSI classification. First, we propose the decoupled-gaze attention (DGA) mechanism to make full use of the correlation between adjacent bands and the continuity of neighboring pixels in HSIs. Then, a redundancy elimination module (REM) is proposed to reduce the number of feature points and eliminate redundant information while preserving the contextual information and relationships between pixels. Finally, the phantom fractal module (PFM) is proposed, which improves the scale of feature learning by fractalizing convolutions at multiple scales. Four publicly available HSIs datasets, including Indian Pines, Salinas, DFC2018, and WHUHi-HongHu, were used in our experiments. According to experimental findings, compared to other state-of-the-art methods, our method performs best with a small number of training samples and few iterations. We have released our code and models at https://github.com/yuhua666/DGPF-RENet.

[1]  D. Hong,et al.  Multi-scale receptive fields: Graph attention neural network for hyperspectral image classification , 2023, Expert Syst. Appl..

[2]  Bo Du,et al.  From center to surrounding: An interactive learning framework for hyperspectral image classification , 2023, ISPRS Journal of Photogrammetry and Remote Sensing.

[3]  Y. Qian,et al.  Incorporating Attention Mechanism And Graph Regularization Into Cnns For Hyperspectral Image Classification , 2022, 2022 12th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[4]  Trevor Darrell,et al.  A ConvNet for the 2020s , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Weiwei Cai,et al.  Fast forest fire smoke detection using MVMNet , 2022, Knowl. Based Syst..

[6]  Mingfang He,et al.  Multi-scale Sparse Network with Cross-Attention Mechanism for image-based butterflies fine-grained classification , 2022, Appl. Soft Comput..

[7]  Guangbo Ren,et al.  A simple and effective spectral-spatial method for mapping large-scale coastal wetlands using China ZY1-02D satellite hyperspectral images , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[8]  Weiwei Cai,et al.  PDAM-STPNNet: A Small Target Detection Approach for Wildland Fire Smoke through Remote Sensing Images , 2021, Symmetry.

[9]  Zhanguo Wei,et al.  Residual-capsule networks with threshold convolution for segmentation of wheat plantation rows in UAV images , 2021, Multimedia Tools and Applications.

[10]  Caihong Mu,et al.  A Multi-Branch Network based on Weight Sharing and Attention Mechanism for Hyperspectral Image Classification , 2021, 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS.

[11]  Lianru Gao,et al.  SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Yingda Xia,et al.  Glance-and-Gaze Vision Transformer , 2021, NeurIPS.

[13]  Qiong Ran,et al.  Hyperspectral and Infrared Image Collaborative Classification Based on Morphology Feature Extraction , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Matthijs Douze,et al.  LeViT: a Vision Transformer in ConvNet’s Clothing for Faster Inference , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Seong Joon Oh,et al.  Rethinking Spatial Dimensions of Vision Transformers , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  Zhaohui Xue,et al.  Attention-Based Second-Order Pooling Network for Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[17]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[18]  Marina Cocchi,et al.  Exploring local spatial features in hyperspectral images , 2020 .

[19]  Yi Shen,et al.  Spatial Revising Variational Autoencoder-Based Feature Extraction Method for Hyperspectral Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Zewen Li,et al.  A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Yong Xiao,et al.  CSA-MSO3DCNN: Multiscale Octave 3D CNN with Channel and Spatial Attention for Hyperspectral Image Classification , 2020, Remote. Sens..

[22]  Yang Yang,et al.  Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network , 2019, Remote. Sens..

[23]  D Yu Vasin,et al.  Elimination of information redundancy of hyperspectral images using the “well-adapted” basis method , 2019, Journal of Physics: Conference Series.

[24]  Peter Caccetta,et al.  ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[25]  Amir Mosavi,et al.  Deep Learning: A Review , 2018 .

[26]  Wenju Wang,et al.  A Fast Dense Spectral-Spatial Convolution Network Framework for Hyperspectral Images Classification , 2018, Remote. Sens..

[27]  Patrick Lambert,et al.  3-D Deep Learning Approach for Remote Sensing Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Bing Liu,et al.  Supervised Deep Feature Extraction for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jun Li,et al.  Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Shutao Li,et al.  Extinction Profiles Fusion for Hyperspectral Images Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Suhad Lateef Al-khafaji,et al.  Spectral-Spatial Scale Invariant Feature Transform for Hyperspectral Images , 2018, IEEE Transactions on Image Processing.

[32]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[34]  Shutao Li,et al.  From Subpixel to Superpixel: A Novel Fusion Framework for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Luc Van Gool,et al.  Hyperspectral CNN for image classification & band selection, with application to face recognition , 2016 .

[36]  Jon Atli Benediktsson,et al.  Probabilistic Fusion of Pixel-Level and Superpixel-Level Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Jiayi Ma,et al.  Hyperspectral Image Classification With Robust Sparse Representation , 2016, IEEE Geoscience and Remote Sensing Letters.

[39]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Karl Staenz,et al.  Summary of current and future terrestrial civilian hyperspectral spaceborne systems , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[41]  Tsehaie Woldai,et al.  Multi- and hyperspectral geologic remote sensing: A review , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[42]  Pao-Ta Yu,et al.  A Dynamic Subspace Method for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Menghua Wang,et al.  Uncertainties in satellite remote sensing of aerosols and impact on monitoring its long-term trend: a review and perspective , 2009 .

[44]  M. Borengasser,et al.  Hyperspectral Remote Sensing: Principles and Applications , 2007 .

[45]  Menghua Wang,et al.  The NIR-SWIR combined atmospheric correction approach for MODIS ocean color data processing. , 2007, Optics express.

[46]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[47]  J. A. Gualtieri,et al.  Support vector machines for hyperspectral remote sensing classification , 1999, Other Conferences.

[48]  Pengjiang Qian,et al.  A Novel Hyperspectral Image Classification Model Using Bole Convolution With Three-Direction Attention Mechanism: Small Sample and Unbalanced Learning , 2023, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Yicong Zhou,et al.  Hyperspectral Image Transformer Classification Networks , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Jiangtao Peng,et al.  Generalized Linear Spectral Mixing Model for Spatial–Temporal–Spectral Fusion , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Shou Feng,et al.  Multiscale Short and Long Range Graph Convolutional Network for Hyperspectral Image Classification , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Hong Huang,et al.  Aggregated-Attention Transformation Network for Hyperspectral Image Classification , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[53]  Jiangtao Peng,et al.  Mapping Coastal Wetlands Using Transformer in Transformer Deep Network on China ZY1-02D Hyperspectral Satellite Images , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[54]  Hong Huang,et al.  Semisupervised Spatial-Spectral Feature Extraction With Attention Mechanism for Hyperspectral Image Classification , 2022, IEEE Geoscience and Remote Sensing Letters.

[55]  Xin Ning,et al.  Hybrid Dilated Convolution Guided Feature Filtering and Enhancement Strategy for Hyperspectral Image Classification , 2022, IEEE Geoscience and Remote Sensing Letters.

[56]  Yushi Chen,et al.  Modifications of the Multi-Layer Perceptron for Hyperspectral Image Classification , 2021, Remote. Sens..

[57]  Hong Li,et al.  Deep High-order Tensor Convolutional Sparse Coding for Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[58]  M. Weiss,et al.  Remote sensing for agricultural applications: A meta-review , 2020 .

[59]  A. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[60]  S. Leblanc,et al.  A Shortwave Infrared Modification to the Simple Ratio for LAI Retrieval in Boreal Forests: An Image and Model Analysis , 2000 .