A Dual Global-local Attention Network for Hyperspectral Band Selection

This paper proposes a dual global-local attention network (DGLAnet), which is an end-to-end unsupervised band selection method that fully utilizes spatial and spectral information in both global and local aspects. The DGLAnet assumes that band selection can be realized using the hyperspectral image (HSI) reconstruction process. First, the DGLAnet implements a dual attention module to obtain spatial-spectral and global-local features to reweight the HSI data. It adopts the bi-directional relations to grasp spatial and spectral features from a global perspective. Meanwhile, the DGLAnet extracts local features through max-pooling and mean-pooling, and then merges them via the convolution operation. Global-local features are utilized to learn attention to recalibrate the original data, and the reconstruction module is adopted to restore the original image from the reweighted HSI data. Finally, a proper band subset is selected by the constructed band evaluation index. Experiments on three hyperspectral data show that the DGLAnet outperforms other state-of-the-art methods and using all bands with a lower computational cost.

[1]  F. Dell’acqua,et al.  A Review of Unsupervised Band Selection Techniques: Land Cover Classification for Hyperspectral Earth Observation Data , 2021, IEEE Geoscience and Remote Sensing Magazine.

[2]  Qian Du,et al.  A Multiscale Spectral Features Graph Fusion Method for Hyperspectral Band Selection , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Lianru Gao,et al.  SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Quoc V. Le,et al.  CoAtNet: Marrying Convolution and Attention for All Data Sizes , 2021, NeurIPS.

[5]  Francesca Bovolo,et al.  Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Bo Du,et al.  Fully Contextual Network for Hyperspectral Scene Parsing , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[7]  J. Lan,et al.  A dense spatial–spectral attention network for hyperspectral image band selection , 2021 .

[8]  Kun Gao,et al.  Band Selection of Hyperspectral Images Using Attention-Based Autoencoders , 2021, IEEE Geoscience and Remote Sensing Letters.

[9]  R. Tao,et al.  Convolutional Neural Network for Coastal Wetland Classification in Hyperspectral Image , 2020, IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium.

[10]  Naoto Yokoya,et al.  More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Bhabatosh Chanda,et al.  DARecNet-BS: Unsupervised Dual-Attention Reconstruction Network for Hyperspectral Band Selection , 2020, IEEE Geoscience and Remote Sensing Letters.

[12]  Lianru Gao,et al.  Graph Convolutional Networks for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Qian Du,et al.  Efficient Deep Learning of Nonlocal Features for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Licheng Jiao,et al.  Convolutional Neural Network Based on Bandwise-Independent Convolution and Hard Thresholding for Hyperspectral Band Selection , 2020, IEEE Transactions on Cybernetics.

[15]  Zhijing Yang,et al.  MIMN-DPP: Maximum-information and minimum-noise determinantal point processes for unsupervised hyperspectral band selection , 2020, Pattern Recognit..

[16]  Haoyang Yu,et al.  Underwater Hyperspectral Target Detection with Band Selection , 2020, Remote. Sens..

[17]  Qian Du,et al.  Deep Latent Spectral Representation Learning-Based Hyperspectral Band Selection for Target Detection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Qian Du,et al.  Correntropy-Based Sparse Spectral Clustering for Hyperspectral Band Selection , 2020, IEEE Geoscience and Remote Sensing Letters.

[19]  Qian Du,et al.  Fast and Latent Low-Rank Subspace Clustering for Hyperspectral Band Selection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jun Zhou,et al.  Attend in Bands: Hyperspectral Band Weighting and Selection for Image Classification , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Qiang Li,et al.  Hyperspectral Band Selection via Adaptive Subspace Partition Strategy , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Weiwei Sun,et al.  A Hierarchical Classification Framework of Satellite Multispectral/Hyperspectral Images for Mapping Coastal Wetlands , 2019, Remote. Sens..

[23]  Jie Feng,et al.  Hyperspectral Band Selection Based On Ternary Weight Convolutional Neural Network , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Qian Du,et al.  Hyperspectral Band Selection: A Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[25]  Hong Huo,et al.  Global-Local Attention Network for Aerial Scene Classification , 2019, IEEE Access.

[26]  Xiaobo Liu,et al.  Unsupervised Hyperspectral Image Band Selection Based on Deep Subspace Clustering , 2019, IEEE Geoscience and Remote Sensing Letters.

[27]  Nicolas Audebert,et al.  Deep Learning for Classification of Hyperspectral Data: A Comparative Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[28]  Xiaobo Liu,et al.  BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Cuiling Lan,et al.  Relation-Aware Global Attention for Person Re-Identification , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Ming Yu,et al.  Spatial-Spectral Fusion Based on Conditional Random Fields for the Fine Classification of Crops in UAV-Borne Hyperspectral Remote Sensing Imagery , 2019, Remote. Sens..

[31]  Licheng Jiao,et al.  Hyperspectral Unmixing via Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[32]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[33]  Qi Wang,et al.  Optimal Clustering Framework for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Changzhe Jiao,et al.  Multiple Instance Hybrid Estimator for Hyperspectral Target Characterization and Sub-pixel Target Detection , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[35]  Wei Liu,et al.  A new hyperspectral band selection approach based on convolutional neural network , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[36]  Surv. Nathaniel Ibrahim,et al.  The Fast Changing Phase of Land Titling and Registration Using GIS Application and Its Benefits in Nasarawa State, Nigeria , 2016 .

[37]  Qi Wang,et al.  Dual-Clustering-Based Hyperspectral Band Selection by Contextual Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Wendy M. Calvin,et al.  Utilizing HyspIRI Prototype Data for Geological Exploration Applications: A Southern California Case Study , 2016 .

[39]  Licheng Jiao,et al.  Supervised Band Selection Using Local Spatial Information for Hyperspectral Image , 2016, IEEE Geoscience and Remote Sensing Letters.

[40]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[41]  Weiwei Sun,et al.  Band Selection Using Improved Sparse Subspace Clustering for Hyperspectral Imagery Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Kurt Prospere,et al.  Plant Species Discrimination in a Tropical Wetland Using In Situ Hyperspectral Data , 2014, Remote. Sens..

[43]  Yongchao Zhao,et al.  A Fast Volume-Gradient-Based Band Selection Method for Hyperspectral Image , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[45]  Mohamed Cheriet,et al.  Hyperspectral band selection based on graph clustering , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[46]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[47]  Lianru Gao,et al.  Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[48]  N. Nasrabadi,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Lianru Gao,et al.  Endmember Extraction of Hyperspectral Remote Sensing Images Based on the Ant Colony Optimization (ACO) Algorithm , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Simon J. Hook,et al.  HYDROTHERMAL FORMATION OF CLAY-CARBONATE ALTERATION ASSEMBLAGES IN THE , 2010, 1402.1150.

[51]  Qian Du,et al.  Similarity-Based Unsupervised Band Selection for Hyperspectral Image Analysis , 2008, IEEE Geoscience and Remote Sensing Letters.

[52]  Rick Archibald,et al.  Feature Selection and Classification of Hyperspectral Images With Support Vector Machines , 2007, IEEE Geoscience and Remote Sensing Letters.

[53]  Thomas Cudahy,et al.  Hyperspectral imaging spectroscopy of a Mars analogue environment at the North Pole Dome, Pilbara Craton, Western Australia , 2005, 1401.5201.

[54]  Vittorio E. Brando,et al.  Satellite hyperspectral remote sensing for estimating estuarine and coastal water quality , 2003, IEEE Trans. Geosci. Remote. Sens..

[55]  Meiping Song,et al.  Semisupervised Hyperspectral Band Selection Based on Dual-Constrained Low-Rank Representation , 2022, IEEE Geoscience and Remote Sensing Letters.

[56]  Julius Tschannerl,et al.  Novel Gumbel-Softmax Trick Enabled Concrete Autoencoder With Entropy Constraints for Unsupervised Hyperspectral Band Selection , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Xiaobo Liu,et al.  Nonlocal Band Attention Network for Hyperspectral Image Band Selection , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[58]  Hong Huang,et al.  Adaptive Residual Convolutional Neural Network for Hyperspectral Image Classification , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[61]  Peijun Du,et al.  A NEW BAND SELECTION ALGORITHM FOR HYPERSPECTRAL DATA BASED ON FRACTAL DIMENSION , 2008 .