Global Consistent Graph Convolutional Network for Hyperspectral Image Classification

While semisupervised methods based on graph convolutional networks (GCNs) can achieve good results in hyperspectral image (HSI) classification, their performance is limited as they rely only on spatial–spectral similarity when constructing local adjacency graphs. Moreover, relying on local adjacency graphs can limit the ability of the methods to ensure the consistency of global feature in complex hyperspectral remote sensing environments. Using the spatial–spectral information is typically not sufficient for providing a reliable similarity measurement to construct a global graph when the spectral variability is large and the spatial distance is long in intraclass pixels. To address this issue, this article presents a novel globally consistent GCN (GCGCN) for HSI classification. According to the proposed method, a local reliable initial graph is first built from inherent spatial–spectral information by considering this graph as a variable to optimize. Then, adaptive global high-order neighbors are explored to capture the underlying rich spatial contextual information by utilizing the graph topological consistent connectivity instead of the common strategy of using only the spatial–spectral similarity measurement. Finally, the adaptive global high-order graph structure and two-layer networks are combined to achieve the global feature smoothing of the same class samples and maintain high global feature consistency. The proposed GCGCN method is evaluated on three real HSI data sets to demonstrate its superiority compared to ten different classification methods. Moreover, the proposed GCGCN method achieves state-of-the-art classification results on three data sets in terms of four classification evaluation metrics, including overall accuracy (OA), kappa coefficient (KC), average accuracy (AA), and class accuracy (CA).

[1]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Filiberto Pla,et al.  Capsule Networks for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Ke Wu,et al.  Semisupervised Classification Based on SLIC Segmentation for Hyperspectral Image , 2020, IEEE Geoscience and Remote Sensing Letters.

[5]  Kilian Q. Weinberger,et al.  Simplifying Graph Convolutional Networks , 2019, ICML.

[6]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[7]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Independent Component Discriminant Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[10]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[13]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[14]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification via Multiple-Feature-Based Adaptive Sparse Representation , 2017, IEEE Transactions on Instrumentation and Measurement.

[15]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[16]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[17]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[18]  Feng Zhou,et al.  Classification of Hyperspectral Images via Multitask Generative Adversarial Networks , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Chen Gong,et al.  Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network , 2019, IEEE Trans. Geosci. Remote. Sens..

[20]  Zhang Yi,et al.  Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering , 2012, IEEE Transactions on Cybernetics.

[21]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Shuvra S. Bhattacharyya,et al.  Hyperspectral Image Classification With Attention-Aided CNNs , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[24]  Xuelong Li,et al.  Quantifying and Detecting Collective Motion by Manifold Learning , 2017, AAAI.

[25]  Qingquan Li,et al.  Local Binary Pattern-Based Hyperspectral Image Classification With Superpixel Guidance , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[27]  Mingli Ding,et al.  Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[29]  Carola-Bibiane Schönlieb,et al.  Superpixel Contracted Graph-Based Learning for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Bing Zhang,et al.  Self-Supervised Low-Rank Representation (SSLRR) for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Fei Wang,et al.  Graph-based semi-supervised learning , 2009, Artificial Life and Robotics.

[32]  Feiping Nie,et al.  Clustering and projected clustering with adaptive neighbors , 2014, KDD.

[33]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Huchuan Lu,et al.  Hyperspectral Image Classification via JCR and SVM Models With Decision Fusion , 2016, IEEE Geoscience and Remote Sensing Letters.

[35]  Yonghui Zhang,et al.  Random Forest Ensemble for River Turbidity Measurement From Space Remote Sensing Data , 2020, IEEE Transactions on Instrumentation and Measurement.

[36]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Yue Gao,et al.  Hypergraph Neural Networks , 2018, AAAI.

[38]  Jun Li,et al.  Regional Clustering-Based Spatial Preprocessing for Hyperspectral Unmixing , 2018 .

[39]  Qi Wang,et al.  Adaptive Consistency Propagation Method for Graph Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[40]  Qian Du,et al.  Graph-Regularized Fast and Robust Principal Component Analysis for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[41]  F. Scarselli,et al.  A new model for learning in graph domains , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[42]  José Blasco,et al.  Characterization of a Multispectral Imaging System Based on Narrow Bandwidth Power LEDs , 2021, IEEE Transactions on Instrumentation and Measurement.

[43]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Antonio J. Plaza,et al.  Deep Pyramidal Residual Networks for Spectral–Spatial Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Yun Ding,et al.  Robust Spatial–Spectral Block-Diagonal Structure Representation With Fuzzy Class Probability for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[47]  Maurice Borgeaud,et al.  Kernel Low-Rank and Sparse Graph for Unsupervised and Semi-Supervised Classification of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[49]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[50]  Shutao Li,et al.  Hyperspectral Image Classification With Squeeze Multibias Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Chen Gong,et al.  Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[53]  Lianru Gao,et al.  A new kernel method for hyperspectral image feature extraction , 2017, Geo spatial Inf. Sci..

[54]  Yuan Yan Tang,et al.  Spectral–Spatial Graph Convolutional Networks for Semisupervised Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[55]  Ying Wang,et al.  Markov Random Fields Integrating Adaptive Interclass-Pair Penalty and Spectral Similarity for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Di Wang,et al.  Adaptive Spectral–Spatial Multiscale Contextual Feature Extraction for Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Bo Du,et al.  Spectral–Spatial Unified Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.