Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network

In hyperspectral image (HSI) classification, spatial context has demonstrated its significance in achieving promising performance. However, conventional spatial context-based methods simply assume that spatially neighboring pixels should correspond to the same land-cover class, so they often fail to correctly discover the contextual relations among pixels in complex situations, and thus leading to imperfect classification results on some irregular or inhomogeneous regions such as class boundaries. To address this deficiency, we develop a new HSI classification method based on the recently proposed Graph Convolutional Network (GCN), as it can flexibly encode the relations among arbitrarily structured non-Euclidean data. Different from traditional GCN, there are two novel strategies adopted by our method to further exploit the contextual relations for accurate HSI classification. First, since the receptive field of traditional GCN is often limited to fairly small neighborhood, we proposed to capture long range contextual relations in HSI by performing successive graph convolutions on a learned region-induced graph which is transformed from the original 2D image grids. Second, we refine the graph edge weight and the connective relationships among image regions by learning the improved adjacency matrix and the 'edge filter', so that the graph can be gradually refined to adapt to the representations generated by each graph convolutional layer. Such updated graph will in turn result in accurate region representations, and vice versa. The experiments carried out on three real-world benchmark datasets demonstrate that the proposed method yields significant improvement in the classification performance when compared with some state-of-the-art approaches.

[1]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[3]  Yuan Yan Tang,et al.  Spectral–Spatial Graph Convolutional Networks for Semisupervised Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[4]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[5]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[6]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[7]  Deyu Meng,et al.  Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network , 2017, IEEE Transactions on Image Processing.

[8]  Chu-Song Chen,et al.  Linear Spectral Mixture Analysis via Multiple-Kernel Learning for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[10]  Shutao Li,et al.  Novel Two-Dimensional Singular Spectrum Analysis for Effective Feature Extraction and Data Classification in Hyperspectral Imaging , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Liangpei Zhang,et al.  An Adaptive Mean-Shift Analysis Approach for Object Extraction and Classification From Urban Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Chen Gong,et al.  Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Abhinav Gupta,et al.  Beyond Grids: Learning Graph Representations for Visual Recognition , 2018, NeurIPS.

[14]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Independent Component Discriminant Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Yang Lu,et al.  Hyperspectral Image Classification Based on Three-Dimensional Scattering Wavelet Transform , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[17]  Ruoyu Li,et al.  Adaptive Graph Convolutional Neural Networks , 2018, AAAI.

[18]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[19]  M. Mirmehdi,et al.  TEXEMS: Texture Exemplars for Defect Detection on Random Textured Surfaces , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Jiankun Hu,et al.  Superpixel-Based Graphical Model for Remote Sensing Image Mapping , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jon Atli Benediktsson,et al.  Multiple Feature Learning for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Naoto Yokoya,et al.  Hyperspectral Tree Species Classification of Japanese Complex Mixed Forest With the Aid of Lidar Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  V. Robinson,et al.  Texture augmented detection of macrophyte species using decision trees , 2013 .

[25]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Yang Xu,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Low-Rank Decomposition , 2015, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[27]  Peijun Du,et al.  Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Gabriele Moser,et al.  Combining Support Vector Machines and Markov Random Fields in an Integrated Framework for Contextual Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Yicong Zhou,et al.  Region-Kernel-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Yicong Zhou,et al.  Extreme Learning Machine With Composite Kernels for Hyperspectral Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Moussa Sofiane Karoui,et al.  Improving Hyperspectral Image Classification by Combining Spectral and Multiband Compact Texture Features , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[32]  Jon Atli Benediktsson,et al.  A Novel Technique for Optimal Feature Selection in Attribute Profiles Based on Genetic Algorithms , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Raymond Y. K. Lau,et al.  Hyperspectral Image Classification With Deep Learning Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[35]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[36]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[38]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Dong-Chen He,et al.  Multiband compact texture unit descriptor for intra-band and inter-band texture analysis , 2015 .

[40]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[41]  Huchuan Lu,et al.  Hyperspectral Image Classification via JCR and SVM Models With Decision Fusion , 2016, IEEE Geoscience and Remote Sensing Letters.

[42]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[43]  Yuan Yan Tang,et al.  Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images , 2019, IEEE Transactions on Cybernetics.

[44]  Yang Wang,et al.  A Dynamic Hidden Markov Random Field Model for Foreground and Shadow Segmentation , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[45]  Yanpeng Li,et al.  Improving deep neural networks using softplus units , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[46]  Dacheng Tao,et al.  Deformed Graph Laplacian for Semisupervised Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Yi Ma,et al.  Superpixel-Based Extended Random Walker for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Zhengyang Wang,et al.  Large-Scale Learnable Graph Convolutional Networks , 2018, KDD.

[49]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[50]  R. Kettig,et al.  Classification of Multispectral Image Data by Extraction and Classification of Homogeneous Objects , 1976, IEEE Transactions on Geoscience Electronics.

[51]  LinLin Shen,et al.  Three-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[53]  Ersin Yumer,et al.  Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Lianru Gao,et al.  Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[55]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Huan Liu,et al.  Relational learning via latent social dimensions , 2009, KDD.

[57]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[58]  Xuehai Zhou,et al.  Natural Language Processing Service Based on Stroke-Level Convolutional Networks for Chinese Text Classification , 2017, 2017 IEEE International Conference on Web Services (ICWS).

[59]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[60]  Liangpei Zhang,et al.  Efficient Superpixel-Level Multitask Joint Sparse Representation for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[62]  Jun Li,et al.  Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines , 2018, IEEE Transactions on Geoscience and Remote Sensing.