Superpixel Contracted Graph-Based Learning for Hyperspectral Image Classification

A central problem in hyperspectral image (HSI) classification is obtaining high classification accuracy when using a limited amount of labeled data. In this article we present a novel graph-based semi-supervised framework to tackle this problem. Our framework uses a superpixel approach, allowing it to define meaningful local regions in HSIs, which with high probability share the same classification label. We then extract spectral and spatial features from these regions and use them to produce a contracted weighted graph-representation, where each node represents a region rather than a pixel. The graph is then fed into a graph-based semi-supervised classifier which gives the final classification. We show that using superpixels in a graph representation is an effective tool for speeding up graphical classifiers applied to HSIs. We demonstrate through exhaustive quantitative and qualitative results that our proposed method produces accurate classifications when an incredibly small amount of labeled data is used. We show that our approach mitigates the major drawbacks of existing approaches, resulting in our approach outperforming several comparative state-of-the-art techniques.

[1]  P. W. Scott,et al.  Evaluation of hyperspectral remote sensing as a means of environmental monitoring in the St. Austell China clay (kaolin) region, Cornwall, UK , 2004 .

[2]  Antonio J. Plaza,et al.  A New Spatial–Spectral Feature Extraction Method for Hyperspectral Images Using Local Covariance Matrix Representation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Matthew J. Hoffman,et al.  Aerial Vehicle Tracking by Adaptive Fusion of Hyperspectral Likelihood Maps , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Nicholas Ayache,et al.  Geometric Means in a Novel Vector Space Structure on Symmetric Positive-Definite Matrices , 2007, SIAM J. Matrix Anal. Appl..

[5]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[6]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[7]  Carola-Bibiane Schönlieb,et al.  Peekaboo-Where are the Objects? Structure Adjusting Superpixels , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Gang Hua,et al.  Hyperspectral Image Classification Through Bilayer Graph-Based Learning , 2014, IEEE Transactions on Image Processing.

[10]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse Model , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Lin Zhu,et al.  Generative Adversarial Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[15]  Yi Ma,et al.  Superpixel-Based Extended Random Walker for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Stanley Osher,et al.  Unsupervised Classification in Hyperspectral Imagery With Nonlocal Total Variation and Primal-Dual Hybrid Gradient Algorithm , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Bo Du,et al.  Joint Sparse Representation and Multitask Learning for Hyperspectral Target Detection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Lorenzo Bruzzone,et al.  Transductive SVMs for semisupervised classification of hyperspectral data , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[20]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yanfeng Gu,et al.  Tensor Matched Subspace Detector for Hyperspectral Target Detection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Qingquan Li,et al.  Superpixel-Based Multitask Learning Framework for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Yong-Jin Liu,et al.  Manifold SLIC: A Fast Method to Compute Content-Sensitive Superpixels , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Nicolas Papadakis,et al.  Semi-Supervised Learning with Graphs: Covariance Based Superpixels For Hyperspectral Image Classification , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[26]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[27]  Matthias W. Seeger,et al.  Using the Nyström Method to Speed Up Kernel Machines , 2000, NIPS.

[28]  Jon Atli Benediktsson,et al.  Semisupervised Self-Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Arjuna Flenner,et al.  Diffuse Interface Models on Graphs for Classification of High Dimensional Data , 2012, SIAM Rev..

[30]  Giorgos Mallinis,et al.  On the Use of Unmanned Aerial Systems for Environmental Monitoring , 2018, Remote. Sens..

[31]  Tao Wang,et al.  Bio-Inspired Adaptive Hyperspectral Imaging for Real-Time Target Tracking , 2010, IEEE Sensors Journal.

[32]  G. Mercier,et al.  Support vector machines for hyperspectral image classification with spectral-based kernels , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[33]  Bastian Leibe,et al.  Superpixels: An evaluation of the state-of-the-art , 2016, Comput. Vis. Image Underst..

[34]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[35]  Bruce J. Tromberg,et al.  Face Recognition in Hyperspectral Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Dan Hu,et al.  Semisupervised Hyperspectral Image Classification Based on Generative Adversarial Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[37]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Jiasong Zhu,et al.  Cascade Superpixel Regularized Gabor Feature Fusion for Hyperspectral Image Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Jiasong Zhu,et al.  Collaborative Representation-Based Multiscale Superpixel Fusion for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Matthew J. Hoffman,et al.  Real-Time Vehicle Tracking in Aerial Video Using Hyperspectral Features , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[41]  Qingquan Li,et al.  Local Binary Pattern-Based Hyperspectral Image Classification With Superpixel Guidance , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[43]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[46]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.