A Fast and Accurate Similarity-Constrained Subspace Clustering Algorithm for Hyperspectral Image

Accurate unsupervised classification of hyperspectral images (HSIs) is challenging and has drawn widespread attention in remote sensing due to its inherent complexity. Although significant efforts have been made to develop a variety of methods, most of them rely on supervised strategies. Subspace clustering methods, such as sparse subspace clustering (SSC), have become a popular tool for unsupervised learning due to their high performance. However, the computational complexity of SSC methods prevents their use on full HSIs. Furthermore, since SSC ignores the spatial information in the HSIs, its discrimination capability is limited, hampering the clustering results’ spatial homogeneity. To address these two relevant issues, in this article, we propose a fast algorithm that obtains a sparse representation coefficient matrix by first selecting a small set of pixels that best represent their neighborhood. Then, it performs spatial filtering to enforce the connectivity of neighboring pixels and uses fast spectral clustering to get the final clustering map. Extensive simulations with our proposed method demonstrate its effectiveness in unsupervised HSI classification, obtaining remarkable high clustering performance compared with state-of-the-art SSC-based algorithms and even novel unsupervised-deep-learning-based methods. Besides, the proposed method is up to three orders of magnitude faster than SSC when clustering more than $\text{2} \times \text{10}^4$ spectral pixels.

[1]  Rong Wang,et al.  Fast Spectral Clustering With Anchor Graph for Large Hyperspectral Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[2]  Antonio J. Plaza,et al.  A New Sparse Subspace Clustering Algorithm for Hyperspectral Remote Sensing Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[3]  Mohammad Rahmati,et al.  Scalable and Robust Sparse Subspace Clustering Using Randomized Clustering and Multilayer Graphs , 2018, Signal Process..

[4]  I. Renhorn,et al.  Military applications of hyperspectral imagery , 2006, SPIE Defense + Commercial Sensing.

[5]  Jorge Bacca,et al.  Spectral Imaging Subspace Clustering with 3-D Spatial Regularizer , 2018 .

[6]  Daniel P. Robinson,et al.  Scalable Sparse Subspace Clustering by Orthogonal Matching Pursuit , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Henry Arguello,et al.  Supervised spatio-spectral classification of fused images using superpixels. , 2019, Applied optics.

[8]  Gary A. Shaw,et al.  Spectral Imaging for Remote Sensing , 2003 .

[9]  W. Bewket,et al.  Model‐Based Characterization and Monitoring of Runoff and Soil Erosion in Response to Land Use/land Cover Changes in the Modjo Watershed, Ethiopia , 2015 .

[10]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[11]  Daniel P. Robinson,et al.  Oracle Based Active Set Algorithm for Scalable Elastic Net Subspace Clustering , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Liangpei Zhang,et al.  Spectral–Spatial Sparse Subspace Clustering for Hyperspectral Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Jorge Bacca,et al.  Kernel Sparse Subspace Clustering with Total Variation Denoising for Hyperspectral Remote Sensing Images , 2017 .

[14]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[15]  Ute Beyer,et al.  Remote Sensing And Image Interpretation , 2016 .

[16]  Akram Aldroubi,et al.  CUR Decompositions, Similarity Matrices, and Subspace Clustering , 2017, Front. Appl. Math. Stat..

[17]  Carlos Hinojosa,et al.  Hyperspectral image segmentation using 3D regularized subspace clustering model , 2021, Journal of Applied Remote Sensing.

[18]  Rong Wang,et al.  Scalable Graph-Based Clustering With Nonnegative Relaxation for Large Hyperspectral Image , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[20]  John R. Miller,et al.  Hyperspectral Data Segmentation and Classification in Precision Agriculture: A Multi-Scale Analysis , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Carlos Hinojosa,et al.  Spectral-Spatial Classification from Multi-Sensor Compressive Measurements Using Superpixels , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[22]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[23]  Zhengqin Li,et al.  Superpixel segmentation using Linear Spectral Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Alexander Kolesnikov,et al.  Revisiting Self-Supervised Visual Representation Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Yuantao Gu,et al.  Active Orthogonal Matching Pursuit for Sparse Subspace Clustering , 2018, IEEE Signal Processing Letters.

[26]  Jakub Nalepa,et al.  Unsupervised Feature Learning Using Recurrent Neural Nets for Segmenting Hyperspectral Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[27]  Liangpei Zhang,et al.  Kernel Sparse Subspace Clustering with a Spatial Max Pooling Operation for Hyperspectral Remote Sensing Data Interpretation , 2017, Remote. Sens..

[28]  Zhang Yi,et al.  Scalable Sparse Subspace Clustering , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Mercedes Eugenia Paoletti,et al.  Deep learning classifiers for hyperspectral imaging: A review , 2019 .

[30]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[31]  Michele Volpi,et al.  Semantic segmentation of urban scenes by learning local class interactions , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Aswin C. Sankaranarayanan,et al.  Greedy feature selection for subspace clustering , 2013, J. Mach. Learn. Res..

[33]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Richard I. Hartley,et al.  Graph connectivity in sparse subspace clustering , 2011, CVPR 2011.

[35]  Naoto Yokoya,et al.  Hyperspectral and Multispectral Data Fusion: A comparative review of the recent literature , 2017, IEEE Geoscience and Remote Sensing Magazine.

[36]  J. G. Lyon,et al.  Hyperspectral Remote Sensing of Vegetation , 2011 .

[37]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[38]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[39]  Daniel P. Robinson,et al.  Scalable Exemplar-based Subspace Clustering on Class-Imbalanced Data , 2018, European Conference on Computer Vision.

[40]  Feiping Nie,et al.  Spectral Clustering of Large-scale Data by Directly Solving Normalized Cut , 2018, KDD.

[41]  Carlos Hinojosa,et al.  Coded Aperture Design for Compressive Spectral Subspace Clustering , 2018, IEEE Journal of Selected Topics in Signal Processing.

[42]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[43]  Zhang Yi,et al.  Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering , 2012, IEEE Transactions on Cybernetics.

[44]  Yiwei Wei,et al.  The Fast Spectral Clustering Based on Spatial Information for Large Scale Hyperspectral Image , 2019, IEEE Access.

[45]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[46]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[47]  Hongyan Zhang,et al.  Semisupervised Sparse Subspace Clustering Method With a Joint Sparsity Constraint for Hyperspectral Remote Sensing Images , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[48]  David P. Williamson,et al.  The Design of Approximation Algorithms , 2011 .

[49]  Jakub Nalepa,et al.  Unsupervised Segmentation of Hyperspectral Images Using 3-D Convolutional Autoencoders , 2019, IEEE Geoscience and Remote Sensing Letters.

[50]  Akram Aldroubi,et al.  Similarity matrix framework for data from union of subspaces , 2017, Applied and Computational Harmonic Analysis.