Nonlinear Unsupervised Clustering of Hyperspectral Images with Applications to Anomaly Detection and Active Learning

The problem of unsupervised learning and segmentation of hyperspectral images is a significant challenge in remote sensing. The high dimensionality of hyperspectral data, presence of substantial noise, and overlap of classes all contribute to the difficulty of automatically clustering and segmenting hyperspectral images. In this article, we propose an unsupervised learning technique that combines a geometric estimation of class modes with a diffusion-inspired labeling that incorporates both spatial and spectral information. The mode estimation incorporates the geometry of the hyperspectral data by using diffusion distance to promote learning a unique mode from each class. These class modes are then used to label all points by a joint spatial-spectral nonlinear diffusion process. The proposed method, called spatial-spectral diffusion learning (DLSS), is shown to perform competitively against benchmark and state-of-the-art hyperspectral clustering methods on a variety of synthetic and real datasets. The proposed methods are shown to enjoy low computational complexity and fast empirical runtime. Two variations of the proposed method are also discussed. The first variation combines the proposed method of mode estimation with partial least squares regression (PLSR) to efficiently segment chemical plumes in hyperspectral images for anomaly detection. The second variation incorporates active learning to allow the user to request labels for a very small number of pixels, which can dramatically improve overall clustering results. Extensive experimental analysis demonstrate the efficacy of the proposed methods, and their robustness to choices of parameters.

[1]  Mauro Maggioni,et al.  Learning by Unsupervised Nonlinear Diffusion , 2018, J. Mach. Learn. Res..

[2]  Mauro Maggioni,et al.  Iterative active learning with diffusion geometry for hyperspectral images , 2018, 2018 9th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[3]  Shutao Li,et al.  PCA-Based Edge-Preserving Features for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Alice Koniges,et al.  Hyperspectral Image Classification Using Graph Clustering Methods , 2022 .

[5]  Xi Chen,et al.  Hyperspectral data clustering based on density analysis ensemble , 2017 .

[6]  Jon Atli Benediktsson,et al.  Hyperspectral Data Classification Using Extended Extinction Profiles , 2016, IEEE Geoscience and Remote Sensing Letters.

[7]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jiayi Ma,et al.  Hyperspectral Unmixing with Robust Collaborative Sparse Regression , 2016, Remote. Sens..

[9]  Julia A. Dobrosotskaya,et al.  Spatial-spectral operator theoretic methods for hyperspectral image classification , 2016 .

[10]  Stanley Osher,et al.  Unsupervised Classification in Hyperspectral Imagery With Nonlocal Total Variation and Primal-Dual Hybrid Gradient Algorithm , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Liangpei Zhang,et al.  Spectral–Spatial Sparse Subspace Clustering for Hyperspectral Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Wojciech Czaja,et al.  Fusion of aerial gamma-ray survey and remote sensing data for a deeper understanding of radionuclide fate after radiological incidents: examples from the Fukushima Dai-Ichi response , 2016, Journal of Radioanalytical and Nuclear Chemistry.

[13]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[14]  Qi Li,et al.  Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network Features , 2016, Remote. Sens..

[15]  Roy R. Lederman,et al.  Learning the geometry of common latent variables using alternating-diffusion , 2015 .

[16]  Guangliang Chen,et al.  High-Dimensional Data Modeling Techniques for Detection of Chemical Plumes and Anomalies in Hyperspectral Images and Movies , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Lorenzo Bruzzone,et al.  A Novel Active Learning Method in Relevance Feedback for Content-Based Remote Sensing Image Retrieval , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Ronald R. Coifman,et al.  Alternating diffusion for common manifold learning with application to sleep stage assessment , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Claude Cariou,et al.  Unsupervised Nearest Neighbors Clustering With Application to Hyperspectral Images , 2015, IEEE Journal of Selected Topics in Signal Processing.

[20]  Qian Du,et al.  Collaborative Representation for Hyperspectral Anomaly Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Thomas S. Huang,et al.  Spatial–Spectral Classification of Hyperspectral Images Using Discriminative Dictionary Designed by Learning Vector Quantization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Wojciech Czaja,et al.  Operator analysis and diffusion based embeddings for heterogeneous data fusion , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[23]  Wojciech Czaja,et al.  Schroedinger Eigenmaps with nondiagonal potentials for spatial-spectral clustering of hyperspectral imagery , 2014, Defense + Security Symposium.

[24]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Bin Yu,et al.  The geometry of kernelized spectral clustering , 2014, 1404.7552.

[26]  Bo Du,et al.  A Discriminative Metric Learning Based Anomaly Detection Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Nicolas Dobigeon,et al.  Nonlinear Hyperspectral Unmixing With Robust Nonnegative Matrix Factorization , 2014, IEEE Transactions on Image Processing.

[28]  André Stumpf,et al.  Active Learning in the Spatial Domain for Remote Sensing Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[29]  James E. Fowler,et al.  Nearest Regularized Subspace for Hyperspectral Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Larry A. Wasserman,et al.  Non‐parametric inference for density modes , 2013, ArXiv.

[31]  Nicolas Gillis,et al.  Hierarchical Clustering of Hyperspectral Images Using Rank-Two Nonnegative Matrix Factorization , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[34]  Guangliang Chen,et al.  A fast multiscale framework for data in high-dimensions: Measure estimation, anomaly detection, and compressive measurements , 2012, 2012 Visual Communications and Image Processing.

[35]  John J. Benedetto,et al.  Integration of heterogeneous data for classification in hyperspectral satellite imagery , 2012, Defense + Commercial Sensing.

[36]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[37]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  René Vidal,et al.  Sparse Manifold Clustering and Embedding , 2011, NIPS.

[39]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[40]  Cecilia Clementi,et al.  Polymer reversal rate calculated via locally scaled diffusion map. , 2011, The Journal of chemical physics.

[41]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[42]  M. Maggioni,et al.  Determination of reaction coordinates via locally scaled diffusion map. , 2011, The Journal of chemical physics.

[43]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[45]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[46]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Farid Melgani,et al.  Clustering of Hyperspectral Images Based on Multiobjective Particle Swarm Optimization , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[49]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[51]  R. Coifman,et al.  Non-linear independent component analysis with diffusion maps , 2008 .

[52]  Ronald R. Coifman,et al.  Diffusion Maps, Reduction Coordinates, and Low Dimensional Representation of Stochastic Systems , 2008, Multiscale Model. Simul..

[53]  Ronald R. Coifman,et al.  Regularization on Graphs with Function-adapted Diffusion Processes , 2008, J. Mach. Learn. Res..

[54]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[55]  Ronald R. Coifman,et al.  Data Fusion and Multicue Data Matching by Diffusion Maps , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Amit Banerjee,et al.  A support vector method for anomaly detection in hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[57]  John Langford,et al.  Cover trees for nearest neighbor , 2006, ICML.

[58]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[59]  B. Nadler,et al.  Diffusion maps, spectral clustering and reaction coordinates of dynamical systems , 2005, math/0503445.

[60]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[61]  Larry Wasserman,et al.  All of Statistics: A Concise Course in Statistical Inference , 2004 .

[62]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Marco Diani,et al.  An unsupervised algorithm for hyperspectral image segmentation based on the Gaussian mixture model , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[64]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[65]  E. M. Winter,et al.  Anomaly detection from hyperspectral imagery , 2002, IEEE Signal Process. Mag..

[66]  Gary A. Shaw,et al.  Hyperspectral subpixel target detection using the linear mixing model , 2001, IEEE Trans. Geosci. Remote. Sens..

[67]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[68]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[69]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[70]  Sanjoy Dasgupta,et al.  Experiments with Random Projection , 2000, UAI.

[71]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[72]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[73]  M. Banerjee,et al.  Beyond kappa: A review of interrater agreement measures , 1999 .

[74]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[75]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[77]  M. C. Jones,et al.  A reliable data-based bandwidth selection method for kernel density estimation , 1991 .

[78]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[79]  R. Sahoo,et al.  Hyperspectral Remote Sensing , 2013, Encyclopedia of Mathematical Geosciences.

[80]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[81]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[82]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[83]  Louis L. Scharf,et al.  Adaptive subspace detectors , 2001, IEEE Trans. Signal Process..

[84]  B. Kowalski,et al.  Partial least-squares regression: a tutorial , 1986 .

[85]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[86]  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS 1 Semisupervised Hyperspectral Image Classification Using Soft Spar , 2022 .