Kronecker least angle regression for unsupervised unmixing of hyperspectral imaging data

Spectral unmixing is an important data processing task that is commonly applied to hyperspectral imaging data. It uses a set of spectral pixels, i.e., multichannel data, to separate each spectral pixel, a multicomponent signal comprised of a linear mixture of pure spectral signatures, into its individual spectral signatures commonly known as endmembers. When no prior information about the required endmembers is available, the resulting unsupervised unmixing problem will be underdetermined, and additional constraints become necessary. A recent approach to solving this problem required that these endmembers be sparse in some dictionary. Sparse signal recovery is commonly solved using a basis pursuit optimization algorithm that requires specifying a data-dependent regularization parameter. Least angle regression (LARS) is a very efficient method to simultaneously solve the basis pursuit optimization problem for all relevant regularization parameter values. However, despite this efficiency of LARS, it has not been applied to the spectral unmixing problem before. This is likely because the application of LARS to large multichannel data could be very challenging in practice, due to the need for generation and storage of extremely large arrays (~ 10 10  bytes in a relatively small area of spectral unmixing problem). In this paper, we extend the standard LARS algorithm, using Kronecker products, to make it suitable for practical and efficient recovery of sparse signals from large multichannel data, i.e., without the need to construct or process very large arrays, or the need for trial and error to determine the regularization parameter value. We then apply this new Kronecker LARS (K-LARS) algorithm to successfully achieve spectral unmixing of both synthetic and AVIRIS hyperspectral imaging data. We also compare our results to ones obtained using an earlier basis pursuit -based spectral unmixing algorithm, generalized morphological component analysis (GMCA). We show that these two results are similar, albeit our results were obtained without trial and error, or arbitrary choices, in specifying the regularization parameter. More important, our K-LARS algorithm could be a very valuable research tool to the signal processing community, where it could be used to solve sparse least squares problems involving large multichannel data.

[1]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[2]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[3]  Radko Mesiar,et al.  Triangular norms. Position paper I: basic analytical and algebraic properties , 2004, Fuzzy Sets Syst..

[4]  Genady Grabarnik,et al.  Sparse Modeling: Theory, Algorithms, and Applications , 2014 .

[5]  Jun Zhou,et al.  Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Antonio J. Plaza,et al.  On the use of spectral libraries to perform sparse unmixing of hyperspectral data , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[7]  Jean-Yves Tourneret,et al.  Bayesian separation of spectral sources under non-negativity and full additivity constraints , 2009, Signal Process..

[8]  Andrzej Cichocki,et al.  Computing Sparse Representations of Multidimensional Signals Using Kronecker Bases , 2013, Neural Computation.

[9]  S. Mallat A wavelet tour of signal processing , 1998 .

[10]  Shengli Xie,et al.  Blind Spectral Unmixing Based on Sparse Nonnegative Matrix Factorization , 2011, IEEE Transactions on Image Processing.

[11]  Xiaorun Li,et al.  Blind nonlinear hyperspectral unmixing based on constrained kernel nonnegative matrix factorization , 2012, Signal, Image and Video Processing.

[12]  Dennis S. Bernstein,et al.  Matrix Mathematics: Theory, Facts, and Formulas with Application to Linear Systems Theory , 2005 .

[13]  Jérôme Bobin,et al.  Robust Sparse Blind Source Separation , 2015, IEEE Signal Processing Letters.

[14]  S. Osher,et al.  Coordinate descent optimization for l 1 minimization with application to compressed sensing; a greedy algorithm , 2009 .

[15]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[16]  Pierre Comon,et al.  Blind separation of sources, part II: Problems statement , 1991, Signal Process..

[17]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[18]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.

[19]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[20]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[21]  Jean-Luc Starck,et al.  Sparse and Non-Negative BSS for Noisy Data , 2013, IEEE Transactions on Signal Processing.

[22]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[23]  Antonio J. Plaza,et al.  Survey of geometric and statistical unmixing algorithms for hyperspectral images , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[24]  Namrata Dewangan,et al.  INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & MANAGEMENT IMAGE DENOISING USING WAVELET THRESHOLDING METHODS , 2012 .

[25]  Mohamed-Jalal Fadili,et al.  Sparsity and Morphological Diversity in Blind Source Separation , 2007, IEEE Transactions on Image Processing.

[26]  Le Wang,et al.  Incorporating spatial information in spectral unmixing: A review , 2014 .

[27]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Zhihui Wei,et al.  Sparse Non-negative Matrix Factorization on GPUs for Hyperspectral Unmixing , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Jun Zhou,et al.  Dual Graph Regularized NMF for Hyperspectral Unmixing , 2014, 2014 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[30]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[31]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[32]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Eric Truslow,et al.  Detection Algorithms in Hyperspectral Imaging Systems: An Overview of Practical Algorithms , 2014, IEEE Signal Processing Magazine.

[34]  Yuan Yan Tang,et al.  Hypergraph-Regularized Sparse NMF for Hyperspectral Unmixing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[36]  Justin K. Romberg,et al.  Dynamic Updating for $\ell_{1}$ Minimization , 2009, IEEE Journal of Selected Topics in Signal Processing.

[37]  Nasser M. Nasrabadi,et al.  Hyperspectral Target Detection : An Overview of Current and Future Challenges , 2014, IEEE Signal Processing Magazine.

[38]  N. Keshava,et al.  Distance metrics and band selection in hyperspectral processing with applications to material identification and spectral libraries , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[39]  F. Amiri,et al.  A sparsity-based Bayesian approach for hyperspectral unmixing using normal compositional model , 2018, Signal Image Video Process..