A Stepwise Analytical Projected Gradient Descent Search for Hyperspectral Unmixing and Its Code Vectorization

We present, in this paper, a new methodology for spectral unmixing, where a vector of fractions, corresponding to a set of endmembers (EMs), is estimated for each pixel in the image. The process first provides an initial estimate of the fraction vector, followed by an iterative procedure that converges to an optimal solution. Specifically, projected gradient descent (PGD) optimization is applied to (a variant of) the spectral angle mapper objective function, so as to significantly reduce the estimation error due to amplitude (i.e., magnitude) variations in EM spectra, caused by the illumination change effect. To improve the computational efficiency of our method over a commonly used gradient descent technique, we have analytically derived the objective function’s gradient and the optimal step size (used in each iteration). To gain further improvement, we have implemented our unmixing module via code vectorization, where the entire process is “folded” into a single loop, and the fractions for all of the pixels are solved simultaneously. We call this new parallel scheme vectorized code PGD unmixing (VPGDU). VPGDU has the advantage of solving (simultaneously) an independent optimization problem per image pixel, exactly as other pixelwise algorithms, but significantly faster. Its performance was compared with the commonly used fully constrained least squares unmixing (FCLSU), the generalized bilinear model (GBM) method for hyperspectral unmixng, and the fast state-of-the-art methods, sparse unmixing by variable splitting and augmented Lagrangian (SUnSAL) and collaborative SUnSAL (CLSUnSAL) based on the alternating direction method of multipliers. Considering all of the prospective EMs of a scene at each pixel (i.e., without a priori knowledge which/how many EMs are actually present in a given pixel), we demonstrate that the accuracy due to VPGDU is considerably higher than that obtained by FCLSU, GBM, SUnSAL, and CLSUnSAL under varying illumination, and is, otherwise, comparable with respect to these methods. However, while our method is significantly faster than FCLSU and GBM, it is slower than SUnSAL and CLSUnSAL by roughly an order of magnitude.

[1]  Paul Honeine,et al.  A gradient based method for fully constrained least-squares unmixing of hyperspectral images , 2011, 2011 IEEE Statistical Signal Processing Workshop (SSP).

[2]  Brian Curtiss,et al.  A method for manual endmember selection and spectral unmixing , 1996 .

[3]  Liangpei Zhang,et al.  Sparsity-Regularized Robust Non-Negative Matrix Factorization for Hyperspectral Unmixing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Jiayi Ma,et al.  Hyperspectral Unmixing with Robust Collaborative Sparse Regression , 2016, Remote. Sens..

[6]  Johannes R. Sveinsson,et al.  Blind Hyperspectral Unmixing Using Total Variation and $\ell_q$ Sparse Regularization , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[7]  William W. Hager,et al.  The Gradient Projection Method with Exact Line Search , 2004, J. Glob. Optim..

[8]  Antonio J. Plaza,et al.  FPGA Implementation of the Pixel Purity Index Algorithm for Remotely Sensed Hyperspectral Image Analysis , 2010, EURASIP J. Adv. Signal Process..

[9]  E. Ashton,et al.  Algorithms for the Detection of Su b-Pixel Targets in Multispectral Imagery , 1998 .

[10]  Kin Keung Lai,et al.  Generalized Convexity and Vector Optimization , 2008 .

[11]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[12]  Jin Chen,et al.  Generalization of Subpixel Analysis for Hyperspectral Data With Flexibility in Spectral Similarity Measures , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Antonio J. Plaza,et al.  A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Paul D. Gader,et al.  A spatial compositional model (SCM) for linear unmixing and endmember uncertainty estimation , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[15]  Jean-Yves Tourneret,et al.  Nonlinear unmixing of hyperspectral images using a generalized bilinear model , 2011 .

[16]  Rob Heylen,et al.  Fully Constrained Least Squares Spectral Unmixing by Simplex Projection , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Imed Riadh Farah,et al.  A New Method to Change Illumination Effect Reduction Based on Spectral Angle Constraint for Hyperspectral Image Unmixing , 2011, IEEE Geoscience and Remote Sensing Letters.

[18]  Dimitri P. Bertsekas,et al.  Incremental Gradient, Subgradient, and Proximal Methods for Convex Optimization: A Survey , 2015, ArXiv.

[19]  Tal Svoray,et al.  Multidate adaptive unmixing and its application to analysis of ecosystem transitions along a climatic gradient , 2002 .

[20]  Naihua Xiu,et al.  Convergence of the Gradient Projection Method for Generalized Convex Minimization , 2000, Comput. Optim. Appl..

[21]  Fuan Tsai,et al.  Derivative Analysis of Hyperspectral Data , 1998 .

[22]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[23]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[24]  Yosio Edemir Shimabukuro,et al.  The least-squares mixing models to generate fraction images derived from remote sensing multispectral data , 1991, IEEE Trans. Geosci. Remote. Sens..

[25]  Antonio J. Plaza,et al.  Parallel implementation of the N-FINDR endmember extraction algorithm on commodity graphics processing units , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  I. Barrodale Best Rational Approximation and Strict Quasi-Convexity , 1973 .

[28]  J. Settle,et al.  Linear mixing and the estimation of ground cover proportions , 1993 .

[29]  Gary A. Shaw,et al.  Spectral Imaging for Remote Sensing , 2003 .

[30]  Angshul Majumdar,et al.  Hyperspectral Unmixing in the Presence of Mixed Noise Using Joint-Sparsity and Total Variation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Nathan S. Netanyahu,et al.  An Iterative Search in End-Member Fraction Space for Spectral Unmixing , 2011, IEEE Geoscience and Remote Sensing Letters.

[32]  Richard J. Murphy,et al.  Incorporating Spatial Information and Endmember Variability Into Unmixing Analyses to Improve Abundance Estimates , 2016, IEEE Transactions on Image Processing.

[33]  Liangpei Zhang,et al.  Adaptive Spatial Regularization Sparse Unmixing Strategy Based on Joint MAP for Hyperspectral Remote Sensing Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[35]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[36]  K. G. Murty,et al.  Convergence of the steepest descent method for minimizing quasiconvex functions , 1996 .

[37]  Yunmei Chen,et al.  Projection Onto A Simplex , 2011, 1101.6081.

[38]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[39]  Antonio J. Plaza,et al.  Survey of geometric and statistical unmixing algorithms for hyperspectral images , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[40]  Chein-I Chang,et al.  Real-Time Simplex Growing Algorithms for Hyperspectral Endmember Extraction , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Jean-Yves Tourneret,et al.  Supervised Nonlinear Spectral Unmixing Using a Postnonlinear Mixing Model for Hyperspectral Imagery , 2012, IEEE Transactions on Image Processing.

[42]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Boris Polyak,et al.  Constrained minimization methods , 1966 .

[44]  Chein-I Chang,et al.  A New Growing Method for Simplex-Based Endmember Extraction Algorithm , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Derek M. Rogge,et al.  Iterative Spectral Unmixing for Optimizing Per-Pixel Endmember Sets , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Joseph W. Boardman,et al.  Inversion of high spectral resolution data , 1990, Other Conferences.

[47]  Jean-Yves Tourneret,et al.  Linear unmixing of hyperspectral images using a scaled gradient method , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[48]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[49]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[50]  Nathan S. Netanyahu,et al.  Spatially adaptive hyperspectral unmixing based on sums of 2D Gaussians for modelling endmember fraction surfaces , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[51]  Mohamed-Jalal Fadili,et al.  A quasi-Newton proximal splitting method , 2012, NIPS.

[52]  Alfonso Fernández-Manso,et al.  Spectral unmixing , 2012 .

[53]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[54]  José M. Bioucas-Dias,et al.  Hyperspectral Unmixing Based on Mixtures of Dirichlet Components , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Qian Du,et al.  Foreword to the Special Issue on Spectral Unmixing of Remotely Sensed Data , 2011 .

[56]  Antonio J. Plaza,et al.  A New Minimum-Volume Enclosing Algorithm for Endmember Identification and Abundance Estimation in Hyperspectral Data , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Antonio J. Plaza,et al.  Collaborative Sparse Regression for Hyperspectral Unmixing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Kong,et al.  A NOTE ON THE GRADIENT PROJECTION METHOD WITH EXACT STEPSIZE RULE *1) , 2007 .

[59]  T. Kemper,et al.  A new tool for variable multiple endmember spectral mixture analysis (VMESMA) , 2005 .

[60]  Nirmal Keshava,et al.  A Survey of Spectral Unmixing Algorithms , 2003 .

[61]  A. Goldstein Convex programming in Hilbert space , 1964 .

[62]  Jean-Yves Tourneret,et al.  Unmixing hyperspectral images using the generalized bilinear model , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[63]  Paul D. Gader,et al.  A Spatial Compositional Model for Linear Unmixing and Endmember Uncertainty Estimation , 2015, IEEE Transactions on Image Processing.