Fast Constrained Least Squares Spectral Unmixing Using Primal-Dual Interior-Point Optimization

Hyperspectral data unmixing aims at identifying the components (endmembers) of an observed surface and at determining their fractional abundances inside each pixel area. Assuming that the spectral signatures of the surface components have been previously determined by an endmember extraction algorithm, or to be part of an available spectral library, the main problem is reduced to the estimation of the fractional abundances. For large hyperspectral image data sets, the estimation of the abundance maps requires the resolution of a large-scale optimization problem subject to linear constraints such as non-negativity and sum less or equal to one. This paper proposes a primal-dual interior-point optimization algorithm allowing a constrained least squares estimation approach. In comparison with existing methods, the proposed algorithm is more flexible since it can handle any linear equality and/or inequality constraint and has the advantage of a reduced computational cost. It also presents an algorithmic structure suitable for a parallel implementation on modern intensive computing devices such as Graphics Processing Units (GPU). The implementation issues are discussed and the applicability of the proposed approach is illustrated with the help of examples on synthetic and real hyperspectral data.

[1]  Jérôme Idier,et al.  Convex half-quadratic criteria and interacting auxiliary variables for image restoration , 2001, IEEE Trans. Image Process..

[2]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[3]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[4]  Paul Honeine,et al.  Geometric Unmixing of Large Hyperspectral Images: A Barycentric Coordinate Approach , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[5]  R. Bro,et al.  A fast non‐negativity‐constrained least squares algorithm , 1997 .

[6]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[7]  Rob Heylen,et al.  Fully Constrained Least Squares Spectral Unmixing by Simplex Projection , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Chein-I Chang,et al.  Semi-Supervised Linear Spectral Unmixing Using a Hierarchical Bayesian Model for Hyperspectral Imagery , 2008, IEEE Transactions on Signal Processing.

[9]  J. Settle,et al.  Linear mixing and the estimation of ground cover proportions , 1993 .

[10]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Émilie Chouzenoux,et al.  Primal dual interior point optimization for penalized least squares estimation of abundance maps in hyperspectral imaging , 2012, 2012 4th Workshop on Hyperspectral Image and Signal Processing (WHISPERS).

[12]  Bin Luo,et al.  Empirical Automatic Estimation of the Number of Endmembers in Hyperspectral Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[13]  P. Armand,et al.  A Feasible BFGS Interior Point Algorithm for Solving Strongly Convex Minimization Problems , 1999 .

[14]  Antonio J. Plaza,et al.  Parallel Hyperspectral Image and Signal Processing [Applications Corner] , 2011, IEEE Signal Processing Magazine.

[15]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[16]  Chein-I. Chang Spectral information divergence for hyperspectral image analysis , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[17]  Jean-Yves Tourneret,et al.  Bayesian separation of spectral sources under non-negativity and full additivity constraints , 2009, Signal Process..

[18]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[20]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  T. Tsuchiya,et al.  On the formulation and theory of the Newton interior-point method for nonlinear programming , 1996 .

[22]  Anders Forsgren,et al.  Interior Methods for Nonlinear Optimization , 2002, SIAM Rev..

[23]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[24]  Ariela Sofer,et al.  Interior-point methodology for 3-D PET reconstruction , 2000, IEEE Transactions on Medical Imaging.

[25]  Lisa R. Gaddis,et al.  Decomposition of AVIRIS spectra: extraction of surface-reflectance, atmospheric, and instrumental components , 1996, IEEE Trans. Geosci. Remote. Sens..

[26]  Olivier Caspary,et al.  The source number estimation based on Gerschgorin radii , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[27]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[28]  Antonio J. Plaza,et al.  FPGA Implementation of Abundance Estimation for Spectral Unmixing of Hyperspectral Data Using the Image Space Reconstruction Algorithm , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Alfonso Fernández-Manso,et al.  Spectral unmixing , 2012 .

[30]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jie Cheng,et al.  Programming Massively Parallel Processors. A Hands-on Approach , 2010, Scalable Comput. Pract. Exp..

[32]  Antonio J. Plaza,et al.  A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Chein-I. Chang,et al.  An improved N-FINDR algorithm in implementation , 2005 .

[34]  C. Loan The ubiquitous Kronecker product , 2000 .

[35]  Jon Atli Benediktsson,et al.  On the decomposition of Mars hyperspectral data by ICA and Bayesian positive source separation , 2008, Neurocomputing.

[36]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Antonio J. Plaza,et al.  Parallel unmixing of remotely sensed hyperspectral images on commodity graphics processing units , 2011, Concurr. Comput. Pract. Exp..

[38]  Thomas Serafini,et al.  Non-negatively constrained image deblurring with an inexact interior point method , 2009, J. Comput. Appl. Math..

[39]  John R. Schott,et al.  Remote Sensing: The Image Chain Approach , 1996 .

[40]  Margaret H. Wright,et al.  Interior methods for constrained optimization , 1992, Acta Numerica.

[41]  R. Clark,et al.  The U. S. Geological Survey, Digital Spectral Library: Version 1 (0.2 to 3.0um) , 1993 .

[42]  Chein-I Chang,et al.  Hyperspectral Data Exploitation , 2007 .

[43]  Mireille Guillaume,et al.  Minimum Dispersion Constrained Nonnegative Matrix Factorization to Unmix Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Margaret H. Wright,et al.  Some properties of the Hessian of the logarithmic barrier function , 1994, Math. Program..

[45]  Margaret H. Wright,et al.  Ill-Conditioning and Computational Error in Interior Methods for Nonlinear Programming , 1998, SIAM J. Optim..

[46]  Stephen J. Wright,et al.  Primal-Dual Interior-Point Methods , 1997 .

[47]  Paul Armand,et al.  A Feasible BFGS Interior Point Algorithm for Solving Convex Minimization Problems , 2000, SIAM J. Optim..