A Spatial Compositional Model for Linear Unmixing and Endmember Uncertainty Estimation

The normal compositional model (NCM) has been extensively used in hyperspectral unmixing. However, previous research has mostly focused on the estimation of endmembers and/or their variability, based on the assumption that the pixels are independent random variables. In this paper, we show that this assumption does not hold if all the pixels are generated by a fixed endmember set. This introduces another concept, endmember uncertainty, which is related to whether the pixels fit into the endmember simplex. To further develop this idea, we derive the NCM from the ground up without the pixel independence assumption, along with: 1) using different noise levels at different wavelengths and 2) using a spatial and sparsity promoting prior for the abundances. The resulting new formulation is called the spatial compositional model (SCM) to better differentiate it from the NCM. The SCM maximum a posteriori objective leads to an optimization problem featuring Noise-weighted least-squares minimization for unmixing. The problem is solved by projected gradient descent, resulting in an algorithm that estimates endmembers, abundances, noise variances, and endmember uncertainty simultaneously. We compared SCM with current state-of-the-art algorithms on synthetic and real images. The results show that SCM can, in the main, provide more accurate endmembers and abundances. Moreover, the estimated uncertainty can serve as a prediction of endmember error under certain conditions.

[1]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[2]  R. E. Roger Principal Components transform with simple, automatic noise adjustment , 1996 .

[3]  Paul D. Gader,et al.  Sampling Piecewise Convex Unmixing and Endmember Extraction , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Qian Du,et al.  A Comparative Study on Linear Regression-Based Noise Estimation for Hyperspectral Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Paul D. Gader,et al.  Piecewise Convex Multiple-Model Endmember Detection and Spectral Unmixing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Paul D. Gader,et al.  A spatial compositional model for linear unmixing , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[7]  Xuelong Li,et al.  Manifold Regularized Sparse NMF for Hyperspectral Unmixing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Jean-Yves Tourneret,et al.  Bayesian Estimation of Linear Mixtures Using the Normal Compositional Model. Application to Hyperspectral Imagery , 2010, IEEE Transactions on Image Processing.

[10]  Gaofeng Meng,et al.  Spectral Unmixing via Data-Guided Sparsity , 2014, IEEE Transactions on Image Processing.

[11]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[12]  Jean-Yves Tourneret,et al.  Enhancing Hyperspectral Image Unmixing With Spatial Correlations , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[14]  John F. Arnold,et al.  Reliably estimating the noise in AVIRIS hyperspectral images , 1996 .

[15]  D. Harville Matrix Algebra From a Statistician's Perspective , 1998 .

[16]  Andreas T. Ernst,et al.  ICE: a statistical approach to identifying endmembers in hyperspectral images , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Hairong Qi,et al.  Endmember Extraction From Highly Mixed Data Using Minimum Volume Constrained Nonnegative Matrix Factorization , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[19]  Jean-Yves Tourneret,et al.  Estimating the Number of Endmembers in Hyperspectral Images Using the Normal Compositional Model and a Hierarchical Bayesian Algorithm , 2010, IEEE Journal of Selected Topics in Signal Processing.

[20]  K. C. Ho,et al.  Endmember Variability in Hyperspectral Analysis: Addressing Spectral Variability During Spectral Unmixing , 2014, IEEE Signal Processing Magazine.

[21]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Qian Du,et al.  PSO-EM: A Hyperspectral Unmixing Algorithm Based On Normal Compositional Model , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Zhigang Luo,et al.  Manifold Regularized Discriminative Nonnegative Matrix Factorization With Fast Gradient Descent , 2011, IEEE Transactions on Image Processing.

[24]  Paul D. Gader,et al.  PCE: Piecewise Convex Endmember Detection , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[25]  D. Stein,et al.  Application of the normal compositional model to the analysis of hyperspectral imagery , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[26]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[27]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Chunxia Zhang,et al.  Enhancing Spectral Unmixing by Local Neighborhood Weights , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Jun Zhou,et al.  Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[30]  William W. Hager,et al.  The Gradient Projection Method with Exact Line Search , 2004, J. Glob. Optim..

[31]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[32]  Jérôme Malick,et al.  Projection-like Retractions on Matrix Manifolds , 2012, SIAM J. Optim..

[33]  S. Hook,et al.  The ASTER spectral library version 2.0 , 2009 .

[34]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Khalide Jbilou,et al.  Block Krylov Subspace Methods for Solving Large Sylvester Equations , 2002, Numerical Algorithms.

[36]  Tongxing Lu,et al.  Solution of the matrix equation AX−XB=C , 2005, Computing.

[37]  HeXiaofei,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2011 .

[38]  Alfonso Fernández-Manso,et al.  Spectral unmixing , 2012 .

[39]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .