M-estimation for robust sparse unmixing of hyperspectral images

Hyperspectral unmixing methods often use a conventional least squares based lasso which assumes that the data follows the Gaussian distribution. The normality assumption is an approximation which is generally invalid for real imagery data. We consider a robust (non-Gaussian) approach to sparse spectral unmixing of remotely sensed imagery which reduces the sensitivity of the estimator to outliers and relaxes the linearity assumption. The method consists of several appropriate penalties. We propose to use an ℓp norm with 0 < p < 1 in the sparse regression problem, which induces more sparsity in the results, but makes the problem non-convex. On the other hand, the problem, though non-convex, can be solved quite straightforwardly with an extensible algorithm based on iteratively reweighted least squares. To deal with the huge size of modern spectral libraries we introduce a library reduction step, similar to the multiple signal classification (MUSIC) array processing algorithm, which not only speeds up unmixing but also yields superior results. In the hyperspectral setting we extend the traditional least squares method to the robust heavy-tailed case and propose a generalised M-lasso solution. M-estimation replaces the Gaussian likelihood with a fixed function ρ(e) that restrains outliers. The M-estimate function reduces the effect of errors with large amplitudes or even assigns the outliers zero weights. Our experimental results on real hyperspectral data show that noise with large amplitudes (outliers) often exists in the data. This ability to mitigate the influence of such outliers can therefore offer greater robustness. Qualitative hyperspectral unmixing results on real hyperspectral image data corroborate the efficacy of the proposed method.

[1]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Shing-Chow Chan,et al.  On Bandwidth Selection in Local Polynomial Regression Analysis and Its Application to Multi-resolution Analysis of Non-uniform Data , 2008, J. Signal Process. Syst..

[3]  Marco Diani,et al.  An unsupervised algorithm for hyperspectral image segmentation based on the Gaussian mixture model , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[4]  Marco Diani,et al.  Statistical Analysis of Hyper-Spectral Data: A Non-Gaussian Approach , 2007, EURASIP J. Adv. Signal Process..

[5]  Corina Nafornita,et al.  Generalised M-Lasso for robust, spatially regularised hurst estimation , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[6]  Shing-Chow Chan,et al.  A recursive least M-estimate algorithm for robust adaptive filtering in impulsive noise: fast algorithm and convergence performance analysis , 2004, IEEE Transactions on Signal Processing.

[7]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[8]  Georges Bienvenu,et al.  Adaptivity to background noise spatial coherence for high resolution passive methods , 1980, ICASSP.

[9]  Fuchun Sun,et al.  A Fast and Robust Sparse Approach for Hyperspectral Data Classification Using a Few Labeled Samples , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Junzhou Huang,et al.  Fast iteratively reweighted least squares algorithms for analysis‐based sparse reconstruction , 2018, Medical Image Anal..

[12]  Nicolai Bissantz,et al.  Convergence Analysis of Generalized Iteratively Reweighted Least Squares Algorithms on Convex Function Spaces , 2008, SIAM J. Optim..

[13]  Yan Zhang,et al.  Sparse Hyperspectral Unmixing Based on Constrained lp - l2 Optimization , 2013, IEEE Geoscience and Remote Sensing Letters.

[14]  Antonio J. Plaza,et al.  Spatial Preprocessing for Endmember Extraction , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Shuicheng Yan,et al.  Smoothed Low Rank and Sparse Matrix Recovery by Iteratively Reweighted Least Squares Minimization , 2014, IEEE Transactions on Image Processing.

[16]  Antonio J. Plaza,et al.  MUSIC-CSR: Hyperspectral Unmixing via Multiple Signal Classification and Collaborative Sparse Regression , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Shing-Chow Chan,et al.  Robust linear estimation using M-estimation and weighted L1 regularization: Model selection and recursive implementation , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[19]  Tiziana Veracini,et al.  Robust hyperspectral image segmentation based on a non-Gaussian model , 2010, 2010 2nd International Workshop on Cognitive Information Processing.

[20]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[21]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Dimitris Manolakis,et al.  Non Gaussian models for hyperspectral algorithm design and assessment , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[23]  Stanley Osher,et al.  L1 unmixing and its application to hyperspectral image enhancement , 2009, Defense + Commercial Sensing.

[24]  Dimitris G. Manolakis,et al.  Modeling hyperspectral imaging data , 2003, SPIE Defense + Commercial Sensing.

[25]  Jiang Li,et al.  Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[26]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[27]  Xiuping Jia,et al.  Collinearity and orthogonality of endmembers in linear spectral unmixing , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[28]  Shie Mannor,et al.  Robust Regression and Lasso , 2008, IEEE Transactions on Information Theory.