A Fast Multiscale Spatial Regularization for Sparse Hyperspectral Unmixing

Sparse hyperspectral unmixing from large spectral libraries has been considered to circumvent the limitations of endmember extraction algorithms in many applications. This strategy often leads to ill-posed inverse problems, which can greatly benefit from spatial regularization strategies. However, existing spatial regularization strategies lead to large-scale nonsmooth optimization problems. Thus, efficiently introducing spatial context in the unmixing problem remains a challenge and a necessity for many real world applications. In this letter, a novel multiscale spatial regularization approach for sparse unmixing is proposed. The method uses a signal-adaptive spatial multiscale decomposition based on segmentation and oversegmentation algorithms to decompose the unmixing problem into two simpler problems: one in an approximation image domain and another in the original domain. Simulation results using both synthetic and real data indicate that the proposed method outperforms the state-of-the-art total variation-based algorithms with a computation time comparable to that of their unregularized counterparts.

[1]  Liangpei Zhang,et al.  Abundance estimation from hyperspectral image based on probabilistic outputs of multi-class support vector machines , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[2]  David R. Thompson,et al.  Superpixel Endmember Detection , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Rob Heylen,et al.  Non-Linear Spectral Unmixing by Geodesic Simplex Volume Maximization , 2011, IEEE Journal of Selected Topics in Signal Processing.

[4]  Ricardo Augusto Borsoi,et al.  Deep Generative Models for Library Augmentation in Multiple Endmember Spectral Mixture Analysis , 2019, ArXiv.

[5]  Cédric Richard,et al.  A graph Laplacian regularization for hyperspectral data unmixing , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Jie Chen,et al.  Nonlinear Estimation of Material Abundances in Hyperspectral Images With $\ell_{1}$-Norm Spatial Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Chong-Yung Chi,et al.  A Convex Analysis-Based Minimum-Volume Enclosing Simplex Algorithm for Hyperspectral Unmixing , 2009, IEEE Transactions on Signal Processing.

[8]  Xiao Xiang Zhu,et al.  SULoRA: Subspace Unmixing With Low-Rank Attribute Embedding for Hyperspectral Data Analysis , 2018, IEEE Journal of Selected Topics in Signal Processing.

[9]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[10]  Yo-Sung Ho,et al.  High-quality non-blind image deconvolution with adaptive regularization , 2011, J. Vis. Commun. Image Represent..

[11]  Manuel L'opez Galv'an The multivariate bisection algorithm , 2017, Revista de la Unión Matemática Argentina.

[12]  Jean-Yves Tourneret,et al.  Enhancing Hyperspectral Image Unmixing With Spatial Correlations , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Maria C. Torres-Madronero,et al.  Integrating Spatial Information in Unsupervised Unmixing of Hyperspectral Imagery Using Multiscale Representation , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Qionghai Dai,et al.  Exploring aligned complementary image pair for blind motion deblurring , 2011, CVPR 2011.

[15]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[16]  Jon Atli Benediktsson,et al.  Big Data for Remote Sensing: Challenges and Opportunities , 2016, Proceedings of the IEEE.

[17]  Lianru Gao,et al.  Integrating Spatial Information in the Normalized P-Linear Algorithm for Nonlinear Hyperspectral Unmixing , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  W. Verstraeten,et al.  Nonlinear Hyperspectral Mixture Analysis for tree cover estimates in orchards , 2009 .

[19]  Paul Honeine,et al.  Hyperspectral Unmixing in Presence of Endmember Variability, Nonlinearity, or Mismodeling Effects , 2015, IEEE Transactions on Image Processing.

[20]  Miguel Velez-Reyes,et al.  Low-dimensional enhanced superpixel representation with homogeneity testing for unmixing of hyperspectral imagery , 2018, Defense + Security.

[21]  Albert Y. Zomaya,et al.  Remote sensing big data computing: Challenges and opportunities , 2015, Future Gener. Comput. Syst..

[22]  Michael K. Ng,et al.  Deblurring and Sparse Unmixing for Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Jie Chen,et al.  Nonlinear Unmixing of Hyperspectral Data Based on a Linear-Mixture/Nonlinear-Fluctuation Model , 2013, IEEE Transactions on Signal Processing.

[24]  Le Wang,et al.  Incorporating spatial information in spectral unmixing: A review , 2014 .

[25]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Spectral Unmixing-Based Binary Partition Tree Representation , 2014, IEEE Transactions on Image Processing.

[26]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[27]  E. Kreyszig Introductory Functional Analysis With Applications , 1978 .

[28]  El-Hadi Djermoune,et al.  Regularization Parameter Estimation for Non-Negative Hyperspectral Image Deconvolution , 2016, IEEE Transactions on Image Processing.

[29]  Antonio J. Plaza,et al.  Automated Extraction of Image-Based Endmember Bundles for Improved Spectral Unmixing , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[31]  John F. Mustard,et al.  Photometric phase functions of common geologic minerals and applications to quantitative analysis of mineral mixture reflectance spectra , 1989 .

[32]  B. Kozintsev,et al.  Computations With Gaussian Random Fields , 1999 .

[33]  Seung-Jean Kim,et al.  Hyperspectral Image Unmixing via Alternating Projected Subgradients , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[34]  Dimitris G. Manolakis,et al.  Detection algorithms for hyperspectral imaging applications , 2002, IEEE Signal Process. Mag..

[35]  Ricardo Augusto Borsoi,et al.  Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing , 2019, IEEE Transactions on Computational Imaging.

[36]  Liangpei Zhang,et al.  Spatial Group Sparsity Regularized Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Qingquan Li,et al.  Superpixel-Based Multitask Learning Framework for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[38]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[39]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[41]  Chong-Yung Chi,et al.  A Simplex Volume Maximization Framework for Hyperspectral Endmember Extraction , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jean-Yves Tourneret,et al.  Nonlinear Spectral Unmixing of Hyperspectral Images Using Gaussian Processes , 2012, IEEE Transactions on Signal Processing.

[43]  Ricardo Augusto Borsoi,et al.  A Data Dependent Multiscale Model for Hyperspectral Unmixing With Spectral Variability , 2018, IEEE Transactions on Image Processing.

[44]  Antonio J. Plaza,et al.  Spatial Preprocessing for Endmember Extraction , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Ricardo Augusto Borsoi,et al.  Improved Hyperspectral Unmixing with Endmember Variability Parametrized Using an Interpolated Scaling Tensor , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[46]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  Cédric Richard,et al.  ADA-PT: An Adaptive Parameter Tuning Strategy Based on the Weighted Stein Unbiased Risk Estimator , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[48]  David Mary,et al.  Blind and Fully Constrained Unmixing of Hyperspectral Images , 2014, IEEE Transactions on Image Processing.

[49]  Nikolas P. Galatsanos,et al.  Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation , 1992, IEEE Trans. Image Process..

[50]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Stephen McLaughlin,et al.  Bayesian Nonlinear Hyperspectral Unmixing With Spatial Residual Component Analysis , 2014, IEEE Transactions on Computational Imaging.

[52]  Deyu Meng,et al.  Nonconvex-Sparsity and Nonlocal-Smoothness-Based Blind Hyperspectral Unmixing , 2019, IEEE Transactions on Image Processing.

[53]  T. W. Ray,et al.  Nonlinear Spectral Mixing in Desert Vegetation , 1996 .

[54]  Hao Wu,et al.  Double Constrained NMF for Hyperspectral Unmixing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[55]  D. Bachrathy,et al.  Bisection method in higher dimensions and the efficiency number , 2012 .

[56]  Jean-Yves Tourneret,et al.  Hyperspectral Unmixing With Spectral Variability Using a Perturbed Linear Mixing Model , 2015, IEEE Transactions on Signal Processing.

[57]  Chein-I Chang,et al.  Automatic spectral target recognition in hyperspectral imagery , 2003 .

[58]  Rob Heylen,et al.  A Distance Geometric Framework for Nonlinear Hyperspectral Unmixing , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Pablo Andrés Arbeláez,et al.  Boundary Extraction in Natural Images Using Ultrametric Contour Maps , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[60]  Shuzhong Zhang,et al.  Strong Duality for the CDT Subproblem: A Necessary and Sufficient Condition , 2008, SIAM J. Optim..

[61]  Cédric Richard,et al.  Nonlinear Unmixing of Hyperspectral Data With Vector-Valued Kernel Functions , 2017, IEEE Transactions on Image Processing.

[62]  P. Hall,et al.  Common Structure of Techniques for Choosing Smoothing Parameters in Regression Problems , 1987 .

[63]  Xuelong Li,et al.  Manifold Regularized Sparse NMF for Hyperspectral Unmixing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Hoang Duong Tuan,et al.  Generalized S-Lemma and strong duality in nonconvex quadratic programming , 2013, J. Glob. Optim..

[65]  Pol Coppin,et al.  Endmember variability in Spectral Mixture Analysis: A review , 2011 .

[66]  R. E. Roger Principal Components transform with simple, automatic noise adjustment , 1996 .

[67]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[68]  Cédric Richard,et al.  Nonparametric Detection of Nonlinearly Mixed Pixels and Endmember Estimation in Hyperspectral Images , 2015, IEEE Transactions on Image Processing.

[69]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[70]  Asad Mahmood,et al.  Modified Residual Method for the Estimation of Noise in Hyperspectral Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[71]  Mario Parente,et al.  Uniformity-Based Superpixel Segmentation of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[72]  E. Miller,et al.  Efficient determination of multiple regularization parameters in a generalized L-curve framework , 2002 .

[73]  Naoto Yokoya,et al.  An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing , 2018, IEEE Transactions on Image Processing.

[74]  Ricardo Augusto Borsoi,et al.  Low-Rank Tensor Modeling for Hyperspectral Unmixing Accounting for Spectral Variability , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[75]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[76]  Jean-Yves Tourneret,et al.  Supervised Nonlinear Spectral Unmixing Using a Postnonlinear Mixing Model for Hyperspectral Imagery , 2012, IEEE Transactions on Image Processing.

[77]  Xiaorun Li,et al.  Blind nonlinear hyperspectral unmixing based on constrained kernel nonnegative matrix factorization , 2012, Signal, Image and Video Processing.

[78]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[79]  Cédric Richard,et al.  Spatial regularization for nonlinear unmixing of hyperspectral data with vector-valued kernel functions , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[80]  Immanuel M. Bomze,et al.  Copositive Relaxation Beats Lagrangian Dual Bounds in Quadratically and Linearly Constrained Quadratic Optimization Problems , 2015, SIAM J. Optim..

[81]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[82]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[83]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[84]  Jocelyn Chanussot,et al.  Blind Hyperspectral Unmixing Using an Extended Linear Mixing Model to Address Spectral Variability , 2016, IEEE Transactions on Image Processing.

[85]  Ricardo Augusto Borsoi,et al.  A Low-Rank Tensor Regularization Strategy for Hyperspectral Unmixing , 2018, 2018 IEEE Statistical Signal Processing Workshop (SSP).

[86]  Liangpei Zhang,et al.  Non-Local Sparse Unmixing for Hyperspectral Remote Sensing Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[87]  Hao Wu,et al.  Superpixels for Spatially Reinforced Bayesian Classification of Hyperspectral Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[88]  Jiunn-Lin Wu,et al.  An Improved Adaptive Deconvolution Algorithm for Single Image Deblurring , 2014 .

[89]  Antonio J. Plaza,et al.  A Signal Processing Perspective on Hyperspectral Unmixing: Insights from Remote Sensing , 2014, IEEE Signal Processing Magazine.

[90]  Rui Wang,et al.  Centralized Collaborative Sparse Unmixing for Hyperspectral Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[91]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[92]  Chein-I Chang,et al.  A quantitative and comparative analysis of linear and nonlinear spectral mixture models using radial basis function neural networks , 2001, IEEE Trans. Geosci. Remote. Sens..

[93]  Ricardo Augusto Borsoi,et al.  Generalized Linear Mixing Model Accounting for Endmember Variability , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[94]  Jean-Yves Tourneret,et al.  Toward a Sparse Bayesian Markov Random Field Approach to Hyperspectral Unmixing and Classification , 2017, IEEE Transactions on Image Processing.

[95]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[96]  Jun Li,et al.  Spectral–Spatial Weighted Sparse Regression for Hyperspectral Image Unmixing , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[97]  Jian Sun,et al.  Progressive inter-scale and intra-scale non-blind image deconvolution , 2008, SIGGRAPH 2008.

[98]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[99]  Fernando Puente León,et al.  Robustness Improvement of Hyperspectral Image Unmixing by Spatial Second-Order Regularization , 2014, IEEE Transactions on Image Processing.

[100]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[101]  Antonio Plaza,et al.  Multicore Real-Time Implementation of a Full Hyperspectral Unmixing Chain , 2018, IEEE Geoscience and Remote Sensing Letters.

[102]  Steve McLaughlin,et al.  Robust Linear Spectral Unmixing Using Anomaly Detection , 2015, IEEE Transactions on Computational Imaging.

[103]  Ricardo Augusto Borsoi,et al.  Super-Resolution for Hyperspectral and Multispectral Image Fusion Accounting for Seasonal Spectral Variability , 2018, IEEE Transactions on Image Processing.

[104]  Mohamed-Jalal Fadili,et al.  Stein Unbiased GrAdient estimator of the Risk (SUGAR) for Multiple Parameter Selection , 2014, SIAM J. Imaging Sci..

[105]  B. R. Hunt,et al.  The Application of Constrained Least Squares Estimation to Image Restoration by Digital Computer , 1973, IEEE Transactions on Computers.

[106]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[107]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[108]  D. M. Titterington,et al.  A Study of Methods of Choosing the Smoothing Parameter in Image Restoration by Regularization , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[109]  Angshul Majumdar,et al.  Hyperspectral Unmixing in the Presence of Mixed Noise Using Joint-Sparsity and Total Variation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[110]  Liangpei Zhang,et al.  Adaptive Spatial Regularization Sparse Unmixing Strategy Based on Joint MAP for Hyperspectral Remote Sensing Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[111]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[112]  Xiaorun Li,et al.  A Kernel Spatial Complexity-Based Nonlinear Unmixing Method of Hyperspectral Imagery , 2010, LSMS/ICSEE.

[113]  Jocelyn Chanussot,et al.  Relationships Between Nonlinear and Space-Variant Linear Models in Hyperspectral Image Unmixing , 2017, IEEE Signal Processing Letters.

[114]  Li Qi,et al.  An improved Richardson–Lucy algorithm based on local prior , 2010 .

[115]  Alfonso Fernández-Manso,et al.  Spectral unmixing , 2012 .