Efficient multi-way sparsity estimation for hyperspectral image processing

Abstract. Sparsity and low rankness are essential properties of real-world data. The sparsity attribute mentions that the data contain very few non-zero elements. On the other hand, the low-rank property characterizes redundancy in the data. The concept of sparsity and low rankness is central to numerous signal processing tasks such as signal inversion, data compression, and noise removal. With the advent of multi-sensor and multi-dimensional data, we frequently encounter multi-way data or tensors with sparse and low-rank structure. Prevalent vector or matrix-based sparsity estimation criterias cannot conveniently characterize the sparsity structure of multi-way data. Hence, we require efficient criteria to quantify the sparsity structure of multi-way data. Sparsity plays a crucial aspect in hyperspectral image processing tasks such as unmixing and denoising. Hyperspectral images contain an inherent multi-way structure; we perform multi-way sparsity estimation in hyperspectral image processing. We introduce an efficient criterion to estimate multi-way sparsity, facilitating signal inversion, and noise removal tasks. The proposed sparsity criteria combine the sparsity of the core tensor obtained by Tucker tensor decomposition, the low rankness of the tensor, and the approximated rank. Since the core tensor obtained by tucker decomposition is highly sparse, the core tensor sparsity reflects the sparsity of the whole tensor indirectly. On the other hand, the nuclear norm and Stein’s unbiased risk estimate quantifies the low rankness of the tensor. Unlike other approaches, our proposed measure takes both low rankness and sparsity attribute into account. In addition, our proposed sparsity measure also satisfies some of the desirable properties of ideal sparsity measures. We demonstrate the efficacy of our proposed sparsity quantification measure in applications such as hyperspectral image denoising, hyperspectral unmixing tasks as demonstrated in the real image experiments.

[1]  Alok Kanti Deb,et al.  Sparsity measure based library aided unmixing of hyperspectral image , 2019, IET Image Process..

[2]  Aurobinda Routray,et al.  Hyperspectral Unmixing by Nuclear Norm Difference Maximization based Dictionary Pruning , 2017, 2017 14th IEEE India Council International Conference (INDICON).

[3]  Qingming Huang,et al.  Towards Discriminability and Diversity: Batch Nuclear-Norm Maximization Under Label Insufficient Situations , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Shubhobrata Bhattacharya,et al.  Feature extraction approach for quality assessment of remotely sensed hyperspectral images , 2020 .

[5]  Gordon Morison SURE Based Truncated Tensor Nuclear Norm Regularization for Low Rank Tensor Completion , 2021, 2020 28th European Signal Processing Conference (EUSIPCO).

[6]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Panos P. Markopoulos,et al.  L1-Norm Tucker Tensor Decomposition , 2019, IEEE Access.

[8]  Lei Huang,et al.  Core consistency diagnostic aided by reconstruction error for accurate enumeration of the number of components in parafac models , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Wei Liu,et al.  Deep Non-Blind Deconvolution via Generalized Low-Rank Approximation , 2018, NeurIPS.

[10]  Shinnosuke Takamichi,et al.  Blind source separation based on independent low-rank matrix analysis with sparse regularization for time-series activity , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Jonathan Cheung-Wai Chan,et al.  Nonlocal Low-Rank Regularized Tensor Decomposition for Hyperspectral Image Denoising , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Johannes R. Sveinsson,et al.  Hyperspectral Subspace Identification Using SURE , 2015, IEEE Geoscience and Remote Sensing Letters.

[13]  Emmanuel J. Candès,et al.  Unbiased Risk Estimates for Singular Value Thresholding and Spectral Estimators , 2012, IEEE Transactions on Signal Processing.

[14]  Alexander G. Gray,et al.  Stochastic Alternating Direction Method of Multipliers , 2013, ICML.

[15]  Venkatesh Saligrama,et al.  Video Anomaly Identification , 2010, IEEE Signal Processing Magazine.

[16]  Nico Vervliet,et al.  Tensorlab 3.0 — Numerical optimization strategies for large-scale constrained and coupled matrix/tensor factorization , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[17]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[18]  A. K. Deb,et al.  Fast Linear Unmixing of Hyperspectral Image by Slow Feature Analysis and Simplex Volume Ratio Approach , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[19]  Javier Portilla,et al.  L0-Norm-Based Sparse Representation Through Alternate Projections , 2006, 2006 International Conference on Image Processing.

[20]  Andrzej Cichocki,et al.  Fast Alternating LS Algorithms for High Order CANDECOMP/PARAFAC Tensor Factorizations , 2013, IEEE Transactions on Signal Processing.

[21]  Aurobinda Routray,et al.  Covariance Similarity Approach for Semiblind Unmixing of Hyperspectral Image , 2019, IEEE Geoscience and Remote Sensing Letters.

[22]  Liangpei Zhang,et al.  Non-Local Sparse Unmixing for Hyperspectral Remote Sensing Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  George Karypis,et al.  Accelerating the Tucker Decomposition with Compressed Sparse Tensors , 2017, Euro-Par.

[24]  Lan Tang,et al.  Image denoising via group sparsity residual constraint , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[26]  Peter Lindstrom,et al.  TTHRESH: Tensor Compression for Multidimensional Visual Data , 2018, IEEE Transactions on Visualization and Computer Graphics.

[27]  Scott T. Rickard,et al.  Comparing Measures of Sparsity , 2008, IEEE Transactions on Information Theory.

[28]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[29]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[30]  Ashraf A. Kassim,et al.  Gini Index as Sparsity Measure for Signal Reconstruction from Compressive Samples , 2011, IEEE Journal of Selected Topics in Signal Processing.

[31]  Hongyan Zhang,et al.  Sparsity-Based Clustering for Large Hyperspectral Remote Sensing Images , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Shmuel Friedland,et al.  Nuclear norm of higher-order tensors , 2014, Math. Comput..

[33]  Feiyun Zhu,et al.  Hyperspectral Unmixing: Ground Truth Labeling, Datasets, Benchmark Performances and Survey , 2017, 1708.05125.

[34]  Wei Wei,et al.  Locally Similar Sparsity-Based Hyperspectral Compressive Sensing Using Unmixing , 2016, IEEE Transactions on Computational Imaging.

[35]  Xin Huang,et al.  Hyperspectral image noise reduction based on rank-1 tensor decomposition , 2013 .

[36]  Jie Huang,et al.  Nonlocal Tensor-Based Sparse Hyperspectral Unmixing , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Ali Hassan Sodhro,et al.  A multi-sensor data fusion enabled ensemble approach for medical data from body sensor networks , 2020, Inf. Fusion.

[38]  Aurobinda Routray,et al.  Noise robust estimation of number of endmembers in a hyperspectral image by Eigenvalue based gap index , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[39]  Yuanchao Su,et al.  Stacked Nonnegative Sparse Autoencoders for Robust Hyperspectral Unmixing , 2018, IEEE Geoscience and Remote Sensing Letters.

[40]  Piotr Indyk Explicit constructions for compressed sensing of sparse signals , 2008, SODA '08.

[41]  Qi Xie,et al.  Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Trac D. Tran,et al.  Exploiting Sparsity in Hyperspectral Image Classification via Graphical Models , 2013, IEEE Geoscience and Remote Sensing Letters.

[43]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[45]  Feiping Nie,et al.  Low-Rank Tensor Completion with Spatio-Temporal Consistency , 2014, AAAI.

[46]  Victor Solo,et al.  Dimension Estimation in Noisy PCA With SURE and Random Matrix Theory , 2008, IEEE Transactions on Signal Processing.

[47]  B. Dousseta,et al.  Satellite multi-sensor data analysis of urban surface temperatures and landcover , 2003 .

[48]  G. Shaw,et al.  Signal processing for hyperspectral image exploitation , 2002, IEEE Signal Process. Mag..

[49]  Aurobinda Routray,et al.  Fast Semi-Supervised Unmixing of Hyperspectral Image by Mutual Coherence Reduction and Recursive PCA , 2018, Remote. Sens..

[50]  Aurobinda Routray,et al.  Efficient tensor decomposition approach for estimation of the number of endmembers in a hyperspectral image , 2020, Journal of Applied Remote Sensing.

[51]  Nikos D. Sidiropoulos,et al.  Tensor Decomposition for Signal Processing and Machine Learning , 2016, IEEE Transactions on Signal Processing.

[52]  Erik Cambria,et al.  Towards an intelligent framework for multimodal affective data analysis , 2015, Neural Networks.

[53]  Massimiliano Pontil,et al.  A New Convex Relaxation for Tensor Completion , 2013, NIPS.

[54]  W. M. Benzel,et al.  USGS Spectral Library Version 7 , 2017 .

[55]  Antonio J. Plaza,et al.  A fast iterative algorithm for implementation of pixel purity index , 2006, IEEE Geoscience and Remote Sensing Letters.

[56]  Zihan Zhou,et al.  Separation of a subspace-sparse signal: Algorithms and conditions , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[57]  Xiaoming Yuan,et al.  A Note on the Alternating Direction Method of Multipliers , 2012, J. Optim. Theory Appl..

[58]  Marco Diani,et al.  Signal-Dependent Noise Modeling and Model Parameter Estimation in Hyperspectral Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.