Enhanced 3DTV Regularization and Its Applications on HSI Denoising and Compressed Sensing

The total variation (TV) is a powerful regularization term encoding the local smoothness prior structure underlying images. By combining the TV regularization term with low rank prior, the 3D total variation (3DTV) regularizer has achieved advanced performance in general hyperspectral image (HSI) processing tasks. Intrinsically, 3DTV assumes i.i.d. sparsity structures on all bands of the gradient maps calculated along the spectrum and space of an HSI. This, however, largely deviates from the real-world cases, where the gradient maps generally have different while correlated gradient map structures across all bands. To alleviate this issue, we propose an enhanced 3DTV (E-3DTV) regularization term beyond the conventional. Instead of imposing sparsity on gradient maps themselves, the new term calculates sparsity on the subspace bases on gradient maps along all bands of an HSI, which naturally encodes the correlation and difference among all these bands, and thus more faithfully reflects the insightful configurations of an HSI. The E-3DTV term can easily replace the conventional 3DTV term and be embedded into an HSI processing model to ameliorate its performance. We made such attempts on two typical related tasks: HSI denoising and compressed sensing. The superiority of our proposed method is substantiated by extensive experiments on synthetic and real HSI data, visually and quantitatively on both tasks, as compared with current state-of-the-arts. The code of our algorithm is released at https://github.com/andrew-pengjj/Enhanced-3DTV.git.

[1]  Pierre Vandergheynst,et al.  Joint trace/TV norm minimization: A new efficient approach for spectral compressive imaging , 2012, 2012 19th IEEE International Conference on Image Processing.

[2]  Shen-En Qian,et al.  Noise reduction of hyperspectral imagery using hybrid spatial-spectral derivative-domain wavelet shrinkage , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Sheng Zhong,et al.  HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[5]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[7]  Wei Liu,et al.  Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yuan Xie,et al.  Hyperspectral Image Restoration via Iteratively Regularized Weighted Schatten $p$-Norm Minimization , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Deyu Meng,et al.  Compressive Sensing of Hyperspectral Images via Joint Tensor Tucker Decomposition and Weighted Total Variation Regularization , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[11]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Antonio J. Plaza,et al.  A new technique for hyperspectral compressive sensing using spectral unmixing , 2012, Optics & Photonics - Optical Engineering + Applications.

[13]  Liangpei Zhang,et al.  Hyperspectral Image Denoising via Noise-Adjusted Iterative Low-Rank Matrix Approximation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[15]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[16]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Wei Wei,et al.  Hyperspectral Compressive Sensing Using Manifold-Structured Sparsity Prior , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[19]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[20]  Lei Zhang,et al.  Multispectral Images Denoising by Intrinsic Tensor Sparsity Regularization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Qi Xie,et al.  Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Peng Li,et al.  Compressive Hyperspectral Imaging via Sparse Tensor and Nonlinear Compressed Sensing , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[24]  Trac D. Tran,et al.  Fast and Efficient Compressive Sensing Using Structurally Random Matrices , 2011, IEEE Transactions on Signal Processing.

[25]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[26]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[27]  Angshul Majumdar,et al.  Split Bregman algorithms for sparse / joint-sparse and low-rank signal recovery: Application in compressive hyperspectral imaging , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[28]  Liangpei Zhang,et al.  High-Resolution Image Classification Integrating Spectral-Spatial-Location Cues by Conditional Random Fields , 2016, IEEE Transactions on Image Processing.

[29]  Yin Zhang,et al.  A Compressive Sensing and Unmixing Scheme for Hyperspectral Data Processing , 2012, IEEE Transactions on Image Processing.

[30]  Guangming Shi,et al.  Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation , 2016, IEEE Transactions on Image Processing.

[31]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[32]  Deyu Meng,et al.  Nonconvex-Sparsity and Nonlocal-Smoothness-Based Blind Hyperspectral Unmixing , 2019, IEEE Transactions on Image Processing.

[33]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[34]  Pierre Vandergheynst,et al.  Hyperspectral image compressed sensing via low-rank and joint-sparse matrix recovery , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Cheng Jiang,et al.  Hyperspectral Image Denoising with a Combined Spatial and Spectral Weighted Hyperspectral Total Variation Model , 2016 .

[36]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Yuan Yan Tang,et al.  A Novel Rank Approximation Method for Mixture Noise Removal of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Jiangjun Peng,et al.  Hyperspectral Image Restoration Via Total Variation Regularized Low-Rank Tensor Decomposition , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[40]  Liangpei Zhang,et al.  Total-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Aswin C. Sankaranarayanan,et al.  SpaRCS: Recovering low-rank and sparse matrices from compressive measurements , 2011, NIPS.

[42]  Guangming Shi,et al.  Low-Rank Tensor Approximation with Laplacian Scale Mixture Modeling for Multiframe Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[43]  Richard G. Baraniuk,et al.  Kronecker product matrices for compressive sensing , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[44]  Xue-Cheng Tai,et al.  A Weighted Dictionary Learning Model for Denoising Images Corrupted by Mixed Noise , 2013, IEEE Transactions on Image Processing.

[45]  Hong Jiang,et al.  Surveillance Video Processing Using Compressive Sensing , 2012, ArXiv.

[46]  Qiang Zhang,et al.  Hyperspectral Image Denoising Employing a Spatial–Spectral Deep Residual Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).