Nonlocal Tensor-Ring Decomposition for Hyperspectral Image Denoising

Hyperspectral image (HSI) denoising is a fundamental problem in remote sensing and image processing. Recently, nonlocal low-rank tensor approximation-based denoising methods have attracted much attention due to their advantage of being capable of fully exploiting the nonlocal self-similarity and global spectral correlation. Existing nonlocal low-rank tensor approximation methods were mainly based on two common decomposition [Tucker or CANDECOMP/PARAFAC (CP)] methods and achieved the state-of-the-art results, but they are subject to certain issues and do not produce the best approximation for a tensor. For example, the number of parameters for Tucker decomposition increases exponentially according to its dimensions, and CP decomposition cannot better preserve the intrinsic correlation of the HSI. In this article, a novel nonlocal tensor-ring (TR) approximation is proposed for HSI denoising by using TR decomposition to explore the nonlocal self-similarity and global spectral correlation simultaneously. TR decomposition approximates a high-order tensor as a sequence of cyclically contracted third-order tensors, which has strong ability to explore these two intrinsic priors and to improve the HSI denoising results. Moreover, an efficient proximal alternating minimization algorithm is developed to optimize the proposed TR decomposition model efficiently. Extensive experiments on three simulated data sets under several noise levels and two real data sets verify that the proposed TR model provides better HSI denoising results than several state-of-the-art methods in terms of quantitative and visual performance evaluations.

[1]  Ting-Zhu Huang,et al.  Destriping of Multispectral Remote Sensing Image Using Low-Rank Tensor Decomposition , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Naoto Yokoya,et al.  Blind cloud and cloud shadow removal of multitemporal images based on total variation regularized low-rank sparsity decomposition , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[3]  Michael K. Ng,et al.  Deblurring and Sparse Unmixing for Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Naoto Yokoya,et al.  Non-Local Meets Global: An Integrated Paradigm for Hyperspectral Denoising , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Sheng Zhong,et al.  Hyper-Laplacian Regularized Unidirectional Low-Rank Tensor Recovery for Multispectral Image Denoising , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Sheng Zhong,et al.  HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Ting-Zhu Huang,et al.  Matrix factorization for low-rank tensor completion using framelet prior , 2018, Inf. Sci..

[8]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Yuan Xie,et al.  Hyperspectral Image Restoration via Iteratively Regularized Weighted Schatten $p$-Norm Minimization , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Deyu Meng,et al.  Denoising Hyperspectral Image With Non-i.i.d. Noise Structure , 2017, IEEE Transactions on Cybernetics.

[12]  Seong G. Kong,et al.  Joint Spatial and Spectral Low-Rank Regularization for Hyperspectral Image Denoising , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Naoto Yokoya,et al.  Hyperspectral and Multispectral Data Fusion: A comparative review of the recent literature , 2017, IEEE Geoscience and Remote Sensing Magazine.

[14]  Qiang Zhang,et al.  Hyperspectral Image Denoising Employing a Spatial–Spectral Deep Residual Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Naoto Yokoya,et al.  Remote Sensing Image Reconstruction Using Tensor Ring Completion and Total Variation , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[17]  Yi Shen,et al.  Low rank constraint and spatial spectral total variation for hyperspectral image mixed denoising , 2018, Signal Process..

[18]  Caroline Fossati,et al.  Denoising of Hyperspectral Images Using the PARAFAC Model and Statistical Performance Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jocelyn Chanussot,et al.  A variational pansharpening approach based on reproducible kernel Hilbert space and heaviside function , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Yuhui Zheng,et al.  Hyperspectral Image Restoration Using Low-Rank Representation on Spectral Difference Image , 2017, IEEE Geoscience and Remote Sensing Letters.

[22]  Naoto Yokoya,et al.  Hyperspectral Image Restoration Using Weighted Group Sparsity-Regularized Low-Rank Tensor Decomposition , 2020, IEEE Transactions on Cybernetics.

[23]  Bo Du,et al.  A Bandwise Noise Model Combined With Low-Rank Matrix Factorization for Hyperspectral Image Denoising , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  V. Aggarwal,et al.  Efficient Low Rank Tensor Ring Completion , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[26]  Yongqiang Zhao,et al.  Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Lei Zhang,et al.  Multispectral Images Denoising by Intrinsic Tensor Sparsity Regularization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Gangyao Kuang,et al.  Spatial–Spectral Total Variation Regularized Low-Rank Tensor Decomposition for Hyperspectral Image Denoising , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[31]  Jun Zhou,et al.  Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Ting-Zhu Huang,et al.  Remote sensing images destriping using unidirectional hybrid total variation and nonconvex low-rank regularization , 2020, J. Comput. Appl. Math..

[33]  Nicolas Dobigeon,et al.  Hyperspectral Unmixing With Spectral Variability Using Adaptive Bundles and Double Sparsity , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Chao Li,et al.  Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion , 2018, AAAI.

[35]  José M. Bioucas-Dias,et al.  Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Jun Zhou,et al.  Nonlocal Similarity Based Nonnegative Tucker Decomposition for Hyperspectral Image Denoising , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[38]  Jianting Cao,et al.  Higher-dimension Tensor Completion via Low-rank Tensor Ring Decomposition , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[39]  Zhi-Quan Luo,et al.  A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization , 2012, SIAM J. Optim..

[40]  Seong G. Kong,et al.  Coupled Sparse Denoising and Unmixing With Low-Rank Constraint for Hyperspectral Image , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Masashi Sugiyama,et al.  Learning Efficient Tensor Representations with Ring-structured Networks , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  Liqing Zhang,et al.  Tensor Ring Decomposition , 2016, ArXiv.

[43]  Adrian S. Lewis,et al.  Clarke Subgradients of Stratifiable Functions , 2006, SIAM J. Optim..

[44]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[45]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[46]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[47]  HuangTao,et al.  Mixed Noise Removal via Laplacian Scale Mixture Modeling and Nonlocal Low-Rank Approximation , 2017 .

[48]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[49]  Ting-Zhu Huang,et al.  Hyperspectral image restoration using framelet-regularized low-rank nonnegative matrix factorization , 2018, Applied Mathematical Modelling.

[50]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[51]  Dong Wang,et al.  Denoising of Hyperspectral Images Using Nonconvex Low Rank Matrix Approximation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Ting-Zhu Huang,et al.  Low-rank tensor completion via smooth matrix factorization , 2019, Applied Mathematical Modelling.

[53]  Salah Bourennane,et al.  Denoising and Dimensionality Reduction Using Multilinear Tools for Hyperspectral Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[54]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[55]  Jiangjun Peng,et al.  Hyperspectral Image Restoration Via Total Variation Regularized Low-Rank Tensor Decomposition , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[56]  Liangpei Zhang,et al.  Total-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Qi Xie,et al.  Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[59]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..