Adaptive Spatial-Spectral Dictionary Learning for Hyperspectral Image Denoising

Hyperspectral imaging is beneficial in a diverse range of applications from diagnostic medicine, to agriculture, to surveillance to name a few. However, hyperspectral images often times suffer from degradation due to the limited light, which introduces noise into the imaging process. In this paper, we propose an effective model for hyperspectral image (HSI) denoising that considers underlying characteristics of HSIs: sparsity across the spatial-spectral domain, high correlation across spectra, and non-local self-similarity over space. We first exploit high correlation across spectra and non-local self-similarity over space in the noisy HSI to learn an adaptive spatial-spectral dictionary. Then, we employ the local and non-local sparsity of the HSI under the learned spatial-spectral dictionary to design an HSI denoising model, which can be effectively solved by an iterative numerical algorithm with parameters that are adaptively adjusted for different clusters and different noise levels. Experimental results on HSI denoising show that the proposed method can provide substantial improvements over the current state-of-the-art HSI denoising methods in terms of both objective metric and subjective visual quality.

[1]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[2]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Qi Wang,et al.  3-D nonlocal means filter with noise estimation for hyperspectral imagery denoising , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[4]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[5]  Xin Huang,et al.  Hyperspectral image noise reduction based on rank-1 tensor decomposition , 2013 .

[6]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[7]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[8]  Guangming Shi,et al.  Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation , 2016, IEEE Transactions on Image Processing.

[9]  Salah Bourennane,et al.  Noise Removal From Hyperspectral Images by Multidimensional Filtering , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[11]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[12]  Guillermo Sapiro,et al.  Learning Discriminative Sparse Representations for Modeling, Source Separation, and Mapping of Hyperspectral Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[14]  Costas Balas,et al.  Hyperspectral image acquisition and analysis of skin , 2003, SPIE BiOS.

[15]  Qi Xie,et al.  A Novel Sparsity Measure for Tensor Recovery , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[17]  Mustafa Teke,et al.  A short survey of hyperspectral remote sensing applications in agriculture , 2013, 2013 6th International Conference on Recent Advances in Space Technologies (RAST).

[18]  Levent Sendur,et al.  Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency , 2002, IEEE Trans. Signal Process..

[19]  Jean-Michel Morel,et al.  Self-Similarity Driven Color Demosaicking , 2009, IEEE Transactions on Image Processing.

[20]  R. K. Rowe,et al.  Multispectral fingerprint biometrics , 2005, Proceedings from the Sixth Annual IEEE SMC Information Assurance Workshop.

[21]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[22]  Bjørn K. Alsberg,et al.  Superresolution of hyperspectral images , 2006 .

[23]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Masahiro Yamaguchi,et al.  Color reproduction from low-SNR multispectral images using spatio-spectral Wiener estimation. , 2008, Optics express.

[26]  Quan Pan,et al.  Hyperspectral imagery super-resolution by sparse representation and spectral regularization , 2011, EURASIP J. Adv. Signal Process..

[27]  D. Elder,et al.  Differentiation of normal skin and melanoma using high resolution hyperspectral imaging , 2006, Cancer biology & therapy.

[28]  Shen-En Qian,et al.  Noise reduction of hyperspectral imagery using hybrid spatial-spectral derivative-domain wavelet shrinkage , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Ayan Chakrabarti,et al.  Statistics of real-world hyperspectral images , 2011, CVPR 2011.

[30]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jessica C. Ramella-Roman,et al.  Detection of blood oxygen level by noninvasive passive spectral imaging of skin , 2008, SPIE BiOS.

[32]  Guangyi Chen,et al.  Denoising and dimensionality reduction of hyperspectral imagery using wavelet packets, neighbour shrinking and principal component analysis , 2009 .

[33]  Ping Zhong,et al.  Multiple-Spectral-Band CRFs for Denoising Junk Bands of Hyperspectral Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Michael Elad,et al.  L1-L2 Optimization in Signal and Image Processing , 2010, IEEE Signal Processing Magazine.

[35]  Mehran Yazdi,et al.  Noise Reduction of Hyperspectral Images Using Kernel Non-Negative Tucker Decomposition , 2011, IEEE Journal of Selected Topics in Signal Processing.

[36]  Russell C. Hardie,et al.  Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Amit Banerjee,et al.  Hyperspectral video for illumination-invariant tracking , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[38]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[39]  M. Borengasser,et al.  Hyperspectral Remote Sensing: Principles and Applications , 2007 .

[40]  Xin Yu,et al.  Anisotropic Diffusion for Hyperspectral Imagery Enhancement , 2010, IEEE Sensors Journal.

[41]  Masatoshi Okutomi,et al.  Direct spatio-spectral datacube reconstruction from raw data using a spatially adaptive spatio-spectral basis , 2013, Electronic Imaging.

[42]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[43]  Minchao Ye,et al.  Hyperspectral Imagery Restoration Using Nonlocal Spectral-Spatial Structured Sparse Representation With Noise Estimation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Caroline Fossati,et al.  Improvement of Classification for Hyperspectral Images Based on Tensor Modeling , 2010, IEEE Geoscience and Remote Sensing Letters.

[45]  Lei Zhang,et al.  Centralized sparse representation for image restoration , 2011, 2011 International Conference on Computer Vision.

[46]  Yoichi Sato,et al.  Denoising hyperspectral images using spectral domain statistics , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[47]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[49]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[50]  Guangming Shi,et al.  Image Restoration via Simultaneous Sparse Coding: Where Structured Sparsity Meets Gaussian Scale Mixture , 2015, International Journal of Computer Vision.

[51]  Stephen Lin,et al.  Acquisition of High Spatial and Spectral Resolution Video with a Hybrid Camera System , 2014, International Journal of Computer Vision.

[52]  Yi Wang,et al.  Hyperspectral urban remote sensing image smoothing and enhancement using forward-and-backward diffusion , 2009, 2009 Joint Urban Remote Sensing Event.

[53]  Salah Bourennane,et al.  Denoising and Dimensionality Reduction Using Multilinear Tools for Hyperspectral Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[54]  Guangyi Chen,et al.  Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for hyperspectral images , 2012, Signal Process..

[56]  Yücel Altunbasak,et al.  Super-resolution reconstruction of hyperspectral images , 2005 .

[57]  Salah Bourennane,et al.  Improvement of Target Detection Methods by Multiway Filtering , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[58]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[59]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[60]  Douglas L. Jones,et al.  Wavelet-based hyperspectral image estimation , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[61]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[62]  Brian A. Wandell,et al.  Spatio-spectral reconstruction of the multispectral datacube using sparse recovery , 2008, 2008 15th IEEE International Conference on Image Processing.

[63]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[64]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[65]  Wei Liu,et al.  Image Fusion with Local Spectral Consistency and Dynamic Gradient Sparsity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[66]  Chih-Yuan Yang,et al.  Exploiting Self-similarities for Single Frame Super-Resolution , 2010, ACCV.

[67]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[68]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[69]  Qiang Ye,et al.  A Novel Method for Hyperspectral Image Classification Based on Laplacian Eigenmap Pixels Distribution-Flow , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[70]  Pierrick Coupé,et al.  Author manuscript, published in "Journal of Magnetic Resonance Imaging 2010;31(1):192-203" DOI: 10.1002/jmri.22003 Adaptive Non-Local Means Denoising of MR Images with Spatially Varying Noise Levels , 2010 .

[71]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[72]  Russell C. Hardie,et al.  Application of the stochastic mixing model to hyperspectral resolution enhancement , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[73]  Takahiro Okabe,et al.  Video Temporal Super-Resolution Based on Self-similarity , 2010, ACCV.

[74]  Jianglin Ma,et al.  Superresolution Enhancement of Hyperspectral CHRIS/Proba Images With a Thin-Plate Spline Nonrigid Transform Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[75]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[76]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[77]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.