Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising

Hyperspectral imagery (HSI) denoising is a challenging problem because of the difficulty in preserving both spectral and spatial structures simultaneously. In recent years, sparse coding, among many methods dedicated to the problem, has attracted much attention and showed state-of-the-art performance. Due to the low-rank property of natural images, an assumption can be made that the latent clean signal is a linear combination of a minority of basis atoms in a dictionary, while the noise component is not. Based on this assumption, denoising can be explored as a sparse signal recovery task with the support of a dictionary. In this paper, we propose to solve the HSI denoising problem by sparse nonnegative matrix factorization (SNMF), which is an integrated model that combines parts-based dictionary learning and sparse coding. The noisy image is used as the training data to learn a dictionary, and sparse coding is used to recover the image based on this dictionary. Unlike most HSI denoising approaches, which treat each band image separately, we take the joint spectral-spatial structure of HSI into account. Inspired by multitask learning, a multitask SNMF (MTSNMF) method is developed, in which bandwise denoising is linked across the spectral domain by sharing a common coefficient matrix. The intrinsic image structures are treated differently but interdependently within the spatial and spectral domains, which allows the physical properties of the image in both spatial and spectral domains to be reflected in the denoising model. The experimental results show that MTSNMF has superior performance on both synthetic and real-world data compared with several other denoising methods.

[1]  Johannes R. Sveinsson,et al.  Hyperspectral Image Denoising Using First Order Spectral Roughness Penalty in Wavelet Domain , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Shen-En Qian,et al.  Noise reduction of hyperspectral imagery using hybrid spatial-spectral derivative-domain wavelet shrinkage , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Grégoire Mercier,et al.  Nonlinear filtering of hyperspectral images with anisotropic diffusion , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[4]  Salah Bourennane,et al.  Noise Removal From Hyperspectral Images by Multidimensional Filtering , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Christian Jutten,et al.  Image Denoising Using Sparse Representations , 2009, ICA.

[6]  Shuyuan Yang,et al.  Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction , 2011, Neurocomputing.

[7]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Christoph Schnörr,et al.  Learning Sparse Representations by Non-Negative Matrix Factorization and Sequential Cone Programming , 2006, J. Mach. Learn. Res..

[10]  Pascal Frossard,et al.  Dictionary Learning , 2011, IEEE Signal Processing Magazine.

[11]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[12]  Ping Zhong,et al.  Jointly Learning the Hybrid CRF and MLR Model for Simultaneous Denoising and Classification of Hyperspectral Imagery , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[13]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[14]  Ping Zhong,et al.  Multiple-Spectral-Band CRFs for Denoising Junk Bands of Hyperspectral Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Johannes R. Sveinsson,et al.  Hyperspectral image denoising using a new linear model and Sparse Regularization , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[16]  Massimiliano Pontil,et al.  Regularized multi--task learning , 2004, KDD.

[17]  Mehran Yazdi,et al.  Noise Reduction of Hyperspectral Images Using Kernel Non-Negative Tucker Decomposition , 2011, IEEE Journal of Selected Topics in Signal Processing.

[18]  Dong-Jo Park,et al.  Noise reduction of hyperspectral images using a joint bilateral filter with fused images , 2011, Defense + Commercial Sensing.

[19]  Jianshu Luo,et al.  Analysis and Denoising of Hyperspectral Remote Sensing Image in the Curvelet Domain , 2013 .

[20]  Sen Jia,et al.  Noise reduction of hyperspectral imagery based on nonlocal tensor factorization , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[21]  Nicolas Gillis,et al.  Accelerated Multiplicative Updates and Hierarchical ALS Algorithms for Nonnegative Matrix Factorization , 2011, Neural Computation.

[22]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Julio Martín-Herrero,et al.  Tensor-Driven Hyperspectral Denoising: A Strong Link for Classification Chains? , 2010, 2010 20th International Conference on Pattern Recognition.

[24]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[25]  Qi Wang,et al.  Panchromatic image based dictionary learning for hyperspectral imagery denoising , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[26]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[27]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[28]  Minchao Ye,et al.  Hyperspectral Imagery Restoration Using Nonlocal Spectral-Spatial Structured Sparse Representation With Noise Estimation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[30]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[32]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[33]  Yan Zhou,et al.  Image Denoising Using a Modified LNMF Algorithm , 2012, 2012 International Conference on Computer Science and Service System.

[34]  Silong Peng,et al.  Denoising of hyperspectral imagery using a spatial-spectral domain mixing prior , 2012, 2012 20th International Conference on Geoinformatics.

[35]  Johannes R. Sveinsson,et al.  Hyperspectral image denoising using 3D wavelets , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[36]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[37]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[38]  Yongqiang Zhao,et al.  Hyperspectral image denoising via sparsity and low rank , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[39]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[40]  Guangyi Chen,et al.  Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Marco Diani,et al.  Signal-Dependent Noise Modeling and Model Parameter Estimation in Hyperspectral Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[42]  S. Shankar Sastry,et al.  Generalized principal component analysis (GPCA) , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[44]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[45]  Guillermo Sapiro,et al.  Dictionary Learning for Noisy and Incomplete Hyperspectral Images , 2012, SIAM J. Imaging Sci..

[46]  Minchao Ye,et al.  Mixed Poisson-Gaussian noise model based sparse denoising for hyperspectral imagery , 2012, 2012 4th Workshop on Hyperspectral Image and Signal Processing (WHISPERS).

[47]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[48]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[49]  David Mary,et al.  Sparsity-based denoising of hyperspectral astrophysical data with colored noise: Application to the MUSE instrument , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[50]  R. Plemmons,et al.  Optimality, computation, and interpretation of nonnegative matrix factorizations , 2004 .

[51]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[52]  Andrzej Cichocki,et al.  Hierarchical ALS Algorithms for Nonnegative Matrix and 3D Tensor Factorization , 2007, ICA.

[53]  Qi Wang,et al.  Noise reduction of hyperspectral imagery using nonlocal sparse representation with spectral-spatial structure , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[54]  Liviu Badea,et al.  Extracting Gene Expression Profiles Common to Colon and Pancreatic Adenocarcinoma Using Simultaneous Nonnegative Matrix Factorization , 2007, Pacific Symposium on Biocomputing.

[55]  R. M. Farouk,et al.  Image Denoising based on Sparse Representation and Non-Negative Matrix Factorization , 2012 .

[56]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[57]  Qi Wang,et al.  3-D nonlocal means filter with noise estimation for hyperspectral imagery denoising , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[58]  Shuxue Ding,et al.  Dictionary Learning Based on Nonnegative Matrix Factorization Using Parallel Coordinate Descent , 2013 .

[59]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .