Multispectral image denoising with optimized vector non-local mean filter

Nowadays, many applications rely on images of high quality to ensure good performance in conducting their tasks. However, noise goes against this objective as it is an unavoidable issue in most applications. Therefore, it is essential to develop techniques to attenuate the impact of noise, while maintaining the integrity of relevant information in images. We propose in this work to extend the application of the Non-Local Means filter (NLM) to the vector case and apply it for denoising multispectral images. The objective is to benefit from the additional information brought by multispectral imaging systems. The NLM filter exploits the redundancy of information in an image to remove noise. A restored pixel is a weighted average of all pixels in the image. In our contribution, we propose an optimization framework where we dynamically fine tune the NLM filter parameters and attenuate its computational complexity by considering only pixels which are most similar to each other in computing a restored pixel. Filter parameters are optimized using Stein's Unbiased Risk Estimator (SURE) rather than using ad hoc means. Experiments have been conducted on multispectral images corrupted with additive white Gaussian noise. PSNR and similarity comparison with other approaches are provided to illustrate the efficiency of our approach in terms of both denoising performance and computation complexity.

[1]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[2]  Andrea Salgian,et al.  Face recognition with visible and thermal infrared imagery , 2003, Comput. Vis. Image Underst..

[3]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[4]  Rakesh Gandhi,et al.  Hyperspectral Image Denoising with a Spatial – Spectral View Fusion Strategy , 2015 .

[5]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[6]  C. Lemieux Monte Carlo and Quasi-Monte Carlo Sampling , 2009 .

[7]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[8]  Raghuveer M. Rao,et al.  Hyperspectral image enhancement with vector bilateral filtering , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[9]  Stephen C. Cain,et al.  Sampling, radiometry, and image reconstruction for polar and geostationary meteorological remote sensing systems , 2002, SPIE Optics + Photonics.

[10]  Thierry Blu,et al.  The SURE-LET Approach to Image Denoising , 2007, IEEE Transactions on Image Processing.

[11]  Bruce J. Tromberg,et al.  Hyperspectral face recognition under variable outdoor illumination , 2004, SPIE Defense + Commercial Sensing.

[12]  I. Pavlidis,et al.  The imaging issue in an automatic face/disguise detection system , 2000, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640).

[13]  Xiangtao Zheng,et al.  Spectral–Spatial Kernel Regularized for Hyperspectral Image Denoising , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Victor Solo,et al.  Selecting the Number of Principal Components with SURE , 2015, IEEE Signal Processing Letters.

[15]  Jie Li,et al.  Hyperspectral image recovery employing a multidimensional nonlocal total variation model , 2015, Signal Process..

[16]  David A. Clausi,et al.  Hyperspectral Image Denoising Using a Spatial–Spectral Monte Carlo Sampling Approach , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  David A. Clausi,et al.  Stochastic image denoising based on Markov-chain Monte Carlo sampling , 2011, Signal Process..

[18]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[20]  Bruce J. Tromberg,et al.  Face Recognition in Hyperspectral Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Amel Benazza-Benyahia,et al.  A Nonlinear Stein-Based Estimator for Multichannel Image Denoising , 2007, IEEE Transactions on Signal Processing.

[23]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[24]  Guoqing Li,et al.  Remote-Sensing Image Denoising Using Partial Differential Equations and Auxiliary Images as Priors , 2012, IEEE Geoscience and Remote Sensing Letters.

[25]  Robert V. Hogg,et al.  Introduction to Mathematical Statistics. , 1966 .

[26]  Honghong Peng,et al.  Multispectral Image Denoising With Optimized Vector Bilateral Filter , 2014, IEEE Transactions on Image Processing.

[27]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[28]  Jianlou Xu,et al.  A variational model based on split Bregman method for multiplicative noise removal , 2015 .

[29]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[30]  Ram M. Narayanan,et al.  Noise estimation in remote sensing imagery using data masking , 2003 .

[31]  Mongi A. Abidi,et al.  An Indoor and Outdoor, Multimodal, Multispectral and Multi-Illuminant Database for Face Recognition , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[32]  C. Stein Estimation of the Mean of a Multivariate Normal Distribution , 1981 .

[33]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[34]  Thierry Blu,et al.  SURE-LET Multichannel Image Denoising: Interscale Orthonormal Wavelet Thresholding , 2008, IEEE Transactions on Image Processing.

[35]  G. Healey,et al.  Face recognition in hyperspectral images - Pattern Analysis and Machine Intelligence, IEEE Transactions on , 2001 .

[36]  Paul Scheunders,et al.  Wavelet-Based EM Algorithm for Multispectral-Image Restoration , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Yilun Wang,et al.  Iterative Support Detection-Based Split Bregman Method for Wavelet Frame-Based Image Inpainting , 2014, IEEE Transactions on Image Processing.

[38]  Dimitri Van De Ville,et al.  SURE-Based Non-Local Means , 2009, IEEE Signal Processing Letters.

[39]  Liangpei Zhang,et al.  Hyperspectral Image Denoising With a Spatial–Spectral View Fusion Strategy , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[41]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[42]  G. Reinsel,et al.  Introduction to Mathematical Statistics (4th ed.). , 1980 .

[43]  Honghong Peng,et al.  Optimized vector bilateral filter for multispectral image denoising , 2012, 2012 19th IEEE International Conference on Image Processing.

[44]  Yongqiang Zhao,et al.  Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Seong G. Kong,et al.  Multiscale Fusion of Visible and Thermal IR Images for Illumination-Invariant Face Recognition , 2007, International Journal of Computer Vision.

[46]  Yue Wu,et al.  Fast blockwise SURE shrinkage for image denoising , 2014, Signal Process..

[47]  Ahmed Bouridane,et al.  Biometric Recognition Systems Using Multispectral Imaging , 2014, Bio-inspiring Cyber Security and Cloud Services.

[48]  Stephen Lin,et al.  A Probabilistic Intensity Similarity Measure based on Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.