Texture Variation Adaptive Image Denoising With Nonlocal PCA

Image textures, as a kind of local variations, provide important information for the human visual system. Many image textures, especially the small-scale or stochastic textures, are rich in high-frequency variations, and are difficult to be preserved. Current state-of-the-art denoising algorithms typically adopt a nonlocal approach consisting of image patch grouping and group-wise denoising filtering. To achieve a better image denoising while preserving the variations in texture, we first adaptively group high correlated image patches with the same kinds of texture elements (texels) via an adaptive clustering method. This adaptive clustering method is applied in an over-clustering-and-iterative-merging approach, where its noise robustness is improved with a custom merging threshold relating to the noise level and cluster size. For texture-preserving denoising of each cluster, considering that the variations in texture are captured and wrapped in not only the between-dimension energy variations but also the within-dimension variations of PCA transform coefficients, we further propose a PCA-transform-domain variation adaptive filtering method to preserve the local variations in textures. Experiments on natural images show the superiority of the proposed transform-domain variation adaptive filtering to traditional PCA-based hard or soft threshold filtering. As a whole, the proposed denoising method achieves a favorable texture-preserving performance both quantitatively and visually, especially for irregular textures, which is further verified in camera raw image denoising.

[1]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[2]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[3]  D. Donoho,et al.  The Optimal Hard Threshold for Singular Values is 4 / √ 3 , 2013 .

[4]  Andrew W. Fitzgibbon,et al.  Joint Demosaicing and Denoising via Learned Nonparametric Random Fields , 2014, IEEE Transactions on Image Processing.

[5]  Peyman Milanfar,et al.  Patch-Based Near-Optimal Image Denoising , 2012, IEEE Transactions on Image Processing.

[6]  Vladimir Katkovnik,et al.  A new method for varying adaptive bandwidth selection , 1999, IEEE Trans. Signal Process..

[7]  Anja Schindler,et al.  A Review and Comparison of Bandwidth Selection Methods for Kernel Regression , 2014 .

[8]  David Zhang,et al.  Two-stage image denoising by principal component analysis with local pixel grouping , 2010, Pattern Recognit..

[9]  Qian Du,et al.  Hyperspectral Image Restoration Based on Low-Rank Recovery With a Local Neighborhood Weighted Spectral–Spatial Total Variation Model , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[11]  Binjie Qin,et al.  Phase asymmetry guided adaptive fractional-order total variation and diffusion for feature-preserving ultrasound despeckling , 2018, 1810.12538.

[12]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[13]  Mingxin Jin,et al.  Low-rank and sparse decomposition with spatially adaptive filtering for sequential segmentation of 2D+t vessels. , 2018, Physics in medicine and biology.

[14]  Shutao Li,et al.  PCA-Based Edge-Preserving Features for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Caiming Zhang,et al.  Patch Grouping SVD-Based Denoising Aggregation Patch Grouping SVD-Based Denoising Aggregation Back Projection Noisy Image , 2015 .

[16]  David L. Donoho,et al.  Optimal Shrinkage of Singular Values , 2014, IEEE Transactions on Information Theory.

[17]  Andriana Olmos,et al.  A biologically inspired algorithm for the recovery of shading and reflectance images , 2004 .

[18]  Madjid Khalilian,et al.  K-Means Divide and Conquer Clustering , 2009, 2009 International Conference on Computer and Automation Engineering.

[19]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[20]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[21]  Aleksandra Pizurica,et al.  Estimating the probability of the presence of a signal of interest in multiresolution single- and multiband image denoising , 2006, IEEE Transactions on Image Processing.

[22]  Jason Sheng-Hong Tsai,et al.  Evolutionary Fuzzy Block-Matching-Based Camera Raw Image Denoising , 2017, IEEE Transactions on Cybernetics.

[23]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[24]  Ido Zachevsky,et al.  Statistics of Natural Stochastic Textures and Their Application in Image Denoising. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[25]  Rajesh Ahirwar A Novel K means Clustering Algorithm for Large Datasets Based on Divide and Conquer Technique , 2014 .

[26]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[27]  Loic A. Royer,et al.  Content-Aware Image Restoration: Pushing the Limits of Fluorescence Microscopy , 2018, bioRxiv.

[28]  Mingxin Jin,et al.  Accurate vessel extraction via tensor completion of background layer in X-ray coronary angiograms , 2019, Pattern Recognit..

[29]  Peyman Milanfar,et al.  Clustering-Based Denoising With Locally Learned Dictionaries , 2009, IEEE Transactions on Image Processing.

[30]  Jinsong Bao,et al.  Joint-Saliency Structure Adaptive Kernel Regression with Adaptive-Scale Kernels for Deformable Registration of Challenging Images , 2018, IEEE Access.

[31]  I. Johnstone On the distribution of the largest eigenvalue in principal components analysis , 2001 .

[32]  David Zhang,et al.  Gradient Histogram Estimation and Preservation for Texture Enhanced Image Denoising , 2014, IEEE Transactions on Image Processing.

[33]  Jérémie Bigot,et al.  Generalized SURE for optimal shrinkage of singular values in low-rank matrix denoising , 2016, J. Mach. Learn. Res..

[34]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[35]  Thierry Blu,et al.  A New SURE Approach to Image Denoising: Interscale Orthonormal Wavelet Thresholding , 2007, IEEE Transactions on Image Processing.

[36]  Rongchang Zhao,et al.  Retinal vessel optical coherence tomography images for anemia screening , 2018, Medical & Biological Engineering & Computing.

[37]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.

[38]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[39]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[40]  Jonathan Li,et al.  SAR Image Denoising via Clustering-Based Principal Component Analysis , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Rong Li,et al.  Extracting contrast-filled vessels in X-ray angiography by graduated RPCA with motion coherency constraint , 2017, Pattern Recognit..

[43]  Daniel Cremers,et al.  Efficient Nonlocal Means for Denoising of Textural Patterns , 2008, IEEE Transactions on Image Processing.

[44]  Jacob Benesty,et al.  New insights into the noise reduction Wiener filter , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[45]  Binjie Qin,et al.  Reducing Poisson noise and baseline drift in x-ray spectral images with bootstrap Poisson regression and robust nonparametric regression , 2013, Physics in medicine and biology.

[46]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision , 2016, International Journal of Computer Vision.

[47]  Kostadin Dabov,et al.  BM3D Image Denoising with Shape-Adaptive Principal Component Analysis , 2009 .

[48]  David L. Donoho,et al.  The Optimal Hard Threshold for Singular Values is 4/sqrt(3) , 2013, 1305.5870.

[49]  Binjie Qin,et al.  Detail-Preserving Image Denoising via Adaptive Clustering and Progressive PCA Thresholding , 2018, IEEE Access.

[50]  Alessandro Foi,et al.  Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise , 2013, IEEE Transactions on Image Processing.

[51]  Binjie Qin,et al.  Structure matching driven by joint-saliency-structure adaptive kernel regression , 2016, Appl. Soft Comput..

[52]  Shadrokh Samavi,et al.  Denoising by low-rank and sparse representations , 2016, J. Vis. Commun. Image Represent..