Noise reduction in high-ISO images using 3-D collaborative filtering and structure extraction from residual blocks

This paper proposes a noise reduction method in digital camera images at high-International Organization for Standardization (ISO) setting. Noise characteristics of luminance and chrominance channels in high-ISO images are different, so we decompose an image into luminance and chrominance channels and process them differently. With luminance image, we perform three-dimensional (3-D) collaborative filtering and structure extraction from residual blocks. The proposed method groups similar two-dimensional blocks into 3-D arrays for collaborative filtering in the transform domain. Residual blocks obtained by 3-D collaborative filtering contain structure residual as well as noise. A modified joint image-noise filter is used to extract structure residual from residual blocks. Finally, denoised blocks and structure residual blocks are returned to their original locations. To process overlapping blocks obtained from 3-D filtering and structure extraction, aggregation is used. Chrominance images at high-ISO setting are observed to have coarse-grain noise. To reduce color noise, we use a multiresolution framework, where chrominance images are decomposed into low- and high-frequency subbands. 3-D collaborative filtering is applied to low-frequency subband whereas hard-thresholding is used in high-frequency subbands. Experimental results with various test images at high-ISO setting show that the proposed method gives better subjective visual quality than other state-of-the-art image denoising methods.

[1]  Pavel Kisilev,et al.  Denoising scheme for realistic digital photos from unknown sources , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Sergio R. Goma,et al.  An image-noise filter with emphasis on low-frequency chrominance noise , 2009, Electronic Imaging.

[3]  I. Selesnick,et al.  Bivariate shrinkage with local variance estimation , 2002, IEEE Signal Processing Letters.

[4]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[5]  Tamer F. Rabie Adaptive hybrid mean and median filtering of high-ISO long-exposure sensor noise for digital photography , 2004, J. Electronic Imaging.

[6]  Youngjin Yoo,et al.  Low-light imaging method with visible-band and wide-band image pair , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Jon Canfield Raw 101: Better Images with Photoshop and Photoshop Elements , 2005 .

[8]  J. Portilla BLIND NON-WHITE NOISE REMOVAL IN IMAGES USING GAUSSIAN SCALE MIXTURES IN THE WAVELET DOMAIN , 2004 .

[9]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[10]  Qian Chen,et al.  Image denoising by bounded block matching and 3D filtering , 2010, Signal Process..

[11]  Takahiro Saito,et al.  Hard color-shrinkage for color-image processing of a digital color camera , 2010, Electronic Imaging.

[12]  Youngjin Yoo,et al.  Profile based fast noise estimation and high ISO noise reduction for digital cameras , 2008, Electronic Imaging.

[13]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[15]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[16]  Karen O. Egiazarian,et al.  Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space , 2007, 2007 IEEE International Conference on Image Processing.

[17]  Jean-Michel Morel,et al.  Denoising image sequences does not require motion estimation , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[18]  R. Weissleder,et al.  Block matching 3D random noise filtering for absorption optical projection tomography , 2010, Physics in medicine and biology.

[19]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[20]  Yuzhong Shen,et al.  Parameter optimization for image denoising based on block matching and 3D collaborative filtering , 2009, Medical Imaging.

[21]  Aleksandra Pizurica,et al.  A joint inter- and intrascale statistical model for Bayesian wavelet based image denoising , 2002, IEEE Trans. Image Process..

[22]  Javier Portilla,et al.  Two-level adaptive denoising using Gaussian scale mixtures in overcomplete oriented pyramids , 2005, IEEE International Conference on Image Processing 2005.

[23]  R. Fergus,et al.  Dark flash photography , 2009, ACM Trans. Graph..

[24]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[25]  Seong-Won Lee,et al.  Noise-adaptive spatio-temporal filter for real-time noise removal in low light level images , 2005, IEEE Trans. Consumer Electron..

[26]  Zhou Wang,et al.  The Use of Residuals in Image Denoising , 2009, ICIAR.

[27]  Ming Zhang,et al.  Multiresolution Bilateral Filtering for Image Denoising , 2008, IEEE Transactions on Image Processing.

[28]  Yong Cheng,et al.  Comments on "Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering" , 2011, IEEE Trans. Image Process..