The iDUDE Framework for Grayscale Image Denoising

We present an extension of the discrete universal denoiser DUDE, specialized for the denoising of grayscale images. The original DUDE is a low-complexity algorithm aimed at recovering discrete sequences corrupted by discrete memoryless noise of known statistical characteristics. It is universal, in the sense of asymptotically achieving, without access to any information on the statistics of the clean sequence, the same performance as the best denoiser that does have access to such information. The DUDE, however, is not effective on grayscale images of practical size. The difficulty lies in the fact that one of the DUDE's key components is the determination of conditional empirical probability distributions of image samples, given the sample values in their neighborhood. When the alphabet is relatively large (as is the case with grayscale images), even for a small-sized neighborhood, the required distributions would be estimated from a large collection of sparse statistics, resulting in poor estimates that would not enable effective denoising. The present work enhances the basic DUDE scheme by incorporating statistical modeling tools that have proven successful in addressing similar issues in lossless image compression. Instantiations of the enhanced framework, which is referred to as iDUDE, are described for examples of additive and nonadditive noise. The resulting denoisers significantly surpass the state of the art in the case of salt and pepper (S&P) and -ary symmetric noise, and perform well for Gaussian noise.

[1]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[2]  Tsachy Weissman,et al.  Universal Denoising of Continuous Amplitude Signals with Applications to Images , 2006, 2006 International Conference on Image Processing.

[3]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[4]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[5]  Stanley Osher,et al.  Total variation based image restoration with free local constraints , 1994, Proceedings of 1st International Conference on Image Processing.

[6]  Mila Nikolova,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[7]  Jyh-Charn Liu,et al.  Selective removal of impulse noise based on homogeneity level information , 2003, IEEE Trans. Image Process..

[8]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[9]  Guillermo Sapiro,et al.  The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS , 2000, IEEE Trans. Image Process..

[10]  Richard A. Haddad,et al.  Adaptive median filters: new algorithms and results , 1995, IEEE Trans. Image Process..

[11]  Tsachy Weissman,et al.  Universal discrete denoising , 2002, Proceedings of the IEEE Information Theory Workshop.

[12]  Nasir D. Memon,et al.  Context-based, adaptive, lossless image coding , 1997, IEEE Trans. Commun..

[13]  Sergio Verdú,et al.  Universal Algorithms for Channel Decoding of Uncompressed Sources , 2008, IEEE Transactions on Information Theory.

[14]  Raymond H. Chan,et al.  Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization , 2005, IEEE Transactions on Image Processing.

[15]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[16]  Charles K. Chui,et al.  A universal noise removal algorithm with an impulse detector , 2005, IEEE Transactions on Image Processing.

[17]  J. Rissanen Stochastic Complexity in Statistical Inquiry Theory , 1989 .

[18]  M.J. Weinberger,et al.  Lossless compression of continuous-tone images , 2000, Proceedings of the IEEE.

[19]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[20]  Michael Elad,et al.  Image Denoising Via Learned Dictionaries and Sparse representation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[22]  Giovanni Motta,et al.  The DUDE framework for continuous tone image denoising , 2005, IEEE International Conference on Image Processing 2005.

[23]  Jorma Rissanen,et al.  Universal coding, information, prediction, and estimation , 1984, IEEE Trans. Inf. Theory.

[24]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  M. Omair Ahmad,et al.  Bayesian Wavelet-Based Image Denoising Using the Gauss–Hermite Expansion , 2008, IEEE Transactions on Image Processing.

[26]  Tsachy Weissman,et al.  Universal discrete denoising: known channel , 2003, IEEE Transactions on Information Theory.

[27]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[28]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[29]  Tsachy Weissman,et al.  A discrete universal denoiser and its application to binary images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[30]  A.N. Netravali,et al.  Picture coding: A review , 1980, Proceedings of the IEEE.

[31]  Guy Gilboa,et al.  Constrained and SNR-Based Solutions for TV-Hilbert Space Image Denoising , 2006, Journal of Mathematical Imaging and Vision.

[32]  Neri Merhav,et al.  Optimal prefix codes for two-sided geometric distributions , 1997, Proceedings of IEEE International Symposium on Information Theory.

[33]  Nick G. Kingsbury,et al.  Image Denoising Using Derotated Complex Wavelet Coefficients , 2008, IEEE Transactions on Image Processing.

[34]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[35]  Tsachy Weissman,et al.  Universal denoising for the finite-input general-output channel , 2005, IEEE Transactions on Information Theory.

[36]  Tsachy Weissman,et al.  Multi-directional context sets with applications to universal denoising and compression , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[37]  Jorma Rissanen,et al.  Applications of universal context modeling to lossless compression of gray-scale images , 1995, Conference Record of The Twenty-Ninth Asilomar Conference on Signals, Systems and Computers.

[38]  Gadiel Seroussi,et al.  Sequential prediction and ranking in universal context modeling and data compression , 1997, IEEE Trans. Inf. Theory.

[39]  Neri Merhav,et al.  Optimal prefix codes for sources with two-sided geometric distributions , 2000, IEEE Trans. Inf. Theory.