Video Denoising Based on a Spatiotemporal Gaussian Scale Mixture Model

We propose a video denoising algorithm based on a spatiotemporal Gaussian scale mixture model in the wavelet transform domain. This model simultaneously captures the local correlations between the wavelet coefficients of natural video sequences across both space and time. Such correlations are further strengthened with a motion compensation process, for which a Fourier domain noise-robust cross correlation algorithm is proposed for motion estimation. Bayesian least square estimation is used to recover the original video signal from the noisy observation. Experimental results show that the performance of the proposed approach is competitive when compared with state-of-the-art video denoising algorithms based on both peak signal-to-noise-ratio and structural similarity evaluations.

[1]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[2]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[3]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[4]  Yuan F. Zheng,et al.  Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Jean-Michel Morel,et al.  Denoising image sequences does not require motion estimation , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[6]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[7]  Michael Elad,et al.  Image Sequence Denoising via Sparse and Redundant Representations , 2009, IEEE Transactions on Image Processing.

[8]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[9]  M. Omair Ahmad,et al.  Video Denoising Based on Inter-frame Statistical Modeling of Wavelet Coefficients , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Patrick Bouthemy,et al.  Space-Time Adaptation for Patch-Based Image Sequence Restoration , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[12]  S. Mallat A wavelet tour of signal processing , 1998 .

[13]  D. Robinson,et al.  Fundamental performance limits in image registration , 2004, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  Thomas S. Huang,et al.  Image Sequence Analysis: Motion Estimation , 1981 .

[15]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[16]  Aggelos K. Katsaggelos,et al.  Noise reduction filters for dynamic image sequences: a review , 1995, Proc. IEEE.

[17]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[18]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[19]  Karen O. Egiazarian,et al.  Video Denoising Algorithm in Sliding 3D DCT Domain , 2005, ACIVS.

[20]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[21]  Edward H. Adelson,et al.  Noise removal via Bayesian wavelet coring , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[22]  D. Ruderman The statistics of natural images , 1994 .

[23]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[24]  Roberto Manduchi,et al.  Accuracy analysis for correlation-based image registration algorithms , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[25]  Stefano Alliney,et al.  Digital Image Registration Using Projections , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[27]  George E. P. Box,et al.  Bayesian Inference in Statistical Analysis: Box/Bayesian , 1992 .

[28]  Bruno A. Olshausen,et al.  Learning sparse, overcomplete representations of time-varying natural images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[29]  Mário A. T. Figueiredo,et al.  Wavelet-Based Image Estimation : An Empirical Bayes Approach Using Jeffreys ’ Noninformative Prior , 2001 .

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[32]  Paul W. Fieguth,et al.  Wavelet Video Denoising with Regularized Multiresolution Motion Estimation , 2006, EURASIP J. Adv. Signal Process..

[33]  Yap-Peng Tan,et al.  Video denoising using vector estimation of wavelet coefficients , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[34]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[35]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[36]  Jauvane Cavalcante de Oliveira Motion Estimation , 2008, Encyclopedia of Multimedia.

[37]  Ivan W. Selesnick,et al.  Video denoising using 2D and 3D dual-tree complex wavelet transforms , 2003, SPIE Optics + Photonics.

[38]  Justin K. Romberg,et al.  Bayesian tree-structured image modeling using wavelet-domain hidden Markov models , 2001, IEEE Trans. Image Process..

[39]  Aleksandra Pizurica,et al.  Wavelet-Domain Video Denoising Based on Reliability Measures , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  William K. Pratt,et al.  Correlation Techniques of Image Registration , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[41]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[42]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[43]  A. Pižurica,et al.  Combined wavelet domain and temporal video denoising , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[44]  J. Atick,et al.  STATISTICS OF NATURAL TIME-VARYING IMAGES , 1995 .

[45]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[46]  D. F. Andrews,et al.  Scale Mixtures of Normal Distributions , 1974 .

[47]  Zhou Wang,et al.  Video quality assessment using a statistical model of human visual speed perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[48]  Xin Li,et al.  Patch-Based Video Processing: A Variational Bayesian Approach , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Robert D. Nowak,et al.  Wavelet-based image estimation: an empirical Bayes approach using Jeffrey's noninformative prior , 2001, IEEE Trans. Image Process..

[50]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[51]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[52]  Zhou Wang,et al.  Statistics of natural image sequences: temporal motion smoothness by local phase correlations , 2009, Electronic Imaging.