A Kalman Filter based Video Denoising Method Using Intensity and Structure Tensor

We propose a video denoising method based on Kalman filter to reduce the noise in video sequences. Firstly, with the strong spatiotemporal correlations of neighboring frames, motion estimation is performed on video frames consisting of previous denoised frames and current noisy frame based on intensity and structure tensor. The current noisy frame is processed in temporal domain by using motion estimation result as the parameter in the Kalman filter, while it is also processed in spatial domain using the Wiener filter. Finally, by weighting the denoised frames from the Kalman and the Wiener filtering, a satisfactory result can be obtained. Experimental results show that the performance of our proposed method is competitive when compared with state-of-the-art video denoising algorithms based on both peak signal-to-noise-ratio and structural similarity evaluations.

[1]  Aleksandra Pizurica,et al.  Wavelet-Domain Video Denoising Based on Reliability Measures , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[3]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[4]  Xin Li,et al.  Patch-Based Video Processing: A Variational Bayesian Approach , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Aleksandra Pizurica,et al.  Combined Wavelet-Domain and Motion-Compensated Video Denoising Based on Video Codec Motion Estimation Methods , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Karen O. Egiazarian,et al.  Video Denoising Algorithm in Sliding 3D DCT Domain , 2005, ACIVS.

[8]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[9]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[11]  Jae S. Lim,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[12]  Paul W. Fieguth,et al.  Wavelet Video Denoising with Regularized Multiresolution Motion Estimation , 2006, EURASIP J. Adv. Signal Process..

[13]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[14]  Yap-Peng Tan,et al.  Video denoising using vector estimation of wavelet coefficients , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[15]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[16]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[17]  N. Ayache,et al.  Log‐Euclidean metrics for fast and simple calculus on diffusion tensors , 2006, Magnetic resonance in medicine.

[18]  M. Omair Ahmad,et al.  Video Denoising Based on Inter-frame Statistical Modeling of Wavelet Coefficients , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Zhou Wang,et al.  Video Denoising Based on a Spatiotemporal Gaussian Scale Mixture Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Karen O. Egiazarian,et al.  Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal Transforms , 2012, IEEE Transactions on Image Processing.

[21]  Thierry Blu,et al.  SURE-LET for Orthonormal Wavelet-Domain Video Denoising , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[24]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[25]  Bin Wang,et al.  Learning Free Energy Kernel for Image Retrieval , 2014, KSII Trans. Internet Inf. Syst..

[26]  Hanno Scharr,et al.  A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance , 2002, J. Vis. Commun. Image Represent..

[27]  Rushan Chen,et al.  Efficient video denoising based on dynamic nonlocal means , 2012, Image Vis. Comput..

[28]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[29]  Leonard McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, ACM Trans. Graph..

[30]  Michael Elad,et al.  Image Sequence Denoising via Sparse and Redundant Representations , 2009, IEEE Transactions on Image Processing.