Recursive bilateral filter for encoder-integrated video denoising

Video denoising based on temporal or spatiotemporal filtering is highly effective but computationally expensive due to the requirement of motion estimation. Encoder-integrated denoising is an efficient framework that embeds the filtering process into the encoding pipeline so that motion estimation for denoising can be avoided. State-of-the-arts encoder-integrated methods use Least Minimum Mean Square Error (LMMSE) optimal filters to reduce noise based on additive noise models. However, in practice, the LMMSE filters could result in blurred edges and visual artifacts due to inaccurate image signal estimation caused by outlier input samples and non-adaptivity within macroblocks. This paper presents new recursive bilateral filters that can be easily integrated into video encoders to tackle the limitations of the LMMSE filters. The robustness of the bilateral filters results in substantially better objective and subjective quality with marginal computation cost increase.

[1]  Hanno Scharr,et al.  Image statistics and anisotropic diffusion , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Oscar C. Au,et al.  An Encoder-Embedded Video Denoising Filter Based on the Temporal LMMSE Estimator , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[3]  Oscar C. Au,et al.  Integration of Recursive Temporal LMMSE Denoising Filter Into Video Codec , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Reginald L. Lagendijk,et al.  Embedded coring in MPEG video compression , 2002, IEEE Trans. Circuits Syst. Video Technol..

[5]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[7]  K. W. Chun,et al.  Motion-compensated temporal filtering for denoising in video encoder , 2004 .