Iterative range-domain weighted filter for structural preserving image smoothing and de-noising

The filtering weights from both spatial domain and range domain in the bilateral filtering always restrict filtering output value highly related to very close neighboring pixels, which results in very small changes before and after filtering. In order to better resolve the problem of piece-wise smoothness image’s de-noising, such as artifact removal of compressed depth image, we firstly propose an iterative range-domain weighted filter method. The filtering weights of the proposed method are calculated within a fixed window in an iterative way according to both pixel similarity in the range domain and image’s pixel occurring frequency, but there is no filtering weight from the spatial domain. Secondly, the proposed method is combined with Gaussian filtering as an engine in order to finish the task of image smoothing, because image smoothing for extracting structures is often sensitive to image’s fine details with strong gradients during suppressing image’s textures. To demonstrate the efficiency, we have applied the proposed method into many applications. For example, the proposed method has better performances on compressed depth artifact removal than BF, CVBF, and ADTF. Meanwhile, the proposed method is used for capture-noise removal of depth image. Additionally, the proposed method performs better performance on structural information preservation for image smoothing, as compared to several existing methods.

[1]  Denis Zorin,et al.  Real-time rendering of textures with feature curves , 2008, TOGS.

[2]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications: Series: Foundations and Trends® in Computer Graphics and Vision , 2009 .

[3]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[4]  Yao Zhao,et al.  Two-stage filtering of compressed depth images with Markov Random Field , 2017, Signal Process. Image Commun..

[5]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[6]  Joost van de Weijer,et al.  Local Mode Filtering , 2001, CVPR.

[7]  Dorin Comaniciu,et al.  A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift , 2004, Image Vis. Comput..

[8]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[9]  Robert D. Nowak,et al.  Wavelet-based Rician noise removal for magnetic resonance imaging , 1999, IEEE Trans. Image Process..

[10]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  B. Zeng,et al.  Candidate value-based boundary filtering for compressed depth images , 2015 .

[14]  Jean Ponce,et al.  Robust Guided Image Filtering Using Nonconvex Potentials , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[16]  Lai-Man Po,et al.  Adaptive depth truncation filter for MVC based compressed depth image , 2014, Signal Process. Image Commun..

[17]  Yao Zhao,et al.  Joint iterative guidance filtering for compressed depth images , 2016, 2016 Visual Communications and Image Processing (VCIP).

[18]  Baining Guo,et al.  Context-aware textures , 2007, TOGS.

[19]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[20]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[21]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields , 2010, Found. Trends Mach. Learn..

[22]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[24]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[25]  Aykut Erdem,et al.  Structure-preserving image smoothing via region covariances , 2013, ACM Trans. Graph..

[26]  Minh N. Do,et al.  Depth Video Enhancement Based on Weighted Mode Filtering , 2012, IEEE Transactions on Image Processing.

[27]  Oscar C. Au,et al.  Depth map denoising using graph-based transform and group sparsity , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[28]  Hans-Peter Seidel,et al.  Coherent Spatiotemporal Filtering, Upsampling and Rendering of RGBZ Videos , 2012, Comput. Graph. Forum.

[29]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications , 2009, Found. Trends Comput. Graph. Vis..

[30]  Feng Liu,et al.  Depth Enhancement via Low-Rank Matrix Completion , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Dong Tian,et al.  New Depth Coding Techniques With Utilization of Corresponding Video , 2011, IEEE Transactions on Broadcasting.