Local Activity-tuned Image Filtering for Noise Removal and Image Smoothing

In this paper, two local activity-tuned filtering frameworks are proposed for noise removal and image smoothing, where the local activity measurement is given by the clipped and normalized local variance or standard deviation. The first framework is a modified anisotropic diffusion for noise removal of piece-wise smooth image. The second framework is a local activity-tuned Relative Total Variation (LAT-RTV) method for image smoothing. Both frameworks employ the division of gradient and the local activity measurement to achieve noise removal. In addition, to better capture local information, the proposed LAT-RTV uses the product of gradient and local activity measurement to boost the performance of image smoothing. Experimental results are presented to demonstrate the efficiency of the proposed methods on various applications, including depth image filtering, clip-art compression artifact removal, image smoothing, and image denoising.

[1]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[3]  T. J. Dennis,et al.  Nonlinear smoothing of stereo disparity maps , 1994 .

[4]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[5]  Subhasis Saha,et al.  An analysis on the effect of image activity on lossy coding performance , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[6]  Rachid Deriche,et al.  Dense Disparity Map Estimation Respecting Image Discontinuities: A PDE and Scale-Space BasedApproach , 2002, MVA.

[7]  Richard Szeliski,et al.  Stereo Matching with Nonlinear Diffusion , 1998, International Journal of Computer Vision.

[8]  Henrique S. Malvar,et al.  An efficient binary image activity detector based on connected components , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Jeremy R. Cooperstock,et al.  Improving Depth Maps by Nonlinear Diffusion , 2004, WSCG.

[10]  L. Radouane.  A New Adaptive Anisotropic Diffusion using the Local Intensity Variance , 2005 .

[11]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Soo In Lee,et al.  Depth-image-based stereoscopic image rendering considering IDCT and anisotropic diffusion , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[13]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[14]  Jian Bai,et al.  Fractional-Order Anisotropic Diffusion for Image Denoising , 2007, IEEE Transactions on Image Processing.

[15]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[16]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[17]  Du-Ming Tsai,et al.  An improved anisotropic diffusion model for detail- and edge-preserving smoothing , 2010, Pattern Recognit. Lett..

[18]  Du-Ming Tsai,et al.  Anisotropic diffusion-based detail-preserving smoothing for image restoration , 2010, 2010 IEEE International Conference on Image Processing.

[19]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[20]  Richard Szeliski,et al.  Multigrid and multilevel preconditioners for computational photography , 2011, ACM Trans. Graph..

[21]  Michael Unser,et al.  Fast $O(1)$ Bilateral Filtering Using Trigonometric Range Kernels , 2011, IEEE Transactions on Image Processing.

[22]  Thomas Wiegand,et al.  Depth Image-Based Rendering With Advanced Texture Synthesis for 3-D Video , 2010, IEEE Transactions on Multimedia.

[23]  Dong Tian,et al.  New Depth Coding Techniques With Utilization of Corresponding Video , 2011, IEEE Transactions on Broadcasting.

[24]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[25]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[26]  Aykut Erdem,et al.  Structure-preserving image smoothing via region covariances , 2013, ACM Trans. Graph..

[27]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Oscar C. Au,et al.  Depth map denoising using graph-based transform and group sparsity , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[29]  Xinpeng Zhang,et al.  An Effective CU Size Decision Method for HEVC Encoders , 2013, IEEE Transactions on Multimedia.

[30]  Lai-Man Po,et al.  Adaptive depth truncation filter for MVC based compressed depth image , 2014, Signal Process. Image Commun..

[31]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[32]  Li-Wei Kang,et al.  Self-Learning Based Image Decomposition With Applications to Single Image Denoising , 2014, IEEE Transactions on Multimedia.

[33]  B. Zeng,et al.  Candidate value-based boundary filtering for compressed depth images , 2015 .

[34]  Jianjun Lei,et al.  Depth Sensation Enhancement for Multiple Virtual View Rendering , 2015, IEEE Transactions on Multimedia.

[35]  Zheng Li,et al.  Stereo matching algorithm with guided filter and modified dynamic programming , 2015, Multimedia Tools and Applications.

[36]  Depth filtering using total variation based video decomposition , 2015, 2015 Third International Conference on Image Information Processing (ICIIP).

[37]  Kunal N. Chaudhury,et al.  Image denoising using optimally weighted bilateral filters: A sure and fast approach , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[38]  Yao Zhao,et al.  Depth Map Down-Sampling and Coding Based on Synthesized View Distortion , 2016, IEEE Transactions on Multimedia.

[39]  Kunal N. Chaudhury,et al.  Fast and Provably Accurate Bilateral Filtering , 2016, IEEE Transactions on Image Processing.

[40]  Manoranjan Paul,et al.  Lossless depth map coding using binary tree based decomposition and context-based arithmetic coding , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[41]  Chengwei Li,et al.  Single-image-based rain streak removal using multidimensional variational mode decomposition and bilateral filter , 2017, J. Electronic Imaging.

[42]  Jean Ponce,et al.  Robust Guided Image Filtering Using Nonconvex Potentials , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.