Image Smoothing via Truncated Total Variation

We present a new regularizer for image smoothing which is particularly effective for diminishing insignificant details, while preserving salient edges. The proposed regularizer relates in spirit to total variation which penalizes all the gradients, while our method just penalizes part of the gradients and leaves the significant edges unchanged. Though the proposed regularizer is a piecewise function, which is hard to optimize, we can unify it to a mathematically sound penalty. The unified penalty term is easy to optimize using recent fast solvers and hard thresholding operation. We show some potential applications of the proposed regularizer, including texture removal and compression artifact restoration. The results show the efficiency of the proposed regularizer.

[1]  Michael Elad,et al.  On the bilateral filter and ways to improve it , 2002 .

[2]  Jonathan T. Barron,et al.  The Fast Bilateral Solver , 2015, ECCV.

[3]  Narendra Ahuja,et al.  Deep Joint Image Filtering , 2016, ECCV.

[4]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[5]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, SIGGRAPH 2006.

[6]  Jonathan T. Barron,et al.  Deep bilateral learning for real-time image enhancement , 2017, ACM Trans. Graph..

[7]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[8]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[9]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[10]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[11]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[12]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[13]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[14]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[16]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[17]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..