Semi-Sparsity for Smoothing Filters

In this paper, we propose a semi-sparsity smoothing method based on a new sparsity-induced minimization scheme. The model is derived from the observations that semi-sparsity prior knowledge is universally applicable in situations where sparsity is not fully admitted such as in the polynomial-smoothing surfaces. We illustrate that such priors can be identified into a generalized <inline-formula> <tex-math notation="LaTeX">$L_{0}$ </tex-math></inline-formula>-norm minimization problem in higher-order gradient domains, giving rise to a new “feature-aware” filter with a powerful simultaneous-fitting ability in both sparse singularities (corners and salient edges) and polynomial-smoothing surfaces. Notice that a direct solver to the proposed model is not available due to the non-convexity and combinatorial nature of <inline-formula> <tex-math notation="LaTeX">$L_{0}$ </tex-math></inline-formula>-norm minimization. Instead, we propose to solve it approximately based on an efficient half-quadratic splitting technique. We demonstrate its versatility and many benefits to a series of signal/image processing and computer vision applications.

[1]  Haihui Wang,et al.  Intrinsic Image Transfer for Illumination Manipulation , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Zheng Liu,et al.  Mesh Denoising via a Novel Mumford-Shah Framework , 2020, Comput. Aided Des..

[3]  Carola-Bibiane Schönlieb,et al.  Higher-Order Total Directional Variation: Imaging Applications , 2018, SIAM J. Imaging Sci..

[4]  Yukihiko Yamashita,et al.  Anisotropic Guided Filtering , 2020, IEEE Transactions on Image Processing.

[5]  Bernd Girod,et al.  Solving Vision Problems via Filtering , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[6]  Bailin Deng,et al.  Static/Dynamic Filtering for Mesh Geometry , 2017, IEEE Transactions on Visualization and Computer Graphics.

[7]  Zheng Liu,et al.  Triangulated Surface Denoising using High Order Regularization with Dynamic Weights , 2017, SIAM J. Sci. Comput..

[8]  Peyman Milanfar,et al.  NIMA: Neural Image Assessment , 2017, IEEE Transactions on Image Processing.

[9]  Kwanghoon Sohn,et al.  Fast Domain Decomposition for Global Image Smoothing , 2017, IEEE Transactions on Image Processing.

[10]  Shunsuke Ono,et al.  $L_{0}$ Gradient Projection , 2017, IEEE Transactions on Image Processing.

[11]  Lizhi Cheng,et al.  Convergence of iterative hard-thresholding algorithm with continuation , 2017, Optim. Lett..

[12]  Xin Tong,et al.  Mesh denoising via cascaded normal regression , 2016, ACM Trans. Graph..

[13]  Minh N. Do,et al.  Fast Guided Global Interpolation for Depth and Motion , 2016, ECCV.

[14]  Narendra Ahuja,et al.  Deep Joint Image Filtering , 2016, ECCV.

[15]  Jonathan T. Barron,et al.  The Fast Bilateral Solver , 2015, ECCV.

[16]  Zongben Xu,et al.  Sparse Regularization: Convergence Of Iterative Jumping Thresholding Algorithm , 2014, IEEE Transactions on Signal Processing.

[17]  Michael S. Brown,et al.  Fast and Effective L0 Gradient Minimization by Region Fusion , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Li Xu,et al.  Mutual-Structure for Joint Filtering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Bailin Deng,et al.  Guided Mesh Normal Filtering , 2015, Comput. Graph. Forum.

[20]  Zhengguo Li,et al.  Gradient Domain Guided Image Filtering , 2015, IEEE Transactions on Image Processing.

[21]  Petros Maragos,et al.  Structure Tensor Total Variation , 2015, SIAM J. Imaging Sci..

[22]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[23]  Dirk A. Lorenz,et al.  Minimization of Non-smooth, Non-convex Functionals by Iterative Thresholding , 2015, J. Optim. Theory Appl..

[24]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[25]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[26]  Ivo F. Sbalzarini,et al.  Image Enhancement by Gradient Distribution Specification , 2014, ACCV Workshops.

[27]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[28]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[29]  Qi Zhang,et al.  100+ Times Faster Weighted Median Filter (WMF) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  David Zhang,et al.  Gradient Histogram Estimation and Preservation for Texture Enhanced Image Denoising , 2014, IEEE Transactions on Image Processing.

[31]  Lei He,et al.  Mesh denoising via L0 minimization , 2013, ACM Trans. Graph..

[32]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Min Wu,et al.  Sparse Norm Filtering , 2013, ArXiv.

[34]  Peyman Milanfar,et al.  Symmetrizing Smoothing Filters , 2013, SIAM J. Imaging Sci..

[35]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[36]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[37]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[39]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[40]  Holger Winnemöller,et al.  XDoG: An eXtended difference-of-Gaussians compendium including advanced image stylization , 2012, Comput. Graph..

[41]  Cewu Lu,et al.  Combining sketch and tone for pencil drawing production , 2012, NPAR '12.

[42]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[43]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[44]  Youyi Zheng,et al.  IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 1 Bilateral Normal Filtering for Mesh Denoising , 2022 .

[45]  Jean-Michel Morel,et al.  Non-Local Means Denoising , 2011, Image Process. Line.

[46]  Jan Eric Kyprianidis,et al.  Image and video abstraction by multi-scale anisotropic Kuwahara filtering , 2011, NPAR '11.

[47]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, ACM Trans. Graph..

[48]  Manuel Menezes de Oliveira Neto,et al.  Domain transform for edge-aware image and video processing , 2011, ACM Trans. Graph..

[49]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[50]  Lionel Moisan,et al.  Total Variation as a Local Filter , 2011, SIAM J. Imaging Sci..

[51]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[52]  Pierre Alliez,et al.  Polygon Mesh Processing , 2010 .

[53]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[54]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[55]  M. Grasmair,et al.  Anisotropic Total Variation Filtering , 2010 .

[56]  Markus H. Gross,et al.  Feature Preserving Point Set Surfaces based on Non‐Linear Kernel Regression , 2009, Comput. Graph. Forum.

[57]  Seungyong Lee,et al.  Flow-Based Image Abstraction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[58]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[59]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[60]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[61]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[62]  E. Grinspun Discrete differential geometry : An applied introduction , 2008, SIGGRAPH 2008.

[63]  Ralph R. Martin,et al.  Fast and Effective Feature-Preserving Mesh Denoising , 2007, IEEE Transactions on Visualization and Computer Graphics.

[64]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[65]  Sylvain Paris,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, ACM Trans. Graph..

[66]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[67]  Ben Weiss,et al.  Fast median and bilateral filtering , 2006, ACM Trans. Graph..

[68]  David Tschumperlé,et al.  Fast Anisotropic Smoothing of Multi-Valued Images using Curvature-Preserving PDE's , 2006, International Journal of Computer Vision.

[69]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[70]  Yves Goussard,et al.  On global and local convergence of half-quadratic algorithms , 2006, IEEE Transactions on Image Processing.

[71]  Michael Elad,et al.  Retinex by Two Bilateral Filters , 2005, Scale-Space.

[72]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[73]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[74]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[75]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[76]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[78]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[79]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[80]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[81]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[82]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[83]  Ulrich Pinkall,et al.  Computing Discrete Minimal Surfaces and Their Conjugates , 1993, Exp. Math..

[84]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[85]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..