A Second Order Variation Based Bilateral Filter for Image Stylization and Texture Removal

Extracting meaningful structures and removing unimportant details or textures from a real world image is a classical problem in the domain of non-photorealistic rendering for images and benefits further computer vision related tasks as well. In this paper, we propose a structure sensitive bilateral filter by designing a novel weighting function which applies the second order variations of local color values. The proposed filter results in an image stylization effect where an image is represented by more flatten while distinguishable color regions. Furthermore, by combining the traditional bilateral filter as a post processing, textures embedded in mosaic art and embroidery art like images can be removed efficiently. Comparisons with the state-of-the-art methods are also provided to verify the validity and efficiency of the proposed filter.

[1]  S. Eiho,et al.  Processing of RI-Angiocardiographic Images , 1976 .

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[4]  Song-Chun Zhu,et al.  From image parsing to painterly rendering , 2009, TOGS.

[5]  Frédo Durand,et al.  Edge-preserving multiscale image decomposition based on local extrema , 2009, ACM Trans. Graph..

[6]  Jürgen Döllner,et al.  Image and Video Abstraction by Anisotropic Kuwahara Filtering , 2009, Comput. Graph. Forum.

[7]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[8]  Xiaogang Jin,et al.  Real-time saliency-aware video abstraction , 2009, The Visual Computer.

[9]  Henry Kang,et al.  Image and Video Abstraction by Coherence‐Enhancing Filtering , 2011, Comput. Graph. Forum.

[10]  Pascal Barla,et al.  Structure-preserving manipulation of photographs , 2007, NPAR '07.

[11]  Aykut Erdem,et al.  Structure-preserving image smoothing via region covariances , 2013, ACM Trans. Graph..

[12]  Vibhav Vineet,et al.  Efficient Salient Region Detection with Soft Image Abstraction , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Nicolai Petkov,et al.  Artistic Edge and Corner Enhancing Smoothing , 2007, IEEE Transactions on Image Processing.

[14]  Enhua Wu,et al.  Abstract line drawings from photographs using flow-based filters , 2012, Comput. Graph..

[15]  Seungyong Lee,et al.  Flow-Based Image Abstraction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[16]  R. Boomgaard,et al.  Decomposition of the Kuwahara-Nagao Operator in terms of Linear Smoothing and Morphological Sharpening , 2002 .

[17]  Michael F. Cohen,et al.  GradientShop: A gradient-domain optimization framework for image and video filtering , 2010, TOGS.

[18]  Jürgen Döllner,et al.  Image Abstraction by Structure Adaptive Filtering , 2008, TPCG.

[19]  Tobias Isenberg,et al.  State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video , 2013, IEEE Transactions on Visualization and Computer Graphics.

[20]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[21]  Xiaogang Jin,et al.  Real-time feature-aware video abstraction , 2008, The Visual Computer.

[22]  Aaron Hertzmann,et al.  AniPaint: Interactive Painterly Animation from Video , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[24]  Seungyong Lee,et al.  Bilateral texture filtering , 2014, ACM Trans. Graph..

[25]  A. M. Taratorin,et al.  Digital Processing of Biomedical Dynamical Images , 1988 .

[26]  Holger Winnemöller,et al.  XDoG: An eXtended difference-of-Gaussians compendium including advanced image stylization , 2012, Comput. Graph..

[27]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[28]  Ru Xue,et al.  An extended flow-based difference-of-Gaussians method of line drawing for polyhedral image , 2014 .

[29]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[30]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[31]  Philip J. Willis,et al.  Two-level joint local laplacian texture filtering , 2015, The Visual Computer.