Image and video abstraction using cumulative range geodesic filtering

Image abstraction traditionally eliminates texture, flattening gradients and removing small-scale details. However, abstracting while preserving irregular silhouettes and medium-scale details can produce a richer abstracted image. We propose a variant of geodesic image filtering which preserves the locally strongest edges, leading to preservation of both strong edges and weak edges depending on the surrounding context.Our contribution is to introduce cumulative range geodesic filtering, where the distance in the image plane is lengthened proportional to the color distance from the starting point. We apply the new filtering scheme to abstraction applications in images and video, and demonstrate that it has powerful structure-preserving capabilities, especially regarding preservation and indication of irregular details. The basic technique, where every pixel is equally abstracted, is further extended with explorations of variable mask size based on spatial location, salience, intensity, and location combined with intensity. Graphical abstractDisplay Omitted HighlightsA novel abstraction algorithm for images and video.Textures and small details are preserved somewhat; strong edges are preserved precisely.Various augmentations to the main algorithm are considered, including user-defined masks and automatic abstraction variation.

[1]  S. T. Dana FORESTS AND PEOPLE , 1947 .

[2]  Nicolai Petkov,et al.  Artistic Edge and Corner Enhancing Smoothing , 2007, IEEE Transactions on Image Processing.

[3]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Seungyong Lee,et al.  Flow-Based Image Abstraction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[5]  M. Kass,et al.  Smoothed local histogram filters , 2010, SIGGRAPH 2010.

[6]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[7]  Michael F. Cohen,et al.  GradientShop: A gradient-domain optimization framework for image and video filtering , 2010, TOGS.

[8]  Pascal Barla,et al.  Structure-preserving manipulation of photographs , 2007, NPAR '07.

[9]  Patrick Pérez,et al.  Geodesic image and video editing , 2010, TOGS.

[10]  Bruce Gooch,et al.  Image simplification and vectorization , 2011, NPAR '11.

[11]  David Salesin,et al.  Video watercolorization using bidirectional texture advection , 2007, SIGGRAPH 2007.

[12]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[13]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[14]  Jan Eric Kyprianidis,et al.  Image and video abstraction by multi-scale anisotropic Kuwahara filtering , 2011, NPAR '11.

[15]  Adrien Bousseau,et al.  Interactive watercolor rendering with temporal coherence and abstraction , 2006, NPAR.

[16]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  David Mould Texture-preserving abstraction , 2012, NPAR '12.

[18]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[19]  Jürgen Döllner,et al.  Image and Video Abstraction by Anisotropic Kuwahara Filtering , 2009, Comput. Graph. Forum.

[20]  Henry Kang,et al.  Image and Video Abstraction by Coherence‐Enhancing Filtering , 2011, Comput. Graph. Forum.

[21]  Song-Chun Zhu,et al.  Sisley the abstract painter , 2010, NPAR.