Painting by feature

In this paper we propose a reinterpretation of the brush and the fill tools for digital image painting. The core idea is to provide an intuitive approach that allows users to paint in the visual style of arbitrary example images. Rather than a static library of colors, brushes, or fill patterns, we offer users entire images as their palette, from which they can select arbitrary contours or textures as their brush or fill tool in their own creations. Compared to previous example-based techniques related to the painting-by-numbers paradigm we propose a new strategy where users can generate salient texture boundaries by our randomized graph-traversal algorithm and apply a content-aware fill to transfer textures into the delimited regions. This workflow allows users of our system to intuitively create visually appealing images that better preserve the visual richness and fluidity of arbitrary example images. We demonstrate the potential of our approach in various applications including interactive image creation, editing and vector image stylization.

[1]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[2]  Song-Chun Zhu,et al.  Primal sketch: Integrating structure and texture , 2007, Comput. Vis. Image Underst..

[3]  Adam Finkelstein,et al.  Suggestive contours for conveying shape , 2003, ACM Trans. Graph..

[4]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[5]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[6]  Olga Sorkine-Hornung,et al.  Transfusive image manipulation , 2012, ACM Trans. Graph..

[7]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[8]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[9]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[10]  E. Grinspun,et al.  Synthesizing structured image hybrids , 2010, ACM Trans. Graph..

[11]  David Salesin,et al.  Painting with texture , 2006, EGSR '06.

[12]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[13]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[14]  Nancy S. Pollard,et al.  Real-time gradient-domain painting , 2008, SIGGRAPH 2008.

[15]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[16]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[17]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[18]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, SIGGRAPH 2008.

[19]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[20]  Stephen DiVerdi,et al.  Painting with Polygons: A Procedural Watercolor Engine , 2013, IEEE Transactions on Visualization and Computer Graphics.

[21]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[22]  John C. Hart,et al.  Detail preserving shape deformation in image editing , 2007, ACM Trans. Graph..

[23]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[24]  Narendra Ahuja,et al.  Texel-based texture segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[26]  Eli Shechtman,et al.  Regenerative morphing , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Daniel Cohen-Or,et al.  More of the same: Synthesizing a variety by structural layering , 2012, Comput. Graph..

[29]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[30]  Nancy S. Pollard,et al.  Real-time gradient-domain painting , 2008, ACM Trans. Graph..

[31]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..