Flow-Based Image Abstraction

We present a non-photorealistic rendering technique that automatically delivers a stylized abstraction of a photograph. Our approach is based on shape/color filtering guided by a vector field that describes the flow of salient features in the image. This flow-based filtering significantly improves the abstraction performance in terms of feature enhancement and stylization. Our method is simple, fast, and easy to implement. Experimental results demonstrate the effectiveness of our method in producing stylistic and feature-enhancing illustrations from photographs.

[1]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[2]  Peter Shirley,et al.  Artistic Vision: painterly rendering using computer vision techniques , 2002, NPAR '02.

[3]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, ACM Trans. Graph..

[4]  Tobias Isenberg,et al.  A Developer's Guide to Silhouette Algorithms for Polygonal Models , 2003, IEEE Computer Graphics and Applications.

[5]  Victor Ostromoukhov.  Digital facial engraving , 1999, SIGGRAPH '99.

[6]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[7]  Dirk Bartz,et al.  Stylized augmented reality for improved immersion , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[8]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[9]  Adam Finkelstein,et al.  Stylized video cubes , 2002, SCA '02.

[10]  Ben Weiss.  Fast median and bilateral filtering , 2006, SIGGRAPH 2006.

[11]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[13]  Tuan Q. Pham.  Spatiotonal adaptivity in super-resolution of under-sampled image sequences , 2006 .

[14]  ReinhardErik,et al.  Human facial illustrations , 2004 .

[15]  Sylvain Paris,et al.  Capture of hair geometry from multiple images , 2004, ACM Trans. Graph..

[16]  Adrian Secord,et al.  Weighted Voronoi stippling , 2002, NPAR '02.

[17]  Irfan A. Essa,et al.  Image and video based painterly animation , 2004, NPAR '04.

[18]  David Tschumperlé,et al.  Curvature-Preserving regularization of multi-valued images using PDE's , 2006, eccv 2006.

[19]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[20]  Frédo Durand,et al.  Decoupling Strokes and High-Level Attributes for Interactive Traditional Drawing , 2001, Rendering Techniques.

[21]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, ACM Trans. Graph..

[22]  Harry Shum,et al.  Color sketch generation , 2006, NPAR.

[23]  Hyung W. Kang,et al.  A unified scheme for adaptive stroke-based rendering , 2006, The Visual Computer.

[24]  Pascal Barla,et al.  X-toon: an extended toon shader , 2006, NPAR.

[25]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[26]  Przemyslaw Prusinkiewicz,et al.  A Few Good Lines: Suggestive Drawing of 3D Models , 2003, Comput. Graph. Forum.

[27]  Lucas J. van Vliet,et al.  Separable bilateral filtering for fast video preprocessing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[28]  Alejo Hausner,et al.  Simulating decorative mosaics , 2001, SIGGRAPH.

[29]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[30]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[31]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[32]  David Salesin,et al.  Orientable textures for image-based pen-and-ink illustration , 1997, SIGGRAPH.

[33]  Oliver Deussen,et al.  Floating Points: A Method for Computing Stipple Drawings , 2000, Comput. Graph. Forum.

[34]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[35]  David Salesin,et al.  Interactive pen-and-ink illustration , 1994, SIGGRAPH.

[36]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[37]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[38]  Pietro Perona.  Orientation diffusions , 1998, IEEE Trans. Image Process..

[39]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[40]  Pascal Barla,et al.  Structure-preserving manipulation of photographs , 2007, NPAR '07.

[41]  Rachid Deriche,et al.  Orthonormal Vector Sets Regularization with PDE's and Applications , 2002, International Journal of Computer Vision.

[42]  Mario Costa Sousa,et al.  Observational Models of Graphite Pencil Materials , 2000, Comput. Graph. Forum.

[43]  Adam Finkelstein,et al.  Coherent stylized silhouettes , 2003, ACM Trans. Graph..

[44]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[45]  Frédo Durand,et al.  Apparent ridges for line drawing , 2007, ACM Trans. Graph..

[46]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[47]  Yunjin Lee,et al.  Line drawings via abstracted shading , 2007, ACM Trans. Graph..

[48]  Hugues Hoppe,et al.  Design of tangent vector fields , 2007, SIGGRAPH 2007.

[49]  Harry Shum,et al.  Video tooning , 2004, ACM Trans. Graph..

[50]  Adam Finkelstein,et al.  Suggestive contours for conveying shape , 2003, ACM Trans. Graph..

[51]  Szymon Rusinkiewicz,et al.  Highlight lines for conveying shape , 2007, NPAR '07.

[52]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[53]  Mark J. Harris,et al.  Stylized rendering techniques for scalable real-time 3D animation , 2000, NPAR '00.

[54]  John P. Collomosse,et al.  Stroke surfaces: temporally coherent artistic animations from video , 2005, IEEE Transactions on Visualization and Computer Graphics.

[55]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[56]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  John P. Collomosse,et al.  Cubist Style Rendering from Photographs , 2003, IEEE Trans. Vis. Comput. Graph..

[58]  Ken-ichi Anjyo,et al.  Stylized Highlights for Cartoon Rendering and Animation , 2003, IEEE Computer Graphics and Applications.

[59]  Aaron Hertzmann,et al.  Isophote distance: a shading approach to artistic stroke thickness , 2007, NPAR '07.