Stylized Rendering Using Samples of a Painted Image

We introduce a novel technique to generate painterly art maps (PAMs) for 3D nonphotorealistic rendering. Our technique can automatically transfer brushstroke textures and color changes to 3D models from samples of a painted image. Therefore, the generation of stylized images or animation in the style of a given artwork can be achieved. This new approach works particularly well for a rich variety of brushstrokes ranging from simple 1D and 2D line-art strokes to very complicated ones with significant variations in stroke characteristics. During the rendering or animation process, the coherence of brushstroke textures and color changes over 3D surfaces can be well maintained. With PAM, we can also easily generate the illusion of flow animation over a 3D surface to convey the shape of a model.

[1]  Chung-Ren Yan,et al.  Feature-Based Texture Synthesis , 2005, ICCSA.

[2]  B. S. Manjunath,et al.  Color image segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[3]  Barbara J. Meier.  Painterly rendering for animation , 1996, SIGGRAPH.

[4]  David P. Luebke,et al.  View-Dependent Particles for Interactive Non-Photorealistic Rendering , 2001, Graphics Interface.

[5]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[6]  Aaron Hertzmann,et al.  A survey of stroke-based rendering , 2003, IEEE Computer Graphics and Applications.

[7]  Adam Finkelstein,et al.  Fine tone control in hardware hatching , 2002, NPAR '02.

[8]  Adam Finkelstein,et al.  WYSIWYG NPR: drawing strokes directly on 3D models , 2002, SIGGRAPH.

[9]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[10]  Aaron Hertzmann,et al.  Illustrating smooth surfaces , 2000, SIGGRAPH.

[11]  Yizhou Yu,et al.  Feature matching and deformation for texture synthesis , 2004, ACM Trans. Graph..

[12]  Adam Finkelstein,et al.  Real-time hatching , 2001, SIGGRAPH.

[13]  Oliver Deussen,et al.  Computer-generated pen-and-ink illustration of trees , 2000, SIGGRAPH.

[14]  Kwan-Liu Ma,et al.  Using Motion to Illustrate Static 3D Shape--Kinetic Visualization , 2003, IEEE Trans. Vis. Comput. Graph..

[15]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[16]  Hui Xu,et al.  PointWorks: Abstraction and Rendering of Sparsely Scanned Outdoor Environments , 2004, Rendering Techniques.

[17]  Michael Garland,et al.  Interactive Texture Synthesis on Surfaces using Jump Maps , 2003, Rendering Techniques.

[18]  Lee Markosian,et al.  Artistic silhouettes: a hybrid approach , 2000, NPAR '00.

[19]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[20]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[21]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[22]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[23]  Peter-Pike J. Sloan,et al.  The Lit Sphere: A Model for Capturing NPR Shading from Art , 2001, Graphics Interface.

[24]  Anton Alstes.  Wang Tiles for Image and Texture Generation , 2004 .

[25]  Christopher D. Kulla,et al.  Using texture synthesis for non-photorealistic shading from paint samples , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[26]  Chung-Ren Yan,et al.  Stylized Rendering for Anatomic Visualization , 2007, Computing in Science & Engineering.

[27]  Stefan Bruckner,et al.  Style Transfer Functions for Illustrative Volume Rendering , 2007, Comput. Graph. Forum.

[28]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[29]  Tong-Yee Lee,et al.  Camera-sampling field and its applications , 2004, IEEE Transactions on Visualization and Computer Graphics.

[30]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[31]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[32]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[33]  Tong-Yee Lee,et al.  Stylized and abstract painterly rendering system using a multiscale segmented sphere hierarchy , 2006, IEEE Transactions on Visualization and Computer Graphics.

[34]  Frédo Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH '05.