Motion-coherent stylization with screen-space image filters

One of the qualities sought in expressive rendering is the 2D impression of the resulting style, called flatness. In the context of 3D scenes, screen-space stylization techniques are good candidates for flatness as they operate in the 2D image plane, after the scene has been rendered into G-buffers. Various stylization filters can be applied in screen-space while making use of the geometrical information contained in G-buffers to ensure motion coherence. However, this means that filtering can only be done inside the rasterized surface of the object. This can be detrimental to some styles that require irregular silhouettes to be convincing. In this paper, we describe a post-processing pipeline that allows stylization filters to extend outside the rasterized footprint of the object by locally "inflating" the data contained in G-buffers. This pipeline is fully implemented on the GPU and can be evaluated at interactive rates. We show how common image filtering techniques, when integrated in our pipeline and in combination with G-buffer data, can be used to reproduce a wide range of "digitally-painted" appearances, such as directed brush strokes with irregular silhouettes, while keeping enough motion coherence.

[1]  Ares Lagae,et al.  A Survey of Procedural Noise Functions , 2010, Comput. Graph. Forum.

[2]  Nicolai Petkov,et al.  Continuous Glass Patterns for Painterly Rendering , 2009, IEEE Transactions on Image Processing.

[3]  Robert W. Sumner,et al.  OverCoat: an implicit canvas for 3D painting , 2011, ACM Trans. Graph..

[4]  Fabrice Neyret,et al.  Interactive Volumetric Textures , 1998, Rendering Techniques.

[5]  Jürgen Döllner,et al.  Sketchy drawings , 2004, AFRIGRAPH '04.

[6]  Adrien Bousseau,et al.  Interactive watercolor rendering with temporal coherence and abstraction , 2006, NPAR.

[7]  Joëlle Thollot,et al.  A Dynamic Noise Primitive for Coherent Stylization , 2010, Comput. Graph. Forum.

[8]  Adrien Bousseau,et al.  State‐of‐the‐Art Report on Temporal Coherence for Stylized Animations , 2011, Comput. Graph. Forum.

[9]  Takafumi Saito,et al.  Comprehensible rendering of 3-D shapes , 1990, SIGGRAPH.

[10]  David Salesin,et al.  Video watercolorization using bidirectional texture advection , 2007, SIGGRAPH 2007.

[11]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[12]  Pascal Barla,et al.  Dynamic Point Distribution for Stroke-based Rendering , 2007, Rendering Techniques.

[13]  Philippe Decaudin,et al.  Volumetric Billboards , 2009, Comput. Graph. Forum.

[14]  Pascal Barla,et al.  Implicit Brushes for Stylized Line‐based Rendering , 2011, Comput. Graph. Forum.

[15]  Philippe Decaudin,et al.  GPU-based lighting and shadowing of complex natural scenes , 2004, SIGGRAPH '04.

[16]  Adrien Bousseau,et al.  Dynamic solid textures for real-time coherent stylization , 2009, I3D '09.

[17]  Adam Finkelstein,et al.  Real-time fur over arbitrary surfaces , 2001, I3D '01.

[18]  John P. Lewis,et al.  Texture synthesis for digital painting , 1984, SIGGRAPH.

[19]  Steven Worley,et al.  A cellular texture basis function , 1996, SIGGRAPH.

[20]  Jürgen Döllner,et al.  Blueprints - Illustrating Architecture and Technical Parts using Hardware-Accelerated Non-Photorealistic Rendering , 2004, Graphics Interface.

[21]  Kenny Mitchell,et al.  Survey of texture mapping techniques for representing and rendering volumetric mesostructure , 2014 .

[22]  Adam Finkelstein,et al.  WYSIWYG NPR: drawing strokes directly on 3D models , 2002, SIGGRAPH.

[23]  Markus H. Gross,et al.  Fin textures for real-time painterly aesthetics , 2015, MIG.

[24]  James T. Kajiya,et al.  Rendering fur with three dimensional textures , 1989, SIGGRAPH.

[25]  Kwan-Liu Ma,et al.  Non-photorealistic rendering using watercolor inspired textures and illumination , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[26]  Christian Bauckhage,et al.  Lecture Notes on Data Science: Kernel k-Means Clustering (Part 1) , 2015 .

[27]  Lee Markosian,et al.  Art-based rendering of fur, grass, and trees , 1999, SIGGRAPH.

[28]  Barbara J. Meier.  Painterly rendering for animation , 1996, SIGGRAPH.

[29]  James R. Clifton,et al.  State-of-the-art report , 1995 .

[30]  Adam Finkelstein,et al.  Interactive painterly stylization of images, videos and 3D animations , 2010, I3D '10.

[31]  Isaac Botkin.  Painting with polygons: non-photorealistic rendering using existing tools , 2009, SIGGRAPH '09.

[32]  Pascal Barla,et al.  Designing Gratin, A GPU-Tailored Node-Based System , 2015 .