Edge- and substrate-based effects for watercolor stylization

We investigate characteristic edge- and substrate-based effects for watercolor stylization. These two fundamental elements of painted art play a significant role in traditional watercolors and highly influence the pigment's behavior and application. Yet a detailed consideration of these specific elements for the stylization of 3D scenes has not been attempted before. Through this investigation, we contribute to the field by presenting ways to emulate two novel effects: dry-brush and gaps & overlaps. By doing so, we also found ways to improve upon well-studied watercolor effects such as edge-darkening and substrate granulation. Finally, we integrated controllable external lighting influences over the watercolorized result, together with other previously researched watercolor effects. These effects are combined through a direct stylization pipeline to produce sophisticated watercolor imagery, which retains spatial coherence in object-space and is locally controllable in real-time.

[1]  Jun-Hai Yong,et al.  Towards Photo Watercolorization with Artistic Verisimilitude , 2014, IEEE Transactions on Visualization and Computer Graphics.

[2]  Matthias Trapp,et al.  Interactive image filtering with multiple levels-of-control on mobile devices , 2016, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[3]  Oliver Deussen,et al.  Real-time watercolor illustrations of plants using a blurred depth test , 2006, NPAR.

[4]  Jürgen Döllner,et al.  Interactive image filtering for level-of-abstraction texturing of virtual 3D scenes , 2015, Comput. Graph..

[5]  Stephen DiVerdi,et al.  RealBrush: painting with examples of physical media , 2013, ACM Trans. Graph..

[6]  Kwan-Liu Ma,et al.  Non-photorealistic rendering using watercolor inspired textures and illumination , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[7]  Stephen DiVerdi,et al.  Painting with Polygons: A Procedural Watercolor Engine , 2013, IEEE Transactions on Visualization and Computer Graphics.

[8]  David Salesin,et al.  Video watercolorization using bidirectional texture advection , 2007, SIGGRAPH 2007.

[9]  DöllnerJürgen,et al.  Interactive image filtering for level-of-abstraction texturing of virtual 3D scenes , 2015 .

[10]  Xiaolong Chen,et al.  Image watercolorization based on visual weight-map , 2014, 2014 7th International Congress on Image and Signal Processing.

[11]  Linda Doyle,et al.  Painting style transfer for head portraits using convolutional neural networks , 2016, ACM Trans. Graph..

[12]  Chun-Fa Chang,et al.  Real-Time Rendering of Watercolor Effects for Virtual Environments , 2004, PCM.

[13]  S. Todorovic,et al.  Video Painting with Space-Time-Varying Style Parameters , 2011, IEEE Transactions on Visualization and Computer Graphics.

[14]  Takafumi Saito,et al.  Comprehensible rendering of 3-D shapes , 1990, SIGGRAPH.

[15]  Oliver Deussen,et al.  Watercolor Illustrations of CAD Data , 2008, CAe.

[16]  Nenghai Yu,et al.  Coherent Online Video Style Transfer , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[18]  Nicolai Petkov,et al.  Edge and line oriented contour detection: State of the art , 2011, Image Vis. Comput..

[19]  Aaron Hertzmann,et al.  Fast paint texture , 2002, NPAR '02.

[20]  David H. Small,et al.  Simulating watercolor by modeling diffusion, pigment, and paper fibers , 1991, Electronic Imaging.

[21]  Adrien Bousseau,et al.  Interactive watercolor rendering with temporal coherence and abstraction , 2006, NPAR.

[22]  Hans-Martin Rall,et al.  Art-directed watercolor rendered animation , 2016 .

[23]  Jun-yong Noh,et al.  Realistic paint simulation based on fluidity, diffusion, and absorption , 2013, Comput. Animat. Virtual Worlds.

[24]  Adrien Bousseau,et al.  Dynamic solid textures for real-time coherent stylization , 2009, I3D '09.

[25]  Matt Pharr,et al.  Gpu gems 2: programming techniques for high-performance graphics and general-purpose computation , 2005 .

[26]  Elaine Cohen,et al.  A Generative Model For Dynamic Canvas Motion , 2005, CAe.

[27]  Seah Hock Soon,et al.  Art-directed watercolor stylization of 3D animations in real-time , 2017, Comput. Graph..

[28]  Joëlle Thollot,et al.  Dynamic Canvas for Immersive Non-Photorealistic Walkthroughs , 2003 .

[29]  Pierre Bénard,et al.  Stylizing animation by example , 2013, ACM Trans. Graph..

[30]  Geoff Wyvill,et al.  A system for real-time watercolour rendering , 2005, International 2005 Computer Graphics.

[31]  Angelos Barmpoutis,et al.  A novel framework for 3D reconstruction and analysis of ancient inscriptions , 2009, Machine Vision and Applications.

[32]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[33]  Frank Van Reeth,et al.  Real-time simulation of watery paint , 2005, Comput. Animat. Virtual Worlds.

[34]  Huamin Wang,et al.  Wetbrush: GPU-based 3D painting simulation at the bristle level , 2015, ACM Trans. Graph..

[35]  Tomoyuki Nishita,et al.  Creating Watercolor Style Images Taking Into Account Painting Techniques , 2004 .

[36]  Baoquan Chen,et al.  Paint Inspired Color Mixing and Compositing for Visualization , 2004 .

[37]  Eli Shechtman,et al.  StyLit , 2016, ACM Trans. Graph..

[38]  Oliver Deussen,et al.  Real-Time Watercolor for Animation , 2006, Journal of Computer Science and Technology.

[39]  John P. Collomosse,et al.  Stroke surfaces: temporally coherent artistic animations from video , 2005, IEEE Transactions on Visualization and Computer Graphics.

[40]  Chiew-Lan Tai,et al.  MoXi: real-time ink dispersion in absorbent paper , 2005, SIGGRAPH '05.

[41]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.