High-Performance By-Example Noise using a Histogram-Preserving Blending Operator

We propose a new by-example noise algorithm that takes as input a small example of a stochastic texture and synthesizes an infinite output with the same appearance. It works on any kind of random-phase inputs as well as on many non-random-phase inputs that are stochastic and non-periodic, typically natural textures such as moss, granite, sand, bark, etc. Our algorithm achieves high-quality results comparable to state-of-the-art procedural-noise techniques but is more than 20 times faster. Our approach is conceptually simple: we partition the output texture space on a triangle grid and associate each vertex with a random patch from the input such that the evaluation inside a triangle is done by blending 3 patches. The key to this approach is the blending operation that usually produces visual artifacts such as ghosting, softened discontinuities and reduced contrast, or introduces new colors not present in the input. We analyze these problems by showing how linear blending impacts the histogram and show that a blending operator that preserves the histogram prevents these problems. The main requirement for a rendering application is to implement such an operator in a fragment shader without further post-processing, i.e. we need a histogram-preserving blending operator that operates only at the pixel level. Our insight for the design of this operator is that, with Gaussian inputs, histogram-preserving blending boils down to mean and variance preservation, which is simple to obtain analytically. We extend this idea to non-Gaussian inputs by "Gaussianizing" them with a histogram transformation and "de-Gaussianizing" them with the inverse transformation after the blending operation. We show how to precompute and store these histogram transformations such that our algorithm can be implemented in a fragment shader.

[1]  Ján Morovic,et al.  Accurate 3D image colour histogram transformation , 2003, Pattern Recognit. Lett..

[2]  Oliver Deussen,et al.  Wang Tiles for image and texture generation , 2003, ACM Trans. Graph..

[3]  Bruno Galerne,et al.  Texton Noise , 2017, Comput. Graph. Forum.

[4]  John P. Lewis,et al.  Texture synthesis for digital painting , 1984, SIGGRAPH.

[5]  Marie-Paule Cani,et al.  Pattern-based texturing revisited , 1999, SIGGRAPH.

[6]  Ares Lagae,et al.  State of the Art in Procedural Noise Functions , 2010, Eurographics.

[7]  Jean-Michel Dischler,et al.  On-the-fly multi-scale infinite texturing from example , 2013, ACM Trans. Graph..

[8]  Ken Perlin,et al.  Improving noise , 2002, SIGGRAPH.

[9]  Fabrice Neyret,et al.  Lagrangian Texture Advection: Preserving both Spectrum and Velocity Field , 2011, IEEE Transactions on Visualization and Computer Graphics.

[10]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[11]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[12]  Bruno Galerne,et al.  Gabor noise by example , 2012, ACM Trans. Graph..

[13]  Luc Devroye,et al.  Non-Uniform Random Variate Generation , 1986 .

[14]  Wolfgang Heidrich,et al.  Displacement interpolation using Lagrangian mass transport , 2011, ACM Trans. Graph..

[15]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[16]  Lance Williams,et al.  Pyramidal parametrics , 1983, SIGGRAPH.

[17]  Ares Lagae,et al.  A Survey of Procedural Noise Functions , 2010, Comput. Graph. Forum.

[18]  Ares Lagae,et al.  An alternative for Wang tiles: colored edges versus colored corners , 2006, TOGS.

[19]  Ares Lagae,et al.  Procedural noise using sparse Gabor convolution , 2009, SIGGRAPH 2009.

[20]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[21]  Jean-Michel Dischler,et al.  Local random-phase noise for procedural texturing , 2014, ACM Trans. Graph..

[22]  Steven Worley,et al.  A cellular texture basis function , 1996, SIGGRAPH.

[23]  J. van Wijk,et al.  Spot noise texture synthesis for data visualization , 1991, SIGGRAPH.

[24]  Bruno Galerne,et al.  Semi-discrete Optimal Transport in Patch Space for Enriching Gaussian Textures , 2017, GSI.

[25]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[26]  Jean-Michel Dischler,et al.  Multiple kernels noise for improved procedural texturing , 2012, The Visual Computer.