Parallel controllable texture synthesis

We present a texture synthesis scheme based on neighborhood matching, with contributions in two areas: parallelism and control. Our scheme defines an infinite, deterministic, aperiodic texture, from which windows can be computed in real-time on a GPU. We attain high-quality synthesis using a new analysis structure called the Gaussian stack, together with a coordinate upsampling step and a subpass correction approach. Texture variation is achieved by multiresolution jittering of exemplar coordinates. Combined with the local support of parallel synthesis, the jitter enables intuitive user controls including multiscale randomness, spatial modulation over both exemplar and output, feature drag-and-drop, and periodicity constraints. We also introduce synthesis magnification, a fast method for amplifying coarse synthesis results to higher resolution.

[1]  Sylvain Lefebvre,et al.  Pattern based procedural textures , 2003, I3D '03.

[2]  David Donovan Garber,et al.  Computational models for texture analysis and texture synthesis , 1981 .

[3]  Kei Yuasa,et al.  Texture tile visibility determination for dynamic texture loading , 1998, Workshop on Graphics Hardware.

[4]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[5]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[6]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[7]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[8]  Martin Kraus,et al.  Adaptive texture maps , 2002, HWWS '02.

[9]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[12]  Luc Van Gool,et al.  Composite Texture Synthesis , 2005, International Journal of Computer Vision.

[13]  Li-Yi Wei,et al.  Tile-based texture mapping on graphics hardware , 2004, SIGGRAPH '04.

[14]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[15]  Frank Losasso,et al.  Geometry clipmaps: terrain rendering using nested regular grids , 2004, SIGGRAPH 2004.

[16]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, SIGGRAPH 2004.

[17]  Michael Garland,et al.  Towards Real-Time Texture Synthesis with the Jump Map , 2002, Rendering Techniques.

[18]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[19]  Kris Popat,et al.  Novel cluster-based probability model for texture synthesis, classification, and compression , 1993, Other Conferences.

[20]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[21]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[22]  Ken Perlin,et al.  Improving noise , 2002, SIGGRAPH.

[23]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[24]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[25]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[26]  Luc Van Gool,et al.  A Compact Model for Viewpoint Dependent Texture Synthesis , 2000, SMILE.

[27]  Christopher J. Migdal,et al.  The clipmap: a virtual mipmap , 1998, SIGGRAPH.

[28]  Oliver Deussen,et al.  Wang Tiles for image and texture generation , 2003, ACM Trans. Graph..