Multiscale texture synthesis

Example-based texture synthesis algorithms have gained widespread popularity for their ability to take a single input image and create a perceptually similar non-periodic texture. However, previous methods rely on single input exemplars that can capture only a limited band of spatial scales. For example, synthesizing a continent-like appearance at a variety of zoom levels would require an impractically high input resolution. In this paper, we develop a multiscale texture synthesis algorithm. We propose a novel example-based representation, which we call an exemplar graph, that simply requires a few low-resolution input exemplars at different scales. Moreover, by allowing loops in the graph, we can create infinite zooms and infinitely detailed textures that are impossible with current example-based methods. We also introduce a technique that ameliorates inconsistencies in the user's input, and show that the application of this method yields improved interscale coherence and higher visual quality. We demonstrate optimizations for both CPU and GPU implementations of our method, and use them to produce animations with zooming and panning at multiple scales, as well as static gigapixel-sized images with features spanning many spatial scales.

[1]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[2]  R. Ramamoorthi,et al.  Frequency domain normal map filtering , 2007, SIGGRAPH 2007.

[3]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[4]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[5]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[6]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[7]  Marcelo Walter,et al.  Towards local control for image-based texture synthesis , 2002, Proceedings. XV Brazilian Symposium on Computer Graphics and Image Processing.

[8]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[9]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[10]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Dani Lischinski,et al.  Solid texture synthesis from 2D exemplars , 2007, SIGGRAPH 2007.

[12]  Hugues Hoppe,et al.  Parallel controllable texture synthesis , 2005, SIGGRAPH 2005.

[13]  Luc Van Gool,et al.  Composite Texture Synthesis , 2005, International Journal of Computer Vision.

[14]  Kris Popat,et al.  Novel cluster-based probability model for texture synthesis, classification, and compression , 1993, Other Conferences.

[15]  Yizhou Yu,et al.  Feature matching and deformation for texture synthesis , 2004, SIGGRAPH 2004.

[16]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[17]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[18]  F. Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH 2005.

[19]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[20]  Hugues Hoppe,et al.  Appearance-space texture synthesis , 2006, SIGGRAPH 2006.

[21]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[22]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[23]  David S. Ebert,et al.  Texturing and Modeling , 1998 .

[24]  Michael Garland,et al.  Towards Real-Time Texture Synthesis with the Jump Map , 2002, Rendering Techniques.

[25]  M. Levoy,et al.  Texture synthesis by fixed neighborhood searching , 2001 .

[26]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[27]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[28]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.