Layered shape synthesis: automatic generation of control maps for non-stationary textures

Many inhomogeneous real-world textures are non-stationary and exhibit various large scale patterns that are easily perceived by a human observer. Such textures violate the assumptions underlying most state-of-the-art example-based synthesis methods. Consequently, they cannot be properly reproduced by these methods, unless a suitable control map is provided to guide the synthesis process. Such control maps are typically either user specified or generated by a simulation. In this paper, we present an alternative: a method for automatic example-based generation of control maps, geared at synthesis of natural, highly inhomogeneous textures, such as those resulting from natural aging or weathering processes. Our method is based on the observation that an appropriate control map for many of these textures may be modeled as a superposition of several layers, where the visible parts of each layer are occupied by a more homogeneous texture. Thus, given a decomposition of a texture exemplar into a small number of such layers, we employ a novel example-based shape synthesis algorithm to automatically generate a new set of layers. Our shape synthesis algorithm is designed to preserve both local and global characteristics of the exemplar's layer map. This process results in a new control map, which then may be used to guide the subsequent texture synthesis process.

[1]  Kun Zhou,et al.  Inverse texture synthesis , 2008, ACM Trans. Graph..

[2]  Alan Edelman,et al.  Modeling and rendering of weathered stone , 1999, SIGGRAPH.

[3]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[4]  Baining Guo,et al.  Context-aware textures , 2007, TOGS.

[5]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[6]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[7]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[8]  Julie Dorsey,et al.  Digital Modeling of Material Appearance , 2007 .

[9]  Andrew Zisserman,et al.  Texture classification: are filter banks necessary? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Nuria Oliver,et al.  Curve Analogies , 2002, Rendering Techniques.

[12]  Sylvain Lefebvre,et al.  Appearance-space texture synthesis , 2006, ACM Trans. Graph..

[13]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[14]  Carles Bosch,et al.  A Physically‐Based Model for Rendering Realistic Scratches , 2004, Comput. Graph. Forum.

[15]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[16]  Alexander Schrijver,et al.  Combinatorial optimization. Polyhedra and efficiency. , 2003 .

[17]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[18]  Greg Turk,et al.  Geometric texture synthesis by example , 2004, SGP '04.

[19]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[20]  Shree K. Nayar,et al.  Time-varying surface appearance , 2006, SIGGRAPH 2006.

[21]  Samir Akkouche,et al.  Simulating and modeling lichen growth , 2004, Comput. Graph. Forum.

[22]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[23]  Shree K. Nayar,et al.  Time-varying surface appearance: acquisition, modeling and rendering , 2006, ACM Trans. Graph..

[24]  Dani Lischinski,et al.  Layered shape synthesis: automatic generation of control maps for non-stationary textures , 2009, SIGGRAPH 2009.

[25]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  H. Shum,et al.  Appearance manifolds for modeling time-variant appearance of materials , 2006, SIGGRAPH 2006.

[27]  Jean-Michel Dischler,et al.  Corrosion: Simulating and Rendering , 2001, Graphics Interface.

[28]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[29]  Pat Hanrahan,et al.  Modeling and rendering of metallic patinas , 1996, SIGGRAPH.

[30]  Dani Lischinski,et al.  Solid texture synthesis from 2D exemplars , 2007, ACM Trans. Graph..

[31]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.