Analysis and Controlled Synthesis of Inhomogeneous Textures

Many interesting real‐world textures are inhomogeneous and/or anisotropic. An inhomogeneous texture is one where various visual properties exhibit significant changes across the texture's spatial domain. Examples include perceptible changes in surface color, lighting, local texture pattern and/or its apparent scale, and weathering effects, which may vary abruptly, or in a continuous fashion. An anisotropic texture is one where the local patterns exhibit a preferred orientation, which also may vary across the spatial domain. While many example‐based texture synthesis methods can be highly effective when synthesizing uniform (stationary) isotropic textures, synthesizing highly non‐uniform textures, or ones with spatially varying orientation, is a considerably more challenging task, which so far has remained underexplored. In this paper, we propose a new method for automatic analysis and controlled synthesis of such textures. Given an input texture exemplar, our method generates a source guidance map comprising: (i) a scalar progression channel that attempts to capture the low frequency spatial changes in color, lighting, and local pattern combined, and (ii) a direction field that captures the local dominant orientation of the texture. Having augmented the texture exemplar with this guidance map, users can exercise better control over the synthesized result by providing easily specified target guidance maps, which are used to constrain the synthesis process.

[1]  Kun Zhou,et al.  Fast example-based surface texture synthesis via discrete optimization , 2006, The Visual Computer.

[2]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[3]  H. Shum,et al.  Appearance manifolds for modeling time-variant appearance of materials , 2006, SIGGRAPH 2006.

[4]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[5]  Jean-Michel Dischler,et al.  Multi-scale label-map extraction for texture synthesis , 2016, ACM Trans. Graph..

[6]  Jean-Michel Dischler,et al.  Corrosion: Simulating and Rendering , 2001, Graphics Interface.

[7]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[8]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[9]  Julie Dorsey,et al.  Digital Modeling of Material Appearance , 2007 .

[10]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[11]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[13]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[14]  Baining Guo,et al.  Image‐based Material Weathering , 2008, Comput. Graph. Forum.

[15]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Dani Lischinski,et al.  Self Tuning Texture Optimization , 2015, Comput. Graph. Forum.

[18]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[19]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Sylvain Lefebvre,et al.  Parallel patch-based texture synthesis , 2012, EGGH-HPG'12.

[21]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[22]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[23]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[24]  Daniel Cohen-Or,et al.  Feature-aligned shape texturing , 2009, ACM Trans. Graph..

[25]  Baining Guo,et al.  Context-aware textures , 2007, TOGS.

[26]  Kun Zhou,et al.  Inverse texture synthesis , 2008, ACM Trans. Graph..

[27]  P. Milanfar,et al.  Multiscale principal components analysis for image local orientation estimation , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[28]  Dani Lischinski,et al.  Layered shape synthesis: automatic generation of control maps for non-stationary textures , 2009, SIGGRAPH 2009.

[29]  Daniel Cohen-Or,et al.  Time-varying weathering in texture space , 2016, ACM Trans. Graph..

[30]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[31]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[32]  Shree K. Nayar,et al.  Time-varying surface appearance , 2006, SIGGRAPH 2006.

[33]  Jitendra Malik,et al.  Textons, contours and regions: cue integration in image segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[34]  Sylvain Lefebvre,et al.  Appearance-space texture synthesis , 2006, ACM Trans. Graph..

[35]  Adam Finkelstein,et al.  The Generalized PatchMatch Correspondence Algorithm , 2010, ECCV.

[36]  Yoshihiro Kanamori,et al.  Single Image Weathering via Exemplar Propagation , 2016, Comput. Graph. Forum.

[37]  Samir Akkouche,et al.  Simulating and modeling lichen growth , 2004, Comput. Graph. Forum.

[38]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[39]  Eli Shechtman,et al.  Brushables: Example‐based Edge‐aware Directional Texture Painting , 2015, Comput. Graph. Forum.

[40]  Kun Zhou,et al.  Online Submission ID: papers 0027 Inverse Texture Synthesis , 2022 .

[41]  Dani Lischinski,et al.  Layered shape synthesis: automatic generation of control maps for non-stationary textures , 2009, ACM Trans. Graph..

[42]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[43]  Jiawen Chen,et al.  Texture transfer using geometry correlation , 2006, EGSR '06.

[44]  Pat Hanrahan,et al.  Modeling and rendering of metallic patinas , 1996, SIGGRAPH.

[45]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[46]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[48]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[49]  Carles Bosch,et al.  A Physically‐Based Model for Rendering Realistic Scratches , 2004, Comput. Graph. Forum.

[50]  Holly E. Rushmeier,et al.  Dominant Texture and Diffusion Distance Manifolds , 2009, Comput. Graph. Forum.

[51]  Yizhou Yu,et al.  Optimized Synthesis of Art Patterns and Layered Textures , 2014, IEEE Transactions on Visualization and Computer Graphics.

[52]  Daniel Cohen-Or,et al.  Consistent mesh partitioning and skeletonisation using the shape diameter function , 2008, The Visual Computer.