Texture transfer using geometry correlation

Texture variation on real-world objects often correlates with underlying geometric characteristics and creates a visually rich appearance. We present a technique to transfer such geometry-dependent texture variation from an example textured model to new geometry in a visually consistent way. It captures the correlation between a set of geometric features, such as curvature, and the observed diffuse texture. We perform dimensionality reduction on the overcomplete feature set which yields a compact guidance field that is used to drive a spatially varying texture synthesis model. In addition, we introduce a method to enrich the guidance field when the target geometry strongly differs from the example. Our method transfers elaborate texture variation that follows geometric features, which gives 3D models a compelling photorealistic appearance.

[1]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[2]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[3]  Chen Xu,et al.  Synthesis of material drying history: phenomenon modeling, transferring and rendering , 2005, NPH.

[4]  Marie-Paule Cani,et al.  Hierarchical pattern mapping , 2002, ACM Trans. Graph..

[5]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[6]  D. Shepard A two-dimensional interpolation function for irregularly-spaced data , 1968, ACM National Conference.

[7]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[8]  Edward H. Adelson,et al.  IMAGE DATA COMPRESSION WITH THE LAPLACIAN PYRAMID , 1981 .

[9]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[10]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[11]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[12]  L. Gool,et al.  Composite Texture Synthesis , 2005, International Journal of Computer Vision.

[13]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[14]  H. Shum,et al.  TextureMontage: Seamless Texturing of Arbitrary Surfaces From Multiple Images , 2005, SIGGRAPH 2005.

[15]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[16]  Chen Xu,et al.  Observing and Transferring Material Histories , 2005 .

[17]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[18]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, SIGGRAPH 2004.

[19]  Greg Turk,et al.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991, SIGGRAPH.

[20]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[21]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[22]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[23]  M. L. Connolly Measurement of protein surface shape by solid angles , 1986 .

[24]  Tien-Tsin Wong,et al.  A Geometry Dependent Texture Generation Framework for Simulating Surface Imperfections , 1997, Rendering Techniques.

[25]  Gavin S. P. Miller,et al.  Efficient algorithms for local and global accessibility shading , 1994, SIGGRAPH.

[26]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[27]  M. Levoy,et al.  Texture synthesis by fixed neighborhood searching , 2001 .

[28]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[29]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[30]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[31]  Frédo Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH '05.

[32]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[33]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[34]  Hans Knutsson,et al.  Learning multidimensional signal processing , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[35]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[36]  Guillermo Sapiro,et al.  Texture Synthesis for 3D Shape Representation , 2003, IEEE Trans. Vis. Comput. Graph..

[37]  Henning Biermann,et al.  Texture and Shape Synthesis on Surfaces , 2001, Rendering Techniques.

[38]  T.,et al.  Shiftable Multi-scale TransformsEero , 1992 .

[39]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[40]  Sergey Zhukov,et al.  An Ambient Light Illumination Model , 1998, Rendering Techniques.

[41]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[42]  Hans-Peter Seidel,et al.  Automated texture registration and stitching for real world models , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[43]  Michael Garland,et al.  Similarity-based surface modelling using geodesic fans , 2004, SGP '04.

[44]  Alan Edelman,et al.  Modeling and rendering of weathered stone , 1999, SIGGRAPH.

[45]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[46]  Michael Garland,et al.  Curvature maps for local shape comparison , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[47]  Klaus Mueller,et al.  Uniform texture synthesis and texture mapping using global parameterization , 2005, The Visual Computer.

[48]  Pat Hanrahan,et al.  Modeling and rendering of metallic patinas , 1996, SIGGRAPH.

[49]  Hujun Bao,et al.  Visual simulation of weathering by γ-ton tracing , 2005, SIGGRAPH 2005.

[50]  Hujun Bao,et al.  Visual simulation of weathering by γ-ton tracing , 2005, ACM Trans. Graph..