Synthesis and rendering of bidirectional texture functions on arbitrary surfaces

The bidirectional texture function (BTF) is a 6D function that describes the appearance of a real-world surface as a function of lighting and viewing directions. The BTF can model the fine-scale shadows, occlusions, and specularities caused by surface mesostructures. We present algorithms for efficient synthesis of BTFs on arbitrary surfaces and for hardware-accelerated rendering. For both synthesis and rendering, a main challenge is handling the large amount of data in a BTF sample. To addresses this challenge, we approximate the BTF sample by a small number of 4D point appearance functions (PAFs) multiplied by 2D geometry maps. The geometry maps and PAFs lead to efficient synthesis and fast rendering of BTFs on arbitrary surfaces. For synthesis, a surface BTF can be generated by applying a texton-based synthesis algorithm to a small set of 2D geometry maps while leaving the companion 4D PAFs untouched. As for rendering, a surface BTF synthesized using geometry maps is well-suited for leveraging the programmable vertex and pixel shaders on the graphics hardware. We present a real-time BTF rendering algorithm that runs at the speed of about 30 frames/second on a mid-level PC with an ATI Radeon 8500 graphics card. We demonstrate the effectiveness of our synthesis and rendering algorithms using both real and synthetic BTF samples.

[1]  Matthias Zwicker,et al.  Surface splatting , 2001, SIGGRAPH.

[2]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.

[3]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[4]  Greg Turk,et al.  Re-tiling polygonal surfaces , 1992, SIGGRAPH.

[5]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[6]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[7]  Mark Meyer,et al.  Interactive geometry remeshing , 2002, SIGGRAPH.

[8]  Shree K. Nayar,et al.  Reflectance and Texture of Real-World Surfaces Authors , 1997, CVPR 1997.

[9]  Michael D. McCool,et al.  Homomorphic factorization of BRDFs for high-performance rendering , 2001, SIGGRAPH.

[10]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[11]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[12]  Jean-Michel Dischler,et al.  Efficiently Rendering Macro Geometric Surface Structures with Bi-Directional Texture Functions , 1998, Rendering Techniques.

[13]  Hans-Peter Seidel,et al.  Efficient Cloth Modeling and Rendering , 2001, Rendering Techniques.

[14]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[15]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[16]  Pedro V. Sander,et al.  Texture mapping progressive meshes , 2001, SIGGRAPH.

[17]  Shree K. Nayar,et al.  Histogram model for 3D textures , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  Baining Guo,et al.  Texture mapping with a Jacobian-based spatially-variant filter , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[19]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[20]  Harry Shum,et al.  Synthesizing bidirectional texture functions for real-world surfaces , 2001, SIGGRAPH.

[21]  Peter Shirley,et al.  A Low Distortion Map Between Disk and Square , 1997, J. Graphics, GPU, & Game Tools.

[22]  Andrea J. van Doorn,et al.  Illuminance texture due to surface mesostructure , 1996 .

[23]  Jan Kautz,et al.  Interactive rendering with arbitrary BRDFs using separable approximations , 1999, SIGGRAPH '99.

[24]  Katsushi Ikeuchi,et al.  Eigen-texture method: Appearance compression based on 3D model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[25]  G. Sapiro,et al.  Growing Fitted Textures , 2001 .

[26]  Hans-Peter Seidel,et al.  Realistic, hardware-accelerated shading and lighting , 1999, SIGGRAPH.

[27]  Henning Biermann,et al.  Texture and Shape Synthesis on Surfaces , 2001, Rendering Techniques.

[28]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[29]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[30]  Greg Turk,et al.  Robust Creation of Implicit Surfaces from Polygonal Meshes , 2002, IEEE Trans. Vis. Comput. Graph..

[31]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[32]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[33]  Anne Verroust-Blondet,et al.  Interactive texture mapping , 1993, SIGGRAPH.