Reconstruction of volumetric surface textures for real-time rendering

Volumetric texturing is a popular technique for rendering rich 3-D detail when a polygonal surface representation would be ineffective. Although efficient algorithms for rendering volumetric textures have been known for years, capturing the richness of a real-life volumetric materials remains a challenging problem. In this paper we propose a technique for generating a volumetric representation of a complex 3-D texture with unknown reflectance and structure. From acquired reflectance data in the form of a 6-D Bidirectional Texture Function (BTF), the proposed algorithm creates an efficient volumetric representation in the form of a stack of semi-transparent layers each representing a slice through the texture's volume. In addition to negligible storage requirements, this representation is ideally suited for hardware-accelerated real-time rendering.

[1]  Kristin J. Dana,et al.  Hybrid textons: modeling surfaces with reflectance and geometry , 2004, CVPR 2004.

[2]  Stephen Lin,et al.  Generalized Displacement Maps , 2004, Rendering Techniques.

[3]  Yizhou Yu,et al.  Shadow Graphs and Surface Reconstruction , 2002, ECCV.

[4]  R. Furukawa,et al.  Synthesis of Textures with Intricate Geometries using BTF and Large Number of Textured Micropolygons , 2005 .

[5]  Hans-Peter Seidel,et al.  Decoupling BRDFs from Surface Mesostructures , 2004, Graphics Interface.

[6]  David J. Kriegman,et al.  Fast texture synthesis on arbitrary meshes , 2003, SIGGRAPH 2003.

[7]  Jirí Filip,et al.  Non-linear reflectance model for bidirectional texture function synthesis , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  Tien-Tsin Wong,et al.  Image-based Rendering with Controllable Illumination , 1997, Rendering Techniques.

[9]  Demetri Terzopoulos,et al.  TensorTextures: multilinear image-based rendering , 2004, ACM Trans. Graph..

[10]  Richard Szeliski,et al.  Stereo Matching with Transparency and Matting , 1999, International Journal of Computer Vision.

[11]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[12]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[13]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[14]  M. Alex O. Vasilescu,et al.  TensorTextures: multilinear image-based rendering , 2004, SIGGRAPH 2004.

[15]  H. Shum,et al.  Shell texture functions , 2004, SIGGRAPH 2004.

[16]  Reinhard Klein,et al.  Compression and Real-Time Rendering of Measured BTFs Using Local PCA , 2003, VMV.

[17]  Dimitri P. Bertsekas,et al.  Incremental Least Squares Methods and the Extended Kalman Filter , 1996, SIAM J. Optim..

[18]  Adam Finkelstein,et al.  Real-time fur over arbitrary surfaces , 2001, I3D '01.

[19]  Baining Guo,et al.  Synthesis and rendering of bidirectional texture functions on arbitrary surfaces , 2004, IEEE Transactions on Visualization and Computer Graphics.

[20]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[21]  Kristin J. Dana,et al.  Hybrid textons: modeling surfaces with reflectance and geometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  James T. Kajiya,et al.  Rendering fur with three dimensional textures , 1989, SIGGRAPH.

[23]  Mark R. Stevens,et al.  Methods for Volumetric Reconstruction of Visual Scenes , 2004, International Journal of Computer Vision.

[24]  Hans-Peter Seidel,et al.  Efficient Cloth Modeling and Rendering , 2001, Rendering Techniques.

[25]  Fabrice Neyret,et al.  Modeling, Animating, and Rendering Complex Scenes Using Volumetric Textures , 1998, IEEE Trans. Vis. Comput. Graph..

[26]  Harry Shum,et al.  Synthesizing bidirectional texture functions for real-world surfaces , 2001, SIGGRAPH.

[27]  Wan-Chun Ma,et al.  Level-of-detail representation of bidirectional texture functions for real-time rendering , 2005, I3D '05.

[28]  Ares Lagae,et al.  Interactive Rendering with Bidirectional Texture Functions , 2003, Comput. Graph. Forum.

[29]  Jean-Michel Dischler,et al.  Efficiently Rendering Macro Geometric Surface Structures with Bi-Directional Texture Functions , 1998, Rendering Techniques.

[30]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[31]  Michal Haindl,et al.  Non-linear reflectance model for bidirectional texture function synthesis , 2004, ICPR 2004.

[32]  M. Koudelka,et al.  Acquisition , Compression , and Synthesis of Bidirectional Texture Functions , 2003 .

[33]  Fabrice Neyret,et al.  Interactive Volumetric Textures , 1998, Rendering Techniques.

[34]  Jirí Filip,et al.  BTF image space utmost compression and modelling method , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[35]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[36]  Kristin J. Dana,et al.  Compact representation of bidirectional texture functions , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[37]  Michal Haindl,et al.  BTF image space utmost compression and modelling method , 2004, ICPR 2004.

[38]  Reinhard Klein,et al.  Preserving Realism in real-time Rendering of Bidirectional Texture Functions , 2003 .

[39]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.