Statistical acquisition of texture appearance

We propose a simple method to acquire and reconstruct material appearance with sparsely sampled data. Our technique renders elaborate view- and light-dependent effects and faithfully reproduces materials such as fabrics and knitwears. Our approach uses sparse measurements to reconstruct a full six-dimensional Bidirectional Texture Function (BTF). Our reconstruction only require input images from the top view to be registered, which is easy to achieve with a fixed camera setup. Bidirectional properties are acquired from a sparse set of viewing directions through image statistics and therefore precise registrations for these views are unnecessary. Our technique is based on multi-scale histograms of image pyramids. The full BTF is generated by matching the corresponding pyramid histograms to interpolated top-view images. We show that the use of multi-scale image statistics achieves a visually plausible appearance. However, our technique does not fully capture sharp specularities or the geometric aspects of parallax. Nonetheless, a large class of materials can be reproduced well with our technique, and our statistical characterization enables acquisition of such materials efficiently using a simple setup.

[1]  Frédo Durand,et al.  Experimental analysis of BRDF models , 2005, EGSR '05.

[2]  Ken Perlin,et al.  Measuring bidirectional texture reflectance with a kaleidoscope , 2003, ACM Trans. Graph..

[3]  Ares Lagae,et al.  Interactive Rendering with Bidirectional Texture Functions , 2003, Comput. Graph. Forum.

[4]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.

[5]  Hans-Peter Seidel,et al.  Decoupling BRDFs from Surface Mesostructures , 2004, Graphics Interface.

[6]  Ralf Sarlette,et al.  Efficient and Realistic Visualization of Cloth , 2003, Rendering Techniques.

[7]  Michal Haindl,et al.  Efficient Image-Based Bidirectional Texture Function Model , 2005 .

[8]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[9]  Shree K. Nayar,et al.  Reflectance and Texture of Real-World Surfaces Authors , 1997, CVPR 1997.

[10]  Kristin J. Dana,et al.  Compact representation of bidirectional texture functions , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Shree K. Nayar,et al.  3D Textured Surface Modeling , 1999 .

[12]  Reinhard Klein,et al.  Reflectance field based real-time, high-quality rendering of bidirectional texture functions , 2004, Comput. Graph..

[13]  Harry Shum,et al.  Synthesizing bidirectional texture functions for real-world surfaces , 2001, SIGGRAPH.

[14]  Kristin J. Dana,et al.  Device for convenient measurement of spatially varying bidirectional reflectance. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Ralf Sarlette,et al.  Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions , 2005, Comput. Graph. Forum.

[16]  MalikJitendra,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001 .

[17]  Demetri Terzopoulos,et al.  TensorTextures: multilinear image-based rendering , 2004, ACM Trans. Graph..

[18]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[19]  Shree K. Nayar,et al.  Correlation model for 3D texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Kristin J. Dana,et al.  Texture histograms as a function of irradiation and viewing direction , 1999, International Journal of Computer Vision.

[21]  F. Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH 2005.

[22]  Reinhard Klein,et al.  Rapid Synchronous Acquisition of Geometry and Appearance of Cultural Heritage Artefacts , 2005, VAST.

[23]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[24]  Shree K. Nayar,et al.  Histogram model for 3D textures , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[25]  J. Koenderink,et al.  Bidirectional Texture Contrast Function , 2004, International Journal of Computer Vision.

[26]  M. Koudelka,et al.  Acquisition , Compression , and Synthesis of Bidirectional Texture Functions , 2003 .

[27]  Mark D. Fairchild,et al.  Sharpness Rules , 2000, Color Imaging Conference.

[28]  Jan J. Koenderink,et al.  Bidirectional Texture Contrast Function , 2004, International Journal of Computer Vision.

[29]  M. Alex O. Vasilescu,et al.  TensorTextures: multilinear image-based rendering , 2004, SIGGRAPH 2004.

[30]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..