Multiview texture models

Mapping textured images on smoothly approximated surfaces is often used to conceal the loss of their real, fine-grained relief. A limitation of mapping a fixed texture in such cases is that it will only be correct for one viewing and one illumination direction. The presence of geometric surface details causes changes that simple foreshortening and global color scaling cannot model well. Hence, one would like to synthesize different textures for different viewing conditions. A texture model is presented that takes account of viewpoint dependent changes in texture appearance. It is highly compact and avoids copy-and-paste like repetitions. The model is learned from example images taken from different viewpoints. It supports texture synthesis for previously unseen conditions.

[1]  B. Julesz,et al.  Early visual perception. , 1981, Annual review of psychology.

[2]  Songde Ma,et al.  Sequential synthesis of natural textures , 1985, Comput. Vis. Graph. Image Process..

[3]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[4]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[5]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[6]  Roland Wilson,et al.  A two-component model of texture for analysis and synthesis , 1998, IEEE Trans. Image Process..

[7]  Fabrice Neyret,et al.  Modeling, Animating, and Rendering Complex Scenes Using Volumetric Textures , 1998, IEEE Trans. Vis. Comput. Graph..

[8]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[9]  Jitendra Malik,et al.  Recognizing surfaces using three-dimensional textons , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Shree K. Nayar,et al.  Correlation model for 3D texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Eero P. Simoncelli,et al.  Texture modeling and synthesis using joint statistics of complex wavelet coefficients , 1999 .

[13]  Georgy L. Gimel'farb,et al.  Image Textures and Gibbs Random Fields , 1999, Computational Imaging and Vision.

[14]  Manuel Menezes de Oliveira Neto,et al.  Relief texture mapping , 2000, SIGGRAPH.

[15]  Luc Van Gool,et al.  A Compact Model for Viewpoint Dependent Texture Synthesis , 2000, SMILE.

[16]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[17]  A. Zalesny.  Analysis and Synthesis of Textures With Pairwise Signal Interactions , 2002 .