On-the-fly multi-scale infinite texturing from example

In computer graphics, rendering visually detailed scenes is often achieved through texturing. We propose a method for on-the-fly non-periodic infinite texturing of surfaces based on a single image. Pattern repetition is avoided by defining patches within each texture whose content can be changed at runtime. In addition, we consistently manage multi-scale using one input image per represented scale. Undersampling artifacts are avoided by accounting for fine-scale features while colors are transferred between scales. Eventually, we allow for relief-enhanced rendering and provide a tool for intuitive creation of height maps. This is done using an ad-hoc local descriptor that measures feature self-similarity in order to propagate height values provided by the user for a few selected texels only. Thanks to the patch-based system, manipulated data are compact and our texturing approach is easy to implement on GPU. The multi-scale extension is capable of rendering finely detailed textures in real-time.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Yong Haur Tay,et al.  RECENT TRENDS IN TEXTURE CLASSIFICATION: A REVIEW , 2009 .

[3]  Ares Lagae,et al.  A procedural object distribution function , 2005, TOGS.

[4]  Ken Perlin,et al.  An image synthesizer , 1988 .

[5]  Gregory Dudek,et al.  Procedural Texture Matching and Transformation , 2004, Comput. Graph. Forum.

[6]  Manuel Menezes de Oliveira Neto,et al.  Real-time relief mapping on arbitrary polygonal surfaces , 2005, I3D '05.

[7]  Dani Lischinski,et al.  Recursive Wang tiles for real-time blue noise , 2006, ACM Trans. Graph..

[8]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[9]  Harry Shum,et al.  Interactive shape from shading , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Eitan Grinspun,et al.  Multiscale texture synthesis , 2008, ACM Trans. Graph..

[11]  Michael Gervautz,et al.  A simple method for color quantization: octree quantization , 1990 .

[12]  Frank Losasso,et al.  Geometry clipmaps: terrain rendering using nested regular grids , 2004, ACM Trans. Graph..

[13]  Pieter Peers,et al.  Facial performance synthesis using deformation-driven polynomial displacement maps , 2008, SIGGRAPH Asia '08.

[14]  Neil A. Dodgson,et al.  Self-similarity based texture editing , 2002, SIGGRAPH.

[15]  Jean-Michel Dischler,et al.  Procedural Descriptions of Anisotropic Noisy Textures by Example , 2010, Eurographics.

[16]  Jean-Michel Dischler,et al.  Coherent Bump Map Recovery from a Single Texture Image , 2002, Graphics Interface.

[17]  Holly E. Rushmeier,et al.  Physically-based interactive bi-scale material design , 2011, ACM Trans. Graph..

[18]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, ACM Trans. Graph..

[20]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[21]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[22]  Rüdiger Westermann,et al.  Interactive Editing of GigaSample Terrain Fields , 2012, Comput. Graph. Forum.

[23]  George Drettakis,et al.  Image-guided weathering: A new approach applied to flow phenomena , 2011, TOGS.

[24]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Anton Alstes Wang Tiles for Image and Texture Generation , 2004 .

[26]  Bruno Galerne,et al.  Gabor noise by example , 2012, ACM Trans. Graph..

[27]  Michael Werman,et al.  Color lines: image specific color representation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[28]  Ares Lagae,et al.  An alternative for Wang tiles: colored edges versus colored corners , 2006, TOGS.

[29]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[30]  H. Shum,et al.  Shell texture functions , 2004, SIGGRAPH 2004.

[31]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..