Patch-Based Texture Synthesis Using Wavelets

Patch-based texture synthesis builds a texture by joining together blocks of pixels — patches — of the original sample. Usually the best patches are selected among all possible using a L2 norm on the RGB or grayscale pixel values of boundary zones. The L2 metric provides the raw pixel-to-pixel difference, disregarding relevant image structures — such as edges — that are relevant in the human visual system and therefore on synthesis of new textures. We present a wavelet-based approach for selecting patches for patch-based texture synthesis. For each possible patch we compute the wavelet coefficients for the boundary region and pick the patch with the smallest error computed from the wavelet coefficients. We show that the use of wavelets as metric for selection of the best patches improves texture synthesis for samples which previous work fails, mainly textures with prominent aligned features.

[1]  Eero P. Simoncelli,et al.  Texture characterization via joint statistics of wavelet coefficient magnitudes , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Raghu Machiraju,et al.  Steering Image Generation with Wavelet Based Perceptual Metric , 1997, Comput. Graph. Forum.

[4]  Stéphane Mallat,et al.  Characterization of Signals from Multiscale Edges , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  F. Schmitt,et al.  Bidimensional texture synthesis by Markov chains , 1981 .

[6]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[7]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[8]  Chi-Man Pun,et al.  Log-Polar Wavelet Energy Signatures for Rotation and Scale Invariant Texture Classification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Pat Hanrahan,et al.  Wavelet radiosity , 1993, SIGGRAPH.

[10]  Marcelo Walter,et al.  Towards local control for image-based texture synthesis , 2002, Proceedings. XV Brazilian Symposium on Computer Graphics and Image Processing.

[11]  C.-C. Jay Kuo,et al.  Texture analysis and classification with tree-structured wavelet transform , 1993, IEEE Trans. Image Process..

[12]  Arivazhagan Selvaraj,et al.  Texture classification using wavelet transform , 2003, Pattern Recognit. Lett..

[13]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[14]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[15]  Edwin Earl Catmull,et al.  A subdivision algorithm for computer display of curved surfaces. , 1974 .

[16]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[17]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[19]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[20]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[21]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[22]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[23]  David S. Ebert,et al.  Texturing and Modeling , 1998 .

[24]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[25]  King-Sun Fu,et al.  A syntactic approach to texture analysis , 1978 .

[26]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Songde Ma,et al.  Model driven synthesis of natural textures for 3-D scenes , 1986, Comput. Graph..