The Heeger & Bergen Pyramid Based Texture Synthesis Algorithm

This contribution deals with the Heeger-Bergen pyramid-based texture analysis/synthesis algorithm. It brings a detailed explanation of the original algorithm tested on many characteristic examples. Our analysis reproduces the original results, but also brings a minor improvement concerning non-periodic textures. Inspired by visual perception theories, Heeger and Bergen proposed to characterize a texture by its first-order statistics of both its color and its responses to multiscale and multi-orientation filters, namely the steerable pyramid. The Heeger-Bergen algorithm consists in the following procedure: starting from a white noise image, histogram matchings are performed to the image alternately in the image domain and the steerable pyramid domain, so that the corresponding output histograms match the ones of the input texture. Source Code An on-line demo 1 of the Heeger-Bergen pyramid-based texture synthesis algorithm is available. The demo permits to upload a color image to extract a subimage and to run the texture synthesis algorithm on this subimage. The algorithm available in the demo is a slightly improved version treating non-periodic textures by a “periodic+smooth” decomposition [13]. The algorithm works with color textures and is able to synthesize textures with larger size than the input image. The original version of the Heeger-Bergen algorithm (where the boundaries are handled by mirror symmetrization) is optional in the source code. An ANSI C implementation is available for download here 2 . It is provided with: • An illustrated html documentation; • Source code; This code requires libpng, libfftw3, openmp, and getopt. Compilation and usage instructions are included in the README.txt file of the zip archive. The illustrated HTML documentation can be reproduced from the source code by using

[1]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[2]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[3]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[4]  Bruno Galerne,et al.  Gabor noise by example , 2012, ACM Trans. Graph..

[5]  Yann Gousseau,et al.  Variational Texture Synthesis with Sparsity and Spectrum Constraints , 2015, Journal of Mathematical Imaging and Vision.

[6]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[7]  Lionel Moisan,et al.  Periodic Plus Smooth Image Decomposition , 2011, Journal of Mathematical Imaging and Vision.

[8]  C. Villani.  Optimal Transport: Old and New , 2008 .

[9]  Arjan Kuijper,et al.  Scale Space and Variational Methods in Computer Vision , 2013, Lecture Notes in Computer Science.

[10]  Bruno Galerne,et al.  Random Phase Textures: Theory and Synthesis , 2011, IEEE Transactions on Image Processing.

[11]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[12]  Gabriel Peyré,et al.  Texture Synthesis with Grouplets , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ares Lagae,et al.  A Survey of Procedural Noise Functions , 2010, Comput. Graph. Forum.

[14]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[15]  Julien Rabin,et al.  Wasserstein Barycenter and Its Application to Texture Mixing , 2011, SSVM.

[16]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[17]  Jose Luis Lisani,et al.  Image Color Cube Dimensional Filtering and Visualization , 2011, Image Process. Line.

[18]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[19]  Bruno Galerne,et al.  Micro-Texture Synthesis by Phase Randomization , 2011, Image Process. Line.

[20]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[21]  Dinu Coltuc,et al.  Exact histogram specification , 2006, IEEE Transactions on Image Processing.

[22]  Alessandro Bevilacqua,et al.  A High Performance Exact Histogram Specification Algorithm , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[23]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[24]  Ares Lagae,et al.  Procedural isotropic stochastic textures by example , 2010, Comput. Graph..