A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients

We present a universal statistical model for texture images in the context of an overcomplete complex wavelet transform. The model is parameterized by a set of statistics computed on pairs of coefficients corresponding to basis functions at adjacent spatial locations, orientations, and scales. We develop an efficient algorithm for synthesizing random images subject to these constraints, by iteratively projecting onto the set of images satisfying each constraint, and we use this to test the perceptual validity of the model. In particular, we demonstrate the necessity of subgroups of the parameter set by showing examples of texture synthesis that fail when those parameters are removed from the set. We also demonstrate the power of our model by successfully synthesizing examples drawn from a diverse collection of artificial and natural textures.

[1]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[2]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[3]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[4]  B Julesz,et al.  Inability of Humans to Discriminate between Visual Textures That Agree in Second-Order Statistics—Revisited , 1973, Perception.

[5]  M. Shishuku.  [Visual discrimination]. , 1974, Kokubyo Gakkai zasshi. The Journal of the Stomatological Society, Japan.

[6]  B Julesz,et al.  Experiments in the visual perception of texture. , 1975, Scientific American.

[7]  Olivier D. Faugeras,et al.  Visual Discrimination of Stochastic Texture Fields , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Dante C. Youla,et al.  Generalized Image Restoration by the Method of Alternating Orthogonal Projections , 1978 .

[9]  E. T. Jaynes,et al.  Where do we Stand on Maximum Entropy , 1979 .

[10]  Olivier D. Faugeras,et al.  Decorrelation Methods of Texture Feature Extraction , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  M. Hassner,et al.  The use of Markov Random Fields as models of texture , 1980 .

[12]  D. Freedman,et al.  On the statistics of vision: The Julesz conjecture☆ , 1981 .

[13]  André Gagalowicz,et al.  A New Method for Texture Fields Synthesis: Some Applications to the Study of Human Vision , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[15]  M. Sezan,et al.  Image Restoration by the Method of Convex Projections: Part 2-Applications and Numerical Results , 1982, IEEE Transactions on Medical Imaging.

[16]  D. Youla,et al.  Image Restoration by the Method of Convex Projections: Part 1ߞTheory , 1982, IEEE Transactions on Medical Imaging.

[17]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Theodosios Pavlidis,et al.  Segmentation by Texture Using Correlation , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Hans Knutsson,et al.  Texture Analysis Using Two-Dimensional Quadrature Filters , 1983 .

[20]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  J. Daugman,et al.  Pure orientation filtering: A scale-invariant image-processing tool for perception research and data compression , 1986 .

[22]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[24]  A B Watson,et al.  Efficiency of a model human image code. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[25]  D Kersten,et al.  Predictability and redundancy of natural images. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[26]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[27]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[28]  D. Cano,et al.  Texture synthesis using hierarchical linear transforms , 1988 .

[29]  N. Graham.  Visual Pattern Analyzers , 1989 .

[30]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  J.G. Daugman,et al.  Entropy reduction and decorrelation in visual coding by oriented neural receptive fields , 1989, IEEE Transactions on Biomedical Engineering.

[32]  M. Porat,et al.  Localized texture processing in vision: analysis and synthesis in the Gaborian space , 1989, IEEE Transactions on Biomedical Engineering.

[33]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[34]  Jitendra Malik,et al.  Detecting and localizing edges composed of steps, peaks and roofs , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[35]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Harry Wechsler,et al.  Segmentation of Textured Images and Gestalt Organization Using Spatial/Spatial-Frequency Representations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  J. Bergen,et al.  Computational Modeling of Visual Texture Segregation , 1991 .

[38]  Alfredo Restrepo,et al.  Localized measurement of emergent image frequencies by Gabor wavelets , 1992, IEEE Trans. Inf. Theory.

[39]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[40]  Joseph M. Francos,et al.  A unified texture model based on a 2-D Wold-like decomposition , 1993, IEEE Trans. Signal Process..

[41]  J. Yellott.  IMPLICATIONS OF TRIPLE CORRELATION UNIQUENESS FOR TEXTURE STATISTICS AND THE JULESZ CONJECTURE , 1993 .

[42]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[43]  J. Cadzow,et al.  Image texture synthesis-by-analysis using moving-average models , 1993 .

[44]  DaubechiesIngrid.  Orthonormal bases of compactly supported wavelets II , 1993 .

[45]  Kris Popat,et al.  Novel cluster-based probability model for texture synthesis, classification, and compression , 1993, Other Conferences.

[46]  Charles A. Bouman,et al.  A multiscale random field model for Bayesian image segmentation , 1994, IEEE Trans. Image Process..

[47]  J. Victor.  Images, statistics, and textures: implications of triple correlation uniqueness for texture statistics and the Julesz conjecture: comment , 1994 .

[48]  Norman S. Kopeika,et al.  Target acquisition modeling for contrast-limited imaging: effects of atmospheric blur and image restoration , 1995 .

[49]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[50]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[51]  Javier Portilla,et al.  Textures synthesis-by-analysis based on a multiscale early-vision model , 1996 .

[52]  D. Field,et al.  Natural Image Statistics and Eecient Coding , 1996 .

[53]  Oscar Nestares,et al.  Texture synthesis‐by‐analysis method based on a multiscale early‐vision model , 1996 .

[54]  Song-Chun Zhu,et al.  FRAME: filters, random fields, and minimax entropy towards a unified theory for texture modeling , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[55]  Takashi Totsuka,et al.  Combining frequency and spatial domain information for fast interactive image noise removal , 1996, SIGGRAPH.

[56]  D. Field,et al.  Natural image statistics and efficient coding. , 1996, Network.

[57]  Eero P. Simoncelli.  Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[58]  Kris Popat,et al.  Cluster-based probability model and its application to image and texture processing , 1997, IEEE Trans. Image Process..

[59]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[60]  Song-Chun Zhu,et al.  Minimax Entropy Principle and Its Application to Texture Modeling , 1997, Neural Computation.

[61]  Paul A. Viola,et al.  A Non-Parametric Multi-Scale Statistical Model for Natural Images , 1997, NIPS.

[62]  Eero P. Simoncelli,et al.  Texture characterization via joint statistics of wavelet coefficient magnitudes , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[63]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[64]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[65]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[66]  Rafael Fonolla Navarro,et al.  Duality of log-polar image representations in the space and spatial-frequency domains , 1999, IEEE Trans. Signal Process..

[67]  Roberto Manduchi,et al.  Independent component analysis of textures , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[68]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[69]  Eero P. Simoncelli,et al.  Texture modeling and synthesis using joint statistics of complex wavelet coefficients , 1999 .

[70]  Eero P. Simoncelli,et al.  Image denoising via adjustment of wavelet coefficient magnitude correlation , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[71]  M. R. Turner,et al.  Texture discrimination by Gabor functions , 1986, Biological Cybernetics.

[72]  Song-Chun Zhu,et al.  Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling , 1998, International Journal of Computer Vision.

[73]  B. Julesz,et al.  Visual discrimination of textures with identical third-order statistics , 1978, Biological Cybernetics.