The Evolution of Modern Texture Processing

This paper studies the evolution of image texture processing techniques over the last years Although texture is a fundamental attribute of images that has been shown to play an important role in human visual perception the quanti cation and characterization of texture is di cult Early texture processing techniques described texture deterministically or statistically in terms of repeated gray level patterns and the structure of the spatial placement of these patterns Gray level cooccurrence matrices were among the most successful such methods Modern texture processing techniques tend to characterize texture in terms of spatio spectrally localized coherent amplitude frequency and phase modulations This paper argues that evolution of the modern methods from the early methods can be directly linked to advances in the understand ing of mammalian biological visual function that occurred in the elds of psychophysics and physiology and furthermore that the most successful modern methods have evolved to emulate biological vision systems Evolution of modern texture processing methods is examined and several of the most successful new techniques such as the multidi mensional Teager Kaiser operator and AM FM modeling techniques are described in some detail The use of computed dominant modulations to perform e ective texture segmentation is demonstrated for the rst time This research was supported in part by the Army Research O ce under contract DAAH and by the Air Force O ce of Scienti c Research Air Force Systems Command USAF under grant number F Author preprint Submitted to Elektrik Turkish Journal of Electrical Engineering and Computer Sciences

[1]  D. Tolhurst,et al.  On the variety of spatial frequency selectivities shown by neurons in area 17 of the cat , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  N. Graham Visual detection of aperiodic spatial stimuli by probability summation among narrowband channels , 1977, Vision Research.

[3]  Petros Maragos,et al.  Multidimensional energy operator for image processing , 1992, Other Conferences.

[4]  Sanjit K. Mitra,et al.  Nonlinear detail enhancement of error-diffused images , 1994, Electronic Imaging.

[5]  Joseph M. Francos,et al.  The polynomial phase difference operator for modeling of nonhomogeneous images , 1995, Proceedings., International Conference on Image Processing.

[6]  Mj Martin Bastiaans A Sampling Theorem For The Complex Spectrogram, And Gabor's Expansion Of A Signal In Gaussian Elementary Signals , 1981 .

[7]  M. Bastiaans,et al.  Gabor's expansion of a signal into Gaussian elementary signals , 1980, Proceedings of the IEEE.

[8]  J. Mayer,et al.  On the Quantum Correction for Thermodynamic Equilibrium , 1947 .

[9]  Gilbert Strang,et al.  Wavelets and Dilation Equations: A Brief Introduction , 1989, SIAM Rev..

[10]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[11]  Alan C. Bovik Variational pattern analysis using Gabor wavelets , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Alfredo Restrepo,et al.  Localized measurement of emergent image frequencies by Gabor wavelets , 1992, IEEE Trans. Inf. Theory.

[13]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[14]  H. Teager Some observations on oral air flow during phonation , 1980 .

[15]  L. Maffei,et al.  The visual cortex as a spatial frequency analyser. , 1973, Vision research.

[16]  Olivier Rioul,et al.  Affine smoothing of the Wigner-Ville distribution , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[17]  Jr. Thomas G. Stockham,et al.  Image processing in the context of a visual model , 1972 .

[18]  Petros Maragos,et al.  Image demodulation using multidimensional energy separation , 1995 .

[19]  Bruce J. Schachter Long crested wave models , 1980 .

[20]  R. Schafer,et al.  Morphological systems for multidimensional signal processing , 1990, Proc. IEEE.

[21]  M. Porat,et al.  Localized texture processing in vision: analysis and synthesis in the Gaborian space , 1989, IEEE Transactions on Biomedical Engineering.

[22]  L. Cohen,et al.  Time-frequency distributions-a review , 1989, Proc. IEEE.

[23]  Alan C. Bovik,et al.  TEXTURE DISCRIMINATION USING A MODEL OF VISUAL CORTEX. , 1986 .

[24]  Yehoshua Y. Zeevi,et al.  The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Hugh R. Wilson,et al.  10 – THE PERCEPTION OF FORM: Retina to Striate Cortex , 1989 .

[26]  J. P. Jones,et al.  The two-dimensional spectral structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[27]  R. L. de Valois,et al.  Relationship between spatial-frequency and orientation tuning of striate-cortex cells. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[28]  R. Wilson,et al.  Finite Prolate Spheroidal Sequences and their Applications II: Image Feature Description and Segmentation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Ramesh C. Jain,et al.  Computerized Flow Field Analysis: Oriented Texture Fields , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Anil K. Jain,et al.  A spatial filtering approach to texture analysis , 1985, Pattern Recognit. Lett..

[31]  Daniel A. Pollen,et al.  Visual cortical neurons as localized spatial frequency filters , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[32]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[33]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex. , 1978, The Journal of physiology.

[34]  Alan C. Bovik,et al.  Shape-from-texture by wavelet-based measurement of local spectral moments , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  S. Mallat Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[36]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[37]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[38]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[39]  William J. Williams,et al.  Improved time-frequency representation of multicomponent signals using exponential kernels , 1989, IEEE Trans. Acoust. Speech Signal Process..

[40]  R. E. Raab Gabor's Signal Expansion and Degrees of Freedom of a Signal , 1982 .

[41]  D. M. MacKay,et al.  Strife over visual cortical function , 1981, Nature.

[42]  Philip M. Woodward,et al.  Probability and Information Theory with Applications to Radar , 1954 .

[43]  Joseph M. Francos,et al.  An estimation algorithm for 2-D polynomial phase signals , 1996, IEEE Trans. Image Process..

[44]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[45]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Alan C. Bovik,et al.  Multi-component AM-FM image models and wavelet-based demodulation with component tracking , 1994, Proceedings of 1st International Conference on Image Processing.

[47]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[48]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[49]  A. Papoulis Signal Analysis , 1977 .

[50]  G. Sandini,et al.  Responses of visual cortical cells to periodic and non‐periodic stimuli. , 1979, The Journal of physiology.

[51]  B Julesz,et al.  Experiments in the visual perception of texture. , 1975, Scientific American.

[52]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[53]  Sanjit K. Mitra,et al.  Quadratic filters for image contrast enhancement , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[54]  Petros Maragos,et al.  Modulation models for image processing and wavelet-based image demodulation , 1992, [1992] Conference Record of the Twenty-Sixth Asilomar Conference on Signals, Systems & Computers.

[55]  Alan C. Bovik,et al.  Shape from Texture Using Local Spectral Moments , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  A. Grossmann,et al.  Cycle-octave and related transforms in seismic signal analysis , 1984 .

[57]  Sanjit K. Mitra,et al.  A new nonlinear algorithm for the removal of impulse noise from highly corrupted images , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.

[58]  Wilson S. Geisler,et al.  COMPUTATIONAL TEXTURE ANALYSIS USING LOCALIZED SPATIAL FILTERING. , 1987 .

[59]  N. Graham,et al.  Detection of grating patterns containing two spatial frequencies: a comparison of single-channel and multiple-channels models. , 1971, Vision research.

[60]  Alan C. Bovik,et al.  Planar surface orientation from texture spatial frequencies , 1995, Pattern Recognit..

[61]  Luc Van Gool,et al.  Texture analysis Anno 1983 , 1985, Comput. Vis. Graph. Image Process..

[62]  Azriel Rosenfeld,et al.  Digital Picture Processing , 1976 .

[63]  H. M. Teager,et al.  Evidence for Nonlinear Sound Production Mechanisms in the Vocal Tract , 1990 .

[64]  Marios S. Pattichis,et al.  AM-FM image analysis techniques , 1996, Proceeding of Southwest Symposium on Image Analysis and Interpretation.

[65]  Alan C. Bovik,et al.  Stereo disparity from multiscale processing of local image phase , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[66]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[67]  J. Kirkwood Quantum Statistics of Almost Classical Assemblies , 1933 .

[68]  Andrew P. Witkin,et al.  Analyzing Oriented Patterns , 1985, IJCAI.

[69]  M. Portnoff Time-frequency representation of digital signals and systems based on short-time Fourier analysis , 1980 .

[70]  Alan C. Bovik,et al.  Limits on discrete modulated signals , 1997, IEEE Trans. Signal Process..

[71]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[72]  Sanjit K. Mitra,et al.  A new class of nonlinear filters for image enhancement , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[73]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[74]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[75]  A. R. Rao,et al.  Computing oriented texture fields , 1989, CVPR 1989.

[76]  S. Zucker,et al.  Finding structure in Co-occurrence matrices for texture analysis , 1980 .

[77]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[78]  T. Caelli,et al.  On the detection of Gabor signals and discrimination of Gabor textures , 1985, Vision Research.

[79]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[80]  J. F. Kaiser,et al.  On a simple algorithm to calculate the 'energy' of a signal , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[81]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[82]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[83]  Terry Caelli,et al.  Probing the spatial frequency spectrum for orientation sensitivity in stochastic textures , 1983, Vision Research.

[84]  E. Yund,et al.  Responses of striate cortex cells to grating and checkerboard patterns. , 1979, The Journal of physiology.

[85]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[86]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[87]  Alan C. Bovik,et al.  Discrete quasi-eigenfunction approximation for AM-FM image analysis , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.