Localized measurement of emergent image frequencies by Gabor wavelets

The authors derive, implement, and demonstrate a computational approach for the measurement of emergent image frequencies. Measuring emergent signal frequencies requires spectral measurements accurate in both frequency and time or space, conflicting requirements that are shown to be balanced by a generalized uncertainty relationship. Such spectral measurements can be obtained from the responses of multiple wavelet-like channel filters that sample the signal spectrum, and that yield a locus of possible solutions for each locally emergent frequency. It is shown analytically that this locus of solutions is maximally localized in both space and frequency if the channel filters used are Gabor wavelets. A constrained solution is obtained by imposing a stabilizing term that develops naturally from the assumptions on the signal. The measurement of frequencies is then cast as an ill-posed extremum problem regularized by the stabilizing term, leading to an iterative constraint propagation algorithm. The technique is demonstrated by application to a variety of 2-D textured images. >

[1]  Daniel A. Pollen,et al.  Visual cortical neurons as localized spatial frequency filters , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  A. Papoulis,et al.  The Fourier Integral and Its Applications , 1963 .

[3]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  Martin D. Levine,et al.  Vision in Man and Machine , 1985 .

[5]  Alan C. Bovik,et al.  Numerical analysis of visual patterns , 1989, Sixth Multidimensional Signal Processing Workshop,.

[6]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Alan C. Bovik,et al.  Numerical Analysis of Image Patterns , 1989, Other Conferences.

[8]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  M. R. Turner,et al.  Texture discrimination by Gabor functions , 1986, Biological Cybernetics.

[10]  Andrew P. Witkin,et al.  Recovering Surface Shape and Orientation from Texture , 1981, Artif. Intell..

[11]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[12]  Ramesh Jain,et al.  The analysis of oriented textures through phase portraits , 1990 .

[13]  J.A. Moorer,et al.  Signal processing aspects of computer music: A survey , 1977, Proceedings of the IEEE.

[14]  Alan C. Bovik,et al.  Analysis of multichannel narrow-band filters for image texture segmentation , 1991, IEEE Trans. Signal Process..

[15]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  Thomas W. Parks,et al.  Time-varying filtering and signal estimation using Wigner distribution synthesis techniques , 1986, IEEE Trans. Acoust. Speech Signal Process..

[18]  S. Bass,et al.  High quality synthesis of musical voices in discrete time , 1984 .

[19]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[20]  Boualem Boashash,et al.  On estimating the instantaneous frequency of a Gaussian random signal by use of the Wigner-Ville distribution , 1988, IEEE Trans. Acoust. Speech Signal Process..

[21]  Kazuo Ohmi,et al.  Numerical processing of flow-visualization pictures – measurement of two-dimensional vortex flow , 1983, Journal of Fluid Mechanics.

[22]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[23]  Curtis Roads,et al.  Automated Granular Synthesis of Sound , 1978 .

[24]  Alan V. Oppenheim,et al.  Speech spectrograms using the fast Fourier transform , 1970, IEEE Spectrum.

[25]  E. Wigner On the quantum correction for thermodynamic equilibrium , 1932 .

[26]  Steven M. Sussman,et al.  Least-square synthesis of radar ambiguity functions , 1962, IRE Trans. Inf. Theory.

[27]  Andrew P. Witkin,et al.  Analyzing Oriented Patterns , 1985, IJCAI.

[28]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[29]  M. Portnoff Time-frequency representation of digital signals and systems based on short-time Fourier analysis , 1980 .

[30]  Bruce J. Schachter Long crested wave models , 1980 .

[31]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[32]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[33]  T. Claasen,et al.  THE WIGNER DISTRIBUTION - A TOOL FOR TIME-FREQUENCY SIGNAL ANALYSIS , 1980 .

[34]  R. L. de Valois,et al.  Relationship between spatial-frequency and orientation tuning of striate-cortex cells. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[35]  L. Glass Moiré Effect from Random Dots , 1969, Nature.

[36]  Alex Pentland,et al.  Shading into Texture , 1984, Artif. Intell..

[37]  A. R. Rao,et al.  Computing oriented texture fields , 1989, CVPR 1989.

[38]  Mj Martin Bastiaans Gabor's signal expansion and degrees of freedom of a signal , 1982 .

[39]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[40]  Dennis Gabor,et al.  Theory of communication , 1946 .

[41]  Martin J. Bastiaans,et al.  Sampling Theorem For The Complex Spectrogram, And Gabor's Expansion Of A Signal In Gaussian Elementary Signals , 1980, Other Conferences.

[42]  David J. Heeger,et al.  Optical flow from spatialtemporal filters , 1987 .

[43]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[44]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[45]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[46]  J.B. Allen,et al.  A unified approach to short-time Fourier analysis and synthesis , 1977, Proceedings of the IEEE.

[47]  Alan C. Bovik,et al.  Channel interactions in visible pattern analysis , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[48]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[49]  Alan C. Bovik,et al.  Localized measurement of image fractal dimension using gabor filters , 1991, J. Vis. Commun. Image Represent..

[50]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Mj Martin Bastiaans A Sampling Theorem For The Complex Spectrogram, And Gabor's Expansion Of A Signal In Gaussian Elementary Signals , 1981 .

[52]  Berthold K. P. Horn,et al.  Determining Shape and Reflectance Using Multiple Images , 1978 .

[53]  Roland T. Chin,et al.  Shape from texture using the Wigner distribution , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[54]  Yehoshua Y. Zeevi,et al.  The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..