Segmentation of Gabor-filtered textures using deterministic relaxation

A supervised texture segmentation scheme is proposed in this article. The texture features are extracted by filtering the given image using a filter bank consisting of a number of Gabor filters with different frequencies, resolutions, and orientations. The segmentation model consists of feature formation, partition, and competition processes. In the feature formation process, the texture features from the Gabor filter bank are modeled as a Gaussian distribution. The image partition is represented as a noncausal Markov random field (MRF) by means of the partition process. The competition process constrains the overall system to have a single label for each pixel. Using these three random processes, the a posteriori probability of each pixel label is expressed as a Gibbs distribution. The corresponding Gibbs energy function is implemented as a set of constraints on each pixel by using a neural network model based on Hopfield network. A deterministic relaxation strategy is used to evolve the minimum energy state of the network, corresponding to a maximum a posteriori (MAP) probability. This results in an optimal segmentation of the textured image. The performance of the scheme is demonstrated on a variety of images including images from remote sensing.

[1]  Daniel A. Pollen,et al.  Visual cortical neurons as localized spatial frequency filters , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[3]  J. Daugman.  Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  Sridhar Lakshmanan,et al.  Simultaneous Parameter Estimation and Segmentation of Gibbs Random Fields Using Simulated Annealing , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  David H. Berger.  Texture as a Discriminant of Crops on Radar Imagery , 1970 .

[7]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[8]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[10]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[11]  D. C. Essen,et al.  Visual areas of the mammalian cerebral cortex. , 1979 .

[12]  John H. R. Maunsell,et al.  Hierarchical organization and functional streams in the visual cortex , 1983, Trends in Neurosciences.

[13]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[15]  Bayya Yegnanarayana,et al.  A combined neural network approach for texture classification , 1995, Neural Networks.

[16]  F. A. DeCosta,et al.  Neural network recognition of textured images using third order cumulants as functional links , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  Rama Chellappa,et al.  Texture segmentation with neural networks , 1992 .

[18]  Wilson S. Geisler,et al.  COMPUTATIONAL TEXTURE ANALYSIS USING LOCALIZED SPATIAL FILTERING. , 1987 .

[19]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[20]  Dennis Gabor,et al.  Theory of communication , 1946 .

[21]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[22]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[23]  Ruzena Bajcsy,et al.  Computer Description of Textured Surfaces , 1973, IJCAI.

[24]  Azriel Rosenfeld,et al.  A Comparative Study of Texture Measures for Terrain Classification , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  John W. Woods,et al.  Two-dimensional discrete Markovian fields , 1972, IEEE Trans. Inf. Theory.

[26]  D G Stork,et al.  Do Gabor functions provide appropriate descriptions of visual cortical receptive fields? , 1990, Journal of the Optical Society of America. A, Optics and image science.

[27]  Anil K. Jain,et al.  A spatial filtering approach to texture analysis , 1985, Pattern Recognit. Lett..

[28]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Jack Sklansky,et al.  Image Segmentation and Feature Extraction , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[30]  H. Wechsler,et al.  Joint spatial/spatial-frequency representation , 1988 .

[31]  K. Laws.  Textured Image Segmentation , 1980 .

[32]  James M. Keller,et al.  Texture description and segmentation through fractal geometry , 1989, Comput. Vis. Graph. Image Process..

[33]  Ari Visa,et al.  A texture classifier based on neural network principles , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[34]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.