The Gabor function extracts the maximum information from input local signals

The receptive fields of simple cells in the visual cortex are well approximated by Gabor functions. This paper shows that the Gabor functions are derived as solutions for a certain mutual-information maximization problem. This means that, under rather general assumptions, the Gabor function can extract the maximum information from input local signals. This suggests that the receptive fields of simple cells are optimally designed from an information theoretic viewpoint.

[1]  M. Torma,et al.  Kohonen self-organizing feature map and its use in clustering , 1994, Other Conferences.

[2]  Dennis Gabor,et al.  Theory of communication , 1946 .

[3]  Ralph Linsker,et al.  Deriving Receptive Fields Using an Optimal Encoding Criterion , 1992, NIPS.

[4]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[5]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[6]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[7]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[8]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[9]  S. Tanaka,et al.  Experience-dependent self-organization of biological neural networks , 1990 .

[10]  J. Daugman.  Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[11]  Kenji Okajima,et al.  Two-dimensional Gabor-type receptive field as derived by mutual information maximization , 1998, Neural Networks.

[12]  William Bialek,et al.  Princeton Lectures on Biophysics , 1993 .