Wavelets, blur, and the sources of variability in the amplitude spectra of natural scenes

A number of recent efforts have been made to account for the response properties of the cells in the visual pathway by considering the statistical structure of the natural environment. Previously, it has been suggested that the wavelet-like properties of cells in primary visual cortex have been proposed to provide an efficient representation of the structure in natural scenes captured by the phase spectrum. In this paper, we take a closer look at the amplitude spectra of natural scenes and its role in understanding visual coding. We propose that one of the principle insights one gains from the amplitude spectra is in understanding the relative sensitivity of cells tuned to different frequencies. It is suggested that response magnitude of cells tuned to different frequencies increases with frequency out to about 20 cycles/deg. The result is a code in which the response to natural scenes with a 1/f falloff is approximately flat out to 20 cycles/deg. The variability in the amplitude spectra of natural scenes is also investigated. Using a measure called the 'thresholded contrast spectrum' (TCS), it is demonstrated that a good proportion of the variability in the spectra is due to the relative sparseness of structure at different frequencies. The slope of the TCS was found to provide a reasonable prediction of blur across a variety of scenes in spite of the variability in their amplitude spectra.

[1]  J. H. van Hateren,et al.  Real and optimal neural images in early vision , 1992, Nature.

[2]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[3]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[4]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[5]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[6]  L. Croner,et al.  Receptive fields of P and M ganglion cells across the primate retina , 1995, Vision Research.

[7]  G. Hartmann,et al.  Parallel Processing in Neural Systems and Computers , 1990 .

[8]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[9]  D. Field,et al.  What's constant in contrast constancy? The effects of scaling on the perceived contrast of bandpass patterns , 1995, Vision Research.

[10]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[11]  Leslie S. Smith,et al.  The principal components of natural images , 1992 .

[12]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.