Spatial Scale Interactions and Image Statistics

In natural scenes and other broadband images, spatial variations in luminance occur at a range of scales or frequencies. It is generally agreed that the visual image is initially represented by the activity of separate frequency-tuned channels, and this notion is supported by physiological evidence for a stage of multi-resolution filtering in early visual processing. The question whether these channels can be accessed as independent sources of information in the normal course of events is a more contentious one. In the psychophysical study of both motion and spatial vision, there are examples of tasks in which fine-scale structure dominates perception or performance and obscures information at coarser scales. It is argued here that one important factor determining the relative salience of information from different spatial scales in broadband images is the distribution of response activity across spatial channels. The special case of natural scenes that have characteristic ‘scale-invariant’ power spectra in which image contrast is roughly constant in equal octave frequency bands is considered. A review is presented of evidence which suggests that the sensitivity of frequency-tuned filters in the visual system is matched to this image statistic, so that, on average, different channels respond with equal activity to natural scenes. Under these conditions, the visual system does appear to have independent access to information at different spatial scales and spatial scale interactions are not apparent.

[1]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[2]  T. A. Reichert,et al.  The absence of a measurable “critical band” at low suprathreshold contrasts , 1976, Vision Research.

[3]  C. Baker,et al.  Spatial receptive-field properties of direction-selective neurons in cat striate cortex. , 1986, Journal of neurophysiology.

[4]  H S Smallman,et al.  Fine grain of the neural representation of human spatial vision , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  J. Kulikowski,et al.  Effective contrast constancy and linearity of contrast sensation , 1976, Vision Research.

[6]  R. Snowden,et al.  Spatial frequency adaptation: Threshold elevation and perceived contrast , 1996, Vision Research.

[7]  G. J. Burton,et al.  Evidence for non-linear response processes in the human visual system from measurements on the thresholds of spatial beat frequencies. , 1973, Vision research.

[8]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[9]  L. Croner,et al.  Receptive fields of P and M ganglion cells across the primate retina , 1995, Vision Research.

[10]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[11]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[13]  D. Tolhurst,et al.  On the variety of spatial frequency selectivities shown by neurons in area 17 of the cat , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  N. Graham,et al.  Detection of grating patterns containing two spatial frequencies: a comparison of single-channel and multiple-channels models. , 1971, Vision research.

[15]  David C. Burr,et al.  Added noise restores recognizability of coarse quantized images , 1983, Nature.

[16]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[17]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[18]  B. Julesz,et al.  Displacement limits for spatial frequency filtered random-dot cinematograms in apparent motion , 1983, Vision Research.

[19]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[20]  B Julesz,et al.  Masking in Visual Recognition: Effects of Two-Dimensional Filtered Noise , 1973, Science.

[21]  Peter J. Bex,et al.  Independent coding across spatial scales in moving fractal images , 1997, Vision Research.

[22]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[23]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[24]  D. Field,et al.  Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes , 1997, Vision Research.

[25]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[26]  A B Watson,et al.  Transfer of contrast sensitivity in linear visual networks , 1992, Visual Neuroscience.

[27]  C L Baker,et al.  A processing stream in mammalian visual cortex neurons for non-Fourier responses. , 1993, Science.

[28]  M. Georgeson,et al.  Contrast constancy: deblurring in human vision by spatial frequency channels. , 1975, The Journal of physiology.

[29]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[30]  D. Burr,et al.  Spatial and temporal selectivity of the human motion detection system , 1985, Vision Research.

[31]  Peter J. Bex,et al.  Energetic motion detection , 1995, Nature.

[32]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[33]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[34]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[35]  Janette Atkinson,et al.  Channels in Vision: Basic Aspects , 1978 .

[36]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[37]  V. Lollo,et al.  Perception of directional sampled motion in relation to displacement and spatial frequency: Evidence for a unitary motion system , 1990, Vision Research.

[38]  O. Braddick,et al.  Masking of low frequency information in short-range apparent motion , 1990, Vision Research.

[39]  J. Robson,et al.  Spatial-frequency channels in human vision. , 1971, Journal of the Optical Society of America.

[40]  D. Field,et al.  What's constant in contrast constancy? The effects of scaling on the perceived contrast of bandpass patterns , 1995, Vision Research.

[41]  M. J. Morgan,et al.  Mostion discrimination in two-frame sequences with differing spatial frequency content , 1994, Vision Research.

[42]  D. Broadbent,et al.  Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency , 1975, Vision Research.

[43]  M. J. Morgan,et al.  Spatial filtering precedes motion detection , 1992, Nature.

[44]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[45]  M. Morrone,et al.  Vision: Feature detection in biological and artificial visual systems , 1990 .

[46]  Richard A Eagle,et al.  What determines the maximum displacement limit for spatially broadband kinematograms , 1996 .