Evolving Concepts of Spatial Channels in Vision: From Independence to Nonlinear Interactions

By the 1960s it was evident from neuroanatomy that there were extensive recurrent interactions, both excitatory and inhibitory, among visual cortical neurons. Nevertheless, the psychophysical discovery of ‘spatial-frequency channels’ gave rise to a decade in which parallel, independent channels were thought to subserve early spatial vision. Recent work, however, has clearly demonstrated that early visual channels do not perform a Fourier or wavelet decomposition of the image. Instead, they interact through a variety of nonlinear pooling mechanisms. Such nonlinear interactions perform important computations in texture perception, stereopsis, and motion and form vision.

[1]  H. Smallman Fine-to-coarse scale disambiguation in stereopsis , 1995, Vision Research.

[2]  R. Sekuler,et al.  Mutual repulsion between moving visual targets. , 1979, Science.

[3]  N. Graham,et al.  Detection of grating patterns containing two spatial frequencies: a comparison of single-channel and multiple-channels models. , 1971, Vision research.

[4]  U. Polat,et al.  Lateral interactions between spatial channels: Suppression and facilitation revealed by lateral masking experiments , 1993, Vision Research.

[5]  Jeounghoon Kim,et al.  Direction repulsion between components in motion transparency , 1996, Vision Research.

[6]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[7]  L. Glass Moiré Effect from Random Dots , 1969, Nature.

[8]  G Sperling,et al.  Two motion perception mechanisms revealed through distance-driven reversal of apparent motion. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[9]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  L. Finkel,et al.  Characterization of the spatial-frequency spectrum in the perception of shape from texture. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  B Moulden,et al.  A Simultaneous Shift in Apparent Direction: Further Evidence for a “Distribution-Shift” Model of Direction Coding , 1980, The Quarterly journal of experimental psychology.

[12]  P. Cavanagh,et al.  Motion: the long and short of it. , 1989, Spatial vision.

[13]  S. Zucker,et al.  Endstopped neurons in the visual cortex as a substrate for calculating curvature , 1987, Nature.

[14]  H. Wilson,et al.  Concentric orientation summation in human form vision , 1997, Vision Research.

[15]  J A Solomon,et al.  Full-wave and half-wave processes in second-order motion and texture. , 1994, Ciba Foundation symposium.

[16]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  H. Wilson,et al.  Spatial frequency tuning of orientation selective units estimated by oblique masking , 1983, Vision Research.

[18]  H. Wilson,et al.  Neural models of stereoscopic vision , 1991, Trends in Neurosciences.

[19]  C D Salzman,et al.  Neural mechanisms for forming a perceptual decision. , 1994, Science.

[20]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[21]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[22]  Tatjana A. Nazir,et al.  Effects of lateral masking and spatial precueing on gap-resolution in central and peripheral vision , 1992, Vision Research.

[23]  R. Desimone Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.

[24]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[25]  D. Broadbent,et al.  Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency , 1975, Vision Research.

[26]  J. Robson,et al.  Summation of very close spatial frequencies: the importance of spatial probability summation , 1987, Vision Research.

[27]  L A Olzak,et al.  Discrimination of Complex Patterns: Orientation Information is Integrated across Spatial Scale; Spatial-Frequency and Contrast Information are Not , 1997, Perception.

[28]  Wilson PII: S0042-6989(97)00328-3 , 1998 .

[29]  R. Desimone,et al.  Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. , 1987, Journal of neurophysiology.

[30]  J. R. Lee,et al.  How Does the Striate Cortex Begin the Reconstruction of the Visual World? , 1971, Science.

[31]  T. Wiesel,et al.  Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysis , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  Manuel Suero,et al.  Motion of complex patterns is computed from the perceived motions of their components , 1991, Vision Research.

[33]  H R Wilson,et al.  A model for motion coherence and transparency , 1994, Visual Neuroscience.

[34]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[35]  A Pantle,et al.  Size-Detecting Mechanisms in Human Vision , 1968, Science.

[36]  Malcolm P. Young,et al.  Objective analysis of the topological organization of the primate cortical visual system , 1992, Nature.

[37]  R A Andersen,et al.  The response of area MT and V1 neurons to transparent motion , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  H. Wilson,et al.  Spatial frequency adaptation and contrast gain control , 1993, Vision Research.

[39]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[40]  J. Kulikowski,et al.  Spatial arrangement of line, edge and grating detectors revealed by subthreshold summation. , 1973, Vision research.

[41]  B. Julesz,et al.  Extension of Panum's fusional area in binocularly stabilized vision. , 1967, Journal of the Optical Society of America.

[42]  L. Iversen,et al.  Excitatory amino acids in the brain - focus on NMDA receptors , 1987, Trends in Neurosciences.

[43]  B Moulden,et al.  Collator units: second-stage orientational filters. , 1994, Ciba Foundation symposium.

[44]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[45]  H. Wilson,et al.  Lateral interactions in peripherally viewed texture arrays. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[46]  Leslie Welch,et al.  The perception of moving plaids reveals two motion-processing stages , 1989, Nature.

[47]  H R Wilson,et al.  Curvature and separation discrimination at texture boundaries. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[48]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[49]  O Braddick,et al.  Local and Global Representations of Velocity: Transparency, Opponency, and Global Direction Perception , 1997, Perception.

[50]  J. Thomas Model of the function of receptive fields in human vision. , 1970, Psychological review.

[51]  M. Morgan,et al.  Perceived diagonals in grids and lattices , 1989, Vision Research.

[52]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[53]  R. Sekuler,et al.  Hysteresis in the perception of motion direction as evidence for neural cooperativity , 1986, Nature.

[54]  John K. Tsotsos An inhibitory beam for attentional selection , 1994 .

[55]  M J Morgan,et al.  The Combination of Filters in Early Spatial Vision: A Retrospective Analysis of the Mirage Model , 1997, Perception.

[56]  M. Colonnier Synaptic patterns on different cell types in the different laminae of the cat visual cortex. An electron microscope study. , 1968, Brain research.

[57]  H. Bouma,et al.  Eccentric vision: Adverse interactions between line segments , 1976, Vision Research.

[58]  C. Gilbert,et al.  Synaptic physiology of horizontal connections in the cat's visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[59]  N. Graham Visual Pattern Analyzers , 1989 .

[60]  U. Polat,et al.  The architecture of perceptual spatial interactions , 1994, Vision Research.

[61]  D. Marr,et al.  Theory of human stereopsis (A) , 1977 .

[62]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[63]  H. Wilson,et al.  Orientation bandwidths of spatial mechanisms measured by masking. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[64]  R. Pérez,et al.  Perception of Random Dot Interference Patterns , 1973, Nature.

[65]  Michael S. Landy,et al.  Complex Channels, Early Local Nonlinearities, and Normalization in Texture Segregation , 1991 .

[66]  Jan J. Koenderink,et al.  Two-dimensional curvature operators , 1988 .

[67]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[68]  S. Klein,et al.  Evidence against narrow-band spatial frequency channels in human vision: the detectability of frequency modulated gratings , 1975, Vision Research.

[69]  H S Smallman,et al.  Spatial Scale Interactions in Stereo Sensitivity and the Neural Representation of Binocular Disparity , 1997, Perception.

[70]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[71]  J H Maunsell,et al.  The Brain's Visual World: Representation of Visual Targets in Cerebral Cortex , 1995, Science.

[72]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[73]  C. Gross,et al.  Representation of visual stimuli in inferior temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[74]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[75]  J. Bergen,et al.  Computational Modeling of Visual Texture Segregation , 1991 .

[76]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[77]  H. Wilson,et al.  Measurement of the Texture-Coherence Limit for Bandpass Arrays , 1998, Perception.

[78]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[79]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[80]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[81]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[82]  J. Robson,et al.  Spatial-frequency channels in human vision. , 1971, Journal of the Optical Society of America.

[83]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[84]  R. Desimone,et al.  Shape recognition and inferior temporal neurons. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[85]  D. V. van Essen,et al.  Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. , 1993, Science.

[86]  A. Y. Maudarbocus,et al.  Non-linearity of visual signals in relation to shape-sensitive adaptation responses. , 1973, Vision research.

[87]  Jeounghoon Kim,et al.  Dependence of plaid motion coherence on component grating directions , 1993, Vision Research.

[88]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[89]  Parvati Dev,et al.  Perception of Depth Surfaces in Random-Dot Stereograms: A Neural Model , 1975, Int. J. Man Mach. Stud..

[90]  H. Wilson,et al.  Coarse spatial scales constrain the range of binocular fusion on fine scales. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[91]  James T. Todd,et al.  The perception of globally coherent motion , 1992, Vision Research.

[92]  Lynn A. Olzak,et al.  Configural effects constrain fourier models of pattern discrimination , 1992, Vision Research.

[93]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[94]  Lynn A. Olzak,et al.  When orthogonal orientations are not processed independently , 1991, Vision Research.