Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons.

We perceive the visual world as a unitary whole, yet one of the guiding principles of nearly a half century of neurophysiological research since the early recordings by Hartline (1938) has been that the visual system consists of neurons that are driven by stimulation within small discrete portions of the total visual field. These classical receptive fields (CRFs) have been mapped with the excitatory responses evoked by a flashed or moving stimulus, usually a spot or bar of light. Most of the visual neurons, in turn, are organized in a series of maps of the visual field, at least 10 of which exist in the visual cortex in primates as well as additional topographic representations in the lateral geniculate body, pulvinar and optic tectum (Allman 1977, Newsome & Allman 1980, Allman & Kaas 1984). It has been widely assumed that perceptual functions that require the integration of inputs over large portions of the visual field must be either collective properties of arrays of neurons representing the visual field, or features of those neurons at the highest processing levels in the visual system, such as the cells in inferotemporal or posterior parietal cortex that typically possess very large receptive fields and do not appear to be organized in visuotopic maps. These assumptions have been based on the results of the many studies in which receptive fields were mapped with conventional stimuli, presented one at a time, against a featureless background. However, unlike the neurophysiologist's tangent screen, the natural visual scene is rich in features, and there is a growing body of evidence that in many visual neurons stimuli presented outside the CRF strongly and selectively influence neural responses to stimuli presented within the CRF. These results suggest obvious mechanisms for local-global comparisons within visuotopically organized structures. Such broad and specific surround mechanisms could participate in many functions that require the integration of inputs over wide regions of the visual space such as the perceptual constancies, the segregation of figure from ground, and depth perception through motion parallax. In the first section of this paper, we trace the historical development of the evidence of response selectivity for visual stimuli presented beyond the CRF; in the second, examine the anatomical pathways that sub serve these far-reaching surround mechanisms; and in the third, explore the possible relationships between these mechanisms and perception.

[1]  H. Barlow Summation and inhibition in the frog's retina , 1953, The Journal of physiology.

[2]  S. W. Kuffler Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[3]  E H Land,et al.  COLOR VISION AND THE NATURAL IMAGE PART II. , 1959, Proceedings of the National Academy of Sciences of the United States of America.

[4]  D. Hubel,et al.  Integrative action in the cat's lateral geniculate body , 1961, The Journal of physiology.

[5]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[6]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[7]  Theodore H. Bullock,et al.  Unit Responses in the Frog's Tectum to Moving and Nonmoving Visual Stimuli , 1963, Science.

[8]  J. Mcilwain RECEPTIVE FIELDS OF OPTIC TRACT AXONS AND LATERAL GENICULATE CELLS: PERIPHERAL EXTENT AND BARBITURATE SENSITIVITY. , 1964, Journal of neurophysiology.

[9]  W. Levick,et al.  EVIDENCE THAT MCILWAIN'S PERIPHERY EFFECT IS NOT A STRAY LIGHT ARTIFACT. , 1965, Journal of neurophysiology.

[10]  D A Gordon,et al.  Static and dynamic visul fields in human space perception. , 1965, Journal of the Optical Society of America.

[11]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[12]  B. Boycott,et al.  Organization of the primate retina: electron microscopy , 1966, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  D. Hubel,et al.  Visual area of the lateral suprasylvian gyrus (Clare—Bishop area) of the cat , 1969, The Journal of physiology.

[14]  P Sterling,et al.  Visual receptive fields in the superior colliculus of the cat. , 1969, Journal of neurophysiology.

[15]  B. H. Jones Responses of single neurons in cat visual cortex to a simple and a more complex stimulus. , 1970, The American journal of physiology.

[16]  W. Levick,et al.  Sustained and transient neurones in the cat's retina and lateral geniculate nucleus , 1971, The Journal of physiology.

[17]  H Ikeda,et al.  Functional organization of the periphery effect in retinal ganglion cells. , 1972, Vision research.

[18]  F S Werblin,et al.  Lateral Interactions at Inner Plexiform Layer of Vertebrate Retina: Antagonistic Responses to Change , 1972, Science.

[19]  J. Kaas,et al.  A representation of the visual field in the inferior nucleus of the pulvinar in the owl monkey (Aotus trivirgatus). , 1972, Brain research.

[20]  C. R. Michael,et al.  Functional organization of cells in superior colliculus of the ground squirrel. , 1972, Journal of neurophysiology.

[21]  W. C. Hall,et al.  Visual cortex of the tree shrew (Tupaia glis): architectonic subdivisions and representations of the visual field. , 1972, Brain research.

[22]  D. Hubel,et al.  Laminar and columnar distribution of geniculo‐cortical fibers in the macaque monkey , 1972, The Journal of comparative neurology.

[23]  P. O. Bishop,et al.  Receptive fields of simple cells in the cat striate cortex , 1973, The Journal of physiology.

[24]  G Rizzolatti,et al.  Inhibitory effect of remote visual stimuli on visual responses of cat superior colliculus: spatial and temporal factors. , 1974, Journal of neurophysiology.

[25]  K. Nakayama,et al.  Optical Velocity Patterns, Velocity-Sensitive Neurons, and Space Perception: A Hypothesis , 1974, Perception.

[26]  B. Dow Functional classes of cells and their laminar distribution in monkey visual cortex. , 1974, Journal of neurophysiology.

[27]  D. Hubel,et al.  Uniformity of monkey striate cortex: A parallel relationship between field size, scatter, and magnification factor , 1974, The Journal of comparative neurology.

[28]  W. B. Spatz An efferent connection of the solitary cells of Meynert. A study with horseradish peroxidase in the marmoset Callithrix , 1975, Brain Research.

[29]  T. Powell,et al.  The intrinsic, association and commissural connections of area 17 on the visual cortex. , 1975, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[30]  P. D. Spear,et al.  Receptive-field characteristics of single neurons in lateral suprasylvian visual area of the cat. , 1975, Journal of neurophysiology.

[31]  J. Lund,et al.  The origin of efferent pathways from the primary visual cortex, area 17, of the macaque monkey as shown by retrograde transport of horseradish peroxidase , 1975, The Journal of comparative neurology.

[32]  L. Maffei,et al.  The unresponsive regions of visual cortical receptive fields , 1976, Vision Research.

[33]  K. Albus,et al.  Effects of interacting visual patterns on single cell responses in cat's striate cortex , 1977, Vision Research.

[34]  E I Knudsen,et al.  Center-surround organization of auditory receptive fields in the owl. , 1978, Science.

[35]  J. Nelson,et al.  Orientation-selective inhibition from beyond the classic visual receptive field , 1978, Brain Research.

[36]  M. Konishi,et al.  Space and frequency are represented separately in auditory midbrain of the owl. , 1978, Journal of neurophysiology.

[37]  D. Riche,et al.  Some claustro‐cortical connections in the cat and baboon as studied by retrograde horseradish persocidase transport , 1978, The Journal of comparative neurology.

[38]  Ricardo Gattass,et al.  Single unit response types in the pulvinar of the cebus monkey to multisensory stimulation , 1978, Brain Research.

[39]  R. Gattass,et al.  Visual receptive fields of units in the pulvinar of cebus monkey , 1979, Brain Research.

[40]  D. Fitzpatrick,et al.  Layer I of striate cortex of Tupaia glis and Galago senegalensis: Projections from thalamus and claustrum revealed by retrograde transport of horseradish peroxidase , 1979, The Journal of comparative neurology.

[41]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[42]  R. Wurtz,et al.  Vision during saccadic eye movements. III. Visual interactions in monkey superior colliculus. , 1980, Journal of neurophysiology.

[43]  A L Humphrey,et al.  Topographic organization of the orientation column system in the striate cortex of the tree shrew (Tupaia glis). II. Deoxyglucose mapping , 1980, The Journal of comparative neurology.

[44]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[45]  W T Newsome,et al.  Interhemispheric connections of visual cortex in the owl monkey, Aotus trivirgatus, and the bushbaby, Galago senegalensis , 1980, The Journal of comparative neurology.

[46]  V. Montero Patterns of connections from the striate cortex to cortical visual areas in superior temporal sulcus of macaque and middle temporal gyrus of owl monkey , 1980, The Journal of comparative neurology.

[47]  A. L. Humphrey,et al.  Topographic organization of the orientation column system in the striate cortex of the tree shrew (Tupaia glis). I. Microelectrode recording , 1980, The Journal of comparative neurology.

[48]  S. Petersen,et al.  Visual response properties of neurons in four extrastriate visual areas of the owl monkey (Aotus trivirgatus): a quantitative comparison of medial, dorsomedial, dorsolateral, and middle temporal areas. , 1981, Journal of neurophysiology.

[49]  S. Levay,et al.  The visual claustrum of the cat. III. Receptive field properties , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[50]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[51]  D. B. Bender,et al.  Retinotopic organization of macaque pulvinar. , 1981, Journal of neurophysiology.

[52]  D. Mackay,et al.  Modulatory influences of moving textured backgrounds on responsiveness of simple cells in feline striate cortex , 1981, The Journal of physiology.

[53]  S. Levay,et al.  The visual claustrum of the cat. II. The visual field map , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  J W McClurkin,et al.  Modulation of lateral geniculate nucleus cell responsiveness by visual activation of the corticogeniculate pathway , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  G. Mitchison,et al.  Long axons within the striate cortex: their distribution, orientation, and patterns of connection. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[56]  A. L. Humphrey,et al.  Anatomical banding of intrinsic connections in striate cortex of tree shrews (Tupaia glis) , 1982, The Journal of comparative neurology.

[57]  D. B. Bender,et al.  Receptive-field properties of neurons in the macaque inferior pulvinar. , 1982, Journal of neurophysiology.

[58]  D. V. van Essen,et al.  The pattern of interhemispheric connections and its relationship to extrastriate visual areas in the macaque monkey , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[59]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[60]  S. Levay,et al.  Contribution of the cortico-claustral loop to receptive field properties in area 17 of the cat , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[61]  D. Hubel,et al.  Colour-generating interactions across the corpus callosum , 1983, Nature.

[62]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[63]  S. Zeki Colour coding in the cerebral cortex: The reaction of cells in monkey visual cortex to wavelengths and colours , 1983, Neuroscience.

[64]  T. Wiesel,et al.  Clustered intrinsic connections in cat visual cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[65]  J. Kaas,et al.  Retinotopic patterns of connections of area 17 with visual areas V‐II and MT in macaque monkeys , 1983, The Journal of comparative neurology.

[66]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[67]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[68]  K. Nakayama,et al.  Single visual neurons code opposing motion independent of direction. , 1983, Science.

[69]  V. S. Ramachandran,et al.  Perceptual organization in moving patterns , 1983, Nature.

[70]  S. Zeki Colour coding in the cerebral cortex: The responses of wavelength-selective and colour-coded cells in monkey visual cortex to changes in wavelength composition , 1983, Neuroscience.

[71]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[72]  T. Albright Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[73]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[74]  R E Weller,et al.  Cortical connections of the middle temporal visual area (MT) and the superior temporal cortex in owl monkeys , 1984, The Journal of comparative neurology.

[75]  Jan J. Koenderink,et al.  Space, Form and Optical Deformations , 1985 .

[76]  D. Ingle,et al.  Action-Oriented Approaches to Visuo-Spatial Brain Functions , 1985 .