Comparisons of cross-modality integration in midbrain and cortex.

Multisensory neurons are abundant in the superior colliculus and anterior ectosylvian cortex of the cat. Despite the fact that these areas receive inputs from different regions, and are likely to be involved in different functional roles, there multisensory neurons have many fundamental similarities. They all have multiple receptive fields, one for each sensory input, and these receptive fields overlap one another. It is this spatial correspondence among receptive fields that determines the manner in which both populations of neurons integrate the inputs they receive from different sensory channels. Several principles of integration characterize both cortical and midbrain multisensory neurons, and these constancies in the fundamentals of cross-modality integration are likely to provide a basis for coherence at different levels of the neuraxis. Yet there are also obvious differences in these populations of multisensory neurons. Cortical receptive fields are significantly larger than those in the midbrain, have a lower incidence of suppressive surrounds, and exhibit less cross-modality inhibitory interactions than in the midbrain. Presumably, these differences reflect a greater emphasis on non-spatial aspects of cross-modality integration in cortex than is required by the orientation and localization functions mediated by the superior colliculus.

[1]  Peter H. Hartline The Optic Tectum of Reptiles: Neurophysiological Studies , 1984 .

[2]  David L. Sparks,et al.  Sensori-motor integration in the primate superior colliculus , 1991 .

[3]  B E Stein,et al.  Relationship between visual and tactile representations in cat superior colliculus. , 1976, Journal of neurophysiology.

[4]  D. Sparks,et al.  Sensorimotor integration in the primate superior colliculus. I. Motor convergence. , 1987, Journal of neurophysiology.

[5]  B. Stein,et al.  Spatial factors determine the activity of multisensory neurons in cat superior colliculus , 1986, Brain Research.

[6]  M. Posner,et al.  Visual dominance: an information-processing account of its origins and significance. , 1976, Psychological review.

[7]  J. Bench The Auditory Response , 1978 .

[8]  M. Wallace,et al.  Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. , 1993, Journal of neurophysiology.

[9]  P. Bertelson,et al.  Cross-modal bias and perceptual fusion with auditory-visual spatial discordance , 1981, Perception & psychophysics.

[10]  M. Wallace,et al.  Representation and integration of multiple sensory inputs in primate superior colliculus. , 1996, Journal of neurophysiology.

[11]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[12]  H. R. Clemo,et al.  Organization of a fourth somatosensory area of cortex in cat. , 1983, Journal of neurophysiology.

[13]  C. Olson,et al.  Ectosylvian visual area of the cat: Location, retinotopic organization, and connections , 1987, The Journal of comparative neurology.

[14]  J. Rauschecker,et al.  Auditory compensation for early blindness in cat cerebral cortex , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  D. Raab DIVISION OF PSYCHOLOGY: STATISTICAL FACILITATION OF SIMPLE REACTION TIMES* , 1962 .

[16]  Mark T. Wallace,et al.  Chapter 8 The visually responsive neuron and beyond: multisensory integration in cat and monkey , 1993 .

[17]  D. Raab Statistical facilitation of simple reaction times. , 1962, Transactions of the New York Academy of Sciences.

[18]  K. Saberi,et al.  Auditory psychomotor coordination and visual search performance , 1990, Perception & psychophysics.

[19]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[20]  H. Vanegas,et al.  Comparative neurology of the optic tectum , 1984 .

[21]  D. Barth,et al.  The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex , 1995, Brain Research.

[22]  Aaron M. King,et al.  The Wellcome Prize Lecture. A map of auditory space in the mammalian brain: neural computation and development , 1993, Experimental physiology.

[23]  P Sterling,et al.  Influence of visual cortex on receptive fields in the superior colliculus of the cat. , 1969, Journal of neurophysiology.

[24]  A. Graybiel Some ascending connections of the pulvinar and nucleus lateralis posterior of the thalamus in the cat. , 1972, Brain research.

[25]  B E Stein,et al.  Superior colliculus: visuotopic-somatotopic overlap. , 1975, Science.

[26]  E. Knudsen Auditory and visual maps of space in the optic tectum of the owl , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  J. Andreassi,et al.  Effects of bisensory stimulation on reaction time and the evoked cortical potential , 1975 .

[28]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[29]  B. Stein,et al.  The Merging of the Senses , 1993 .

[30]  M T Wallace,et al.  The visually responsive neuron and beyond: multisensory integration in cat and monkey. , 1993, Progress in brain research.

[31]  D L Sparks,et al.  Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. , 1987, Journal of neurophysiology.

[32]  L F Dell'Osso,et al.  Audio-ocular response characteristics. , 1978, Sensory processes.

[33]  Lawrence G. McDade,et al.  Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli , 1989, Journal of Cognitive Neuroscience.

[34]  D. Irvine,et al.  Auditory response properties of neurons in the anterior ectosylvian sulcus of the cat , 1986, Brain Research.

[35]  FRANK MORRELL,et al.  Visual System's View of Acoustic Space , 1972, Nature.

[36]  W H WATKINS,et al.  ACOUSTIC FACILITATION OF VISUAL DETECTION. , 1965, Journal of experimental psychology.

[37]  S Fidell,et al.  Sensory function in multimodal signal detection. , 1970, The Journal of the Acoustical Society of America.

[38]  M T Wallace,et al.  Cross-modal synthesis in the midbrain depends on input from cortex. , 1994, Journal of neurophysiology.

[39]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[40]  I H Bernstein,et al.  Effects of an auditory signal on visual reaction time. , 1969, Journal of experimental psychology.

[41]  H. R. Clemo,et al.  Somatosensory cortex: a ‘new’ somatotopic representation , 1982, Brain Research.

[42]  B. Stein,et al.  Enhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis , 1996, Journal of Cognitive Neuroscience.

[43]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[44]  D. Reisberg,et al.  Eye position and the control of auditory attention. , 1981, Journal of experimental psychology. Human perception and performance.

[45]  Jeff Miller,et al.  Timecourse of coactivation in bimodal divided attention , 1986, Perception & psychophysics.

[46]  Eiichi Iwai,et al.  Neuronal activity in visual, auditory and polysensory areas in the monkey temporal cortex during visual fixation task , 1991, Brain Research Bulletin.

[47]  B E Stein,et al.  Corticotectal and corticothalamic efferent projections of SIV somatosensory cortex in cat. , 1983, Journal of neurophysiology.

[48]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[49]  M. Frens,et al.  Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements , 1995, Perception & psychophysics.

[50]  R S Nickerson,et al.  Intersensory facilitation of reaction time: energy summation or preparation enhancement? , 1973, Psychological review.

[51]  Audio-visual integration in the superior colliculus of the awake monkey , 1995 .

[52]  D. Hubel,et al.  Topography of visual and somatosensory projections to mouse superior colliculus. , 1976, Journal of neurophysiology.

[53]  B. Stein,et al.  Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. , 1986, Journal of neurophysiology.

[54]  The cognitive architecture of bimodal event perception: A commentary and addendum to Radeau (1994) , 1994 .

[55]  David L. Sparks,et al.  Erratum: Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[56]  R. Schmidt,et al.  On the nature of intersensory facilitation of reaction time , 1983, Perception & psychophysics.

[57]  B. Stein,et al.  Multimodal Representation in the Superior Colliculus and Optic Tectum , 1984 .

[58]  G. Kovács,et al.  Visual, somatosensory and auditory modality properties along the feline suprageniculate-anterior ectosylvian sulcus/insular pathway. , 1996, Progress in brain research.