Multisensory Integration in the Superior Colliculus Requires Synergy among Corticocollicular Inputs

Influences from the visual (AEV), auditory (FAES), and somatosensory (SIV) divisions of the cat anterior ectosylvian sulcus (AES) play a critical role in rendering superior colliculus (SC) neurons capable of multisensory integration. However, it is not known whether this is accomplished via their independent sensory-specific action or via some cross-modal cooperative action that emerges as a consequence of their convergence on SC neurons. Using visual–auditory SC neurons as a model, we examined how selective and combined deactivation of FAES and AEV affected SC multisensory (visual–auditory) and unisensory (visual–visual) integration capabilities. As noted earlier, multisensory integration yielded SC responses that were significantly greater than those evoked by the most effective individual component stimulus. This multisensory “response enhancement” was more evident when the component stimuli were weakly effective. Conversely, unisensory integration was dominated by the lack of response enhancement. During cryogenic deactivation of FAES and/or AEV, the unisensory responses of SC neurons were only modestly affected; however, their multisensory response enhancement showed a significant downward shift and was eliminated. The shift was similar in magnitude for deactivation of either AES subregion and, in general, only marginally greater when both were deactivated simultaneously. These data reveal that SC multisensory integration is dependent on the cooperative action of distinct subsets of unisensory corticofugal afferents, afferents whose sensory combination matches the multisensory profile of their midbrain target neurons, and whose functional synergy is specific to rendering SC neurons capable of synthesizing information from those particular senses.

[1]  B. Stein,et al.  Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. , 1986, Journal of neurophysiology.

[2]  Thomas J. Anastasio,et al.  Using Bayes' Rule to Model Multisensory Enhancement in the Superior Colliculus , 2000, Neural Computation.

[3]  H. Vanegas,et al.  Comparative neurology of the optic tectum , 1984 .

[4]  Wan Jiang,et al.  Multisensory orientation behavior is disrupted by neonatal cortical ablation. , 2007, Journal of neurophysiology.

[5]  M. T. Wallace,et al.  Visual, auditory and somatosensory convergence in output neurons of the cat superior colliculus: multisensory properties of the tecto-reticulo-spinal projection , 2005, Experimental Brain Research.

[6]  Kota Takahashi,et al.  Integration of Visual and Auditory Information , 1990 .

[7]  R. Guillery,et al.  Thalamic Relay Functions and Their Role in Corticocortical Communication Generalizations from the Visual System , 2002, Neuron.

[8]  Terrence R Stanford,et al.  Cortex Mediates Multisensory But Not Unisensory Integration in Superior Colliculus , 2007, The Journal of Neuroscience.

[9]  B E Stein,et al.  Two visual corticotectal systems in cat. , 1984, Journal of neurophysiology.

[10]  B. Motter Neural correlates of attentive selection for color or luminance in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Terrence R Stanford,et al.  A Model of the Neural Mechanisms Underlying Multisensory Integration in the Superior Colliculus , 2007, Perception.

[12]  R W Guillery,et al.  The role of the thalamus in the flow of information to the cortex. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[13]  J. K. Harting,et al.  Cortical somatosensory and trigeminal inputs to the cat superior colliculus: Light and electron microscopic analyses , 1997, The Journal of comparative neurology.

[14]  M. Wallace,et al.  Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. , 1993, Journal of neurophysiology.

[15]  B. Stein,et al.  Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  M T Wallace,et al.  Mechanisms of within- and cross-modality suppression in the superior colliculus. , 1997, Journal of neurophysiology.

[17]  B. Stein,et al.  Sources of subcortical projections to the superior colliculus in the cat , 1979, The Journal of comparative neurology.

[18]  B. Stein,et al.  A chronic headholder minimizing facial obstructions , 1983, Brain Research Bulletin.

[19]  H. R. Clemo,et al.  Organization of a fourth somatosensory area of cortex in cat. , 1983, Journal of neurophysiology.

[20]  Lawrence G. McDade,et al.  Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli , 1989, Journal of Cognitive Neuroscience.

[21]  D. Irvine,et al.  Auditory response properties of neurons in the anterior ectosylvian sulcus of the cat , 1986, Brain Research.

[22]  T. Stanford,et al.  Evaluating the Operations Underlying Multisensory Integration in the Cat Superior Colliculus , 2005, The Journal of Neuroscience.

[23]  M. Wallace,et al.  Multisensory integration in the superior colliculus of the alert cat. , 1998, Journal of neurophysiology.

[24]  R. Guillery,et al.  On the actions that one nerve cell can have on another: distinguishing "drivers" from "modulators". , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Sidney S. Simon,et al.  Merging of the Senses , 2008, Front. Neurosci..

[26]  J. K. Harting,et al.  The Mammalian Superior Colliculus: Studies of Its Morphology and Connections , 1984 .

[27]  M. Wallace,et al.  Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli. , 2005, Journal of neurophysiology.

[28]  C. Olson,et al.  Ectosylvian visual area of the cat: Location, retinotopic organization, and connections , 1987, The Journal of comparative neurology.

[29]  B. Stein,et al.  Efferent projections of the neonatal superior colliculus: Extraoculomotor-related brain stem structures , 1982, Brain Research.

[30]  M. Wallace,et al.  Superior colliculus lesions preferentially disrupt multisensory orientation , 2004, Neuroscience.

[31]  David R. Wozny,et al.  Human trimodal perception follows optimal statistical inference. , 2008, Journal of vision.

[32]  M. Alex Meredith,et al.  Neurons and behavior: the same rules of multisensory integration apply , 1988, Brain Research.

[33]  Franco Lepore,et al.  Sensory modality distribution in the anterior ectosylvian cortex (AEC) of cats , 2004, Experimental Brain Research.

[34]  M T Wallace,et al.  Cross-modal synthesis in the midbrain depends on input from cortex. , 1994, Journal of neurophysiology.

[35]  Mauro Ursino,et al.  Multisensory integration in the superior colliculus: a neural network model , 2009, Journal of Computational Neuroscience.

[36]  Jean-Pierre Bresciani,et al.  Vision and touch are automatically integrated for the perception of sequences of events. , 2006, Journal of vision.

[37]  Barry E. Stein,et al.  The development of a dialogue between cortex and midbrain to integrate multisensory information , 2005, Experimental Brain Research.

[38]  Barry E Stein,et al.  Neuron-specific response characteristics predict the magnitude of multisensory integration. , 2003, Journal of neurophysiology.

[39]  C. K. Peck,et al.  Visual-auditory integration in cat superior colliculus: implications for neuronal control of the orienting response. , 1996, Progress in brain research.

[40]  Thomas J. Anastasio,et al.  Modeling Cross-Modal Enhancement and Modality-Specific Suppression in Multisensory Neurons , 2003, Neural Computation.

[41]  H. R. Clemo,et al.  Somatosensory cortex: a ‘new’ somatotopic representation , 1982, Brain Research.

[42]  B E Stein,et al.  Effects of cooling somatosensory cortex on response properties of tactile cells in the superior colliculus. , 1986, Journal of neurophysiology.

[43]  S. Sherman The thalamus is more than just a relay , 2007, Current Opinion in Neurobiology.

[44]  B. Stein Neural mechanisms for synthesizing sensory information and producing adaptive behaviors , 1998, Experimental Brain Research.

[45]  B E Stein,et al.  Corticotectal and corticothalamic efferent projections of SIV somatosensory cortex in cat. , 1983, Journal of neurophysiology.

[46]  Alexandre Pouget,et al.  Bayesian multisensory integration and cross-modal spatial links , 2004, Journal of Physiology-Paris.

[47]  B. Stein,et al.  Two Corticotectal Areas Facilitate Multisensory Orientation Behavior , 2002, Journal of Cognitive Neuroscience.

[48]  Wan Jiang,et al.  Cortex controls multisensory depression in superior colliculus. , 2003, Journal of neurophysiology.

[49]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[50]  L. Mucke,et al.  Physiologic and anatomic investigation of a visual cortical area situated in the ventral bank of the anterior ectosylvian sulcus of the cat , 2004, Experimental Brain Research.

[51]  T. Stanford,et al.  A neural network model of multisensory integration also accounts for unisensory integration in superior colliculus , 2008, Brain Research.

[52]  Kamel Belkacem-Boussaid,et al.  Multimodality in the superior colliculus: an information theoretic analysis. , 2002, Brain research. Cognitive brain research.

[53]  W. Jiang,et al.  Two cortical areas mediate multisensory integration in superior colliculus neurons. , 2001, Journal of neurophysiology.

[54]  G. DeAngelis,et al.  Multisensory Integration in Macaque Visual Cortex Depends on Cue Reliability , 2008, Neuron.

[55]  A. J. King,et al.  Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus , 2004, Experimental Brain Research.

[56]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[57]  H. R. Clemo,et al.  Auditory cortical projection from the anterior ectosylvian sulcus (Field AES) to the superior colliculus in the cat: an anatomical and electrophysiological study. , 1989, The Journal of comparative neurology.

[58]  B. Stein,et al.  Spatial factors determine the activity of multisensory neurons in cat superior colliculus , 1986, Brain Research.

[59]  Mark T. Wallace,et al.  Excitotoxic lesions of the superior colliculus preferentially impact multisensory neurons and multisensory integration , 2007, Experimental Brain Research.

[60]  James M. Sprague,et al.  Chapter 1 Neural mechanisms of visual orienting responses , 1996 .

[61]  B. Stein,et al.  Corticothalamic and corticotectal somatosensory projections from the anterior ectosylvian sulcus (SIV cortex) in neonatal cats: An anatomical demonstration with HRP and 3H‐leucine , 1988, The Journal of comparative neurology.

[62]  Stéphane Rainville,et al.  Motion grouping/segmentation via velocity gradients , 2010 .

[63]  O D Creutzfeldt,et al.  Anterior ectosylvian visual area (AEV) of the cat: physiological properties. , 1988, Progress in brain research.

[64]  M T Wallace,et al.  Comparisons of cross-modality integration in midbrain and cortex. , 1996, Progress in brain research.

[65]  Barry Stein,et al.  A Bayesian model unifies multisensory spatial localization with the physiological properties of the superior colliculus , 2007, Experimental Brain Research.

[66]  B. Stein,et al.  The role of anterior ectosylvian cortex in cross-modality orientation and approach behavior , 1996, Experimental Brain Research.