Temporal Profiles of Response Enhancement in Multisensory Integration

Animals have evolved multiple senses that transduce different forms of energy as a way of increasing their sensitivity to environmental events. Each sense provides a unique and independent perspective on the world, and very often a single event stimulates several of them. In order to make best use of the available information, the brain has also evolved the capacity to integrate information across the senses (“multisensory integration”). This facilitates the detection, localization, and identification of a given event, and has obvious survival value for the individual and the species. Multisensory responses in the superior colliculus (SC) evidence shorter latencies and are more robust at their onset. This is the phenomenon of initial response enhancement in multisensory integration, which is believed to represent a real time fusion of information across the senses. The present paper reviews two recent reports describing how the timing and robustness of sensory responses change as a consequence of multisensory integration in the model system of the SC.

[1]  M. Wallace,et al.  Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. , 1993, Journal of neurophysiology.

[2]  A John Van Opstal,et al.  Crossmodal integration in the primate superior colliculus underlying the preparation and initiation of saccadic eye movements. , 2005, Journal of neurophysiology.

[3]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[4]  T. Stanford,et al.  Superadditivity in multisensory integration: putting the computation in context. , 2007, Neuroreport.

[5]  Hisashi Q. Higuchi On the nature of , 1999 .

[6]  E. A. Whitchurch,et al.  Combined auditory and visual stimuli facilitate head saccades in the barn owl (Tyto alba). , 2006, Journal of neurophysiology.

[7]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[8]  T. Stanford,et al.  Evaluating the Operations Underlying Multisensory Integration in the Cat Superior Colliculus , 2005, The Journal of Neuroscience.

[9]  J. Samietz,et al.  Interaction of vibrational and visual cues in parasitoid host location , 2001, Journal of Comparative Physiology A.

[10]  T. Stanford,et al.  Multisensory Integration Shortens Physiological Response Latencies , 2007, The Journal of Neuroscience.

[11]  B E Stein,et al.  Unimodal and multimodal response properties of neurons in the cat's superior colliculus. , 1972, Experimental neurology.

[12]  W. Jiang,et al.  Two cortical areas mediate multisensory integration in superior colliculus neurons. , 2001, Journal of neurophysiology.

[13]  Sidney S. Simon,et al.  Merging of the Senses , 2008, Front. Neurosci..

[14]  B. Stein,et al.  Multisensory Integration Produces an Initial Response Enhancement , 2007, Frontiers in integrative neuroscience.

[15]  A. J. King,et al.  Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus , 2004, Experimental Brain Research.

[16]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[17]  Terrence R Stanford,et al.  A Model of the Neural Mechanisms Underlying Multisensory Integration in the Superior Colliculus , 2007, Perception.

[18]  Michael C. Dorris,et al.  Combined eye-head gaze shifts to visual and auditory targets in humans , 1996, Experimental Brain Research.

[19]  Barry E Stein,et al.  Neuron-specific response characteristics predict the magnitude of multisensory integration. , 2003, Journal of neurophysiology.

[20]  B E Stein,et al.  Reptiles and mammals use similar sensory organizations in the midbrain. , 1979, Science.

[21]  B. Stein,et al.  Topographic organization of somatosensory corticotectal influences in cat. , 1984, Journal of neurophysiology.

[22]  Thomas J. Anastasio,et al.  Using Bayes' Rule to Model Multisensory Enhancement in the Superior Colliculus , 2000, Neural Computation.

[23]  K. Saberi,et al.  Auditory psychomotor coordination and visual search performance , 1990, Perception & psychophysics.

[24]  I. Nelken,et al.  Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex , 2006, Cerebral cortex.

[25]  P. Reuter-Lorenz,et al.  Visual-auditory interactions in sensorimotor processing: saccades versus manual responses. , 1994, Journal of experimental psychology. Human perception and performance.

[26]  Idan Segev,et al.  Methods in Neuronal Modeling , 1988 .

[27]  C. Rowe Receiver psychology and the evolution of multicomponent signals , 1999, Animal Behaviour.

[28]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[29]  L. Morrell,et al.  Intersensory facilitation of reaction time , 1967 .

[30]  M. Wallace,et al.  Representation and integration of multiple sensory inputs in primate superior colliculus. , 1996, Journal of neurophysiology.

[31]  Barry Stein,et al.  A Bayesian model unifies multisensory spatial localization with the physiological properties of the superior colliculus , 2007, Experimental Brain Research.

[32]  J. Allum,et al.  Visual-vestibular interactions in the vestibular nuclei of the goldfish , 1976, Experimental Brain Research.

[33]  M T Wallace,et al.  Cross-modal synthesis in the midbrain depends on input from cortex. , 1994, Journal of neurophysiology.

[34]  M. Frens,et al.  Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements , 1995, Perception & psychophysics.

[35]  B. Stein,et al.  Two Corticotectal Areas Facilitate Multisensory Orientation Behavior , 2002, Journal of Cognitive Neuroscience.

[36]  B E Stein,et al.  Relationship between visual and tactile representations in cat superior colliculus. , 1976, Journal of neurophysiology.

[37]  T. Ono,et al.  Auditory thalamus integrates visual inputs into behavioral gains , 2005, Nature Neuroscience.