Multisensory gain within and across hemispaces in simple and choice reaction time paradigms

Recent results on the nature and limits of multisensory enhancement are inconsistent when stimuli are presented across spatial regions. We presented visual, tactile and visuotactile stimuli to participants in two speeded response tasks. Each unisensory stimulus was presented to either the left or right hemispace, and multisensory stimuli were presented as either aligned (e.g. visual right/tactile right) or misaligned (e.g. visual right/tactile left). The first task was a simple reaction time (SRT) paradigm where participants responded to all stimulations irrespective of spatial position. Results showed that multisensory gain and coactivation were the same for spatially aligned and misaligned visuotactile stimulation. In the second task, a choice reaction time (CRT) paradigm where participants responded to right-sided stimuli only, misaligned stimuli yielded slower reaction times. No difference in multisensory gain was found between the SRT and CRT tasks for aligned stimulation. Overall, the results suggest that when spatial information is task-irrelevant, multisensory integration of spatially aligned and misaligned stimuli is equivalent. However, manipulating task requirements can alter this effect.

[1]  B. Stein,et al.  The Merging of the Senses , 1993 .

[2]  Bettina Forster,et al.  An ERP Investigation on Visuotactile Interactions in Peripersonal and Extrapersonal Space: Evidence for the Spatial Rule , 2009, Journal of Cognitive Neuroscience.

[3]  Sensation and Sensory Processing , 2001 .

[4]  J. Todd,et al.  Reaction To Multiple Stimuli... , 2012 .

[5]  Emiliano Macaluso,et al.  Multisensory stimulation with or without saccades: fMRI evidence for crossmodal effects on sensory-specific cortices that reflect multisensory location-congruence rather than task-relevance , 2005, NeuroImage.

[6]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Covert Expectation-of-reward in Rat Ventral Striatum at Decision Points , 2022 .

[7]  Charles Spence,et al.  Audiotactile interactions in near and far space , 2005, Experimental Brain Research.

[8]  Micah M. Murray,et al.  The Behavioral Relevance of Multisensory Neural Response Interactions , 2009, Frontiers in neuroscience.

[9]  F. Colavita.  Human sensory dominance , 1974 .

[10]  C. Schroeder,et al.  Somatosensory input to auditory association cortex in the macaque monkey. , 2001, Journal of neurophysiology.

[11]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[12]  Ana Tajadura-Jiménez,et al.  Auditory–somatosensory multisensory interactions are spatially modulated by stimulated body surface and acoustic spectra , 2009, Neuropsychologia.

[13]  Cristiana Cavina-Pratesi,et al.  Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time , 2002, Experimental Brain Research.

[14]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[15]  Charles Spence,et al.  Audiotactile multisensory interactions in human information processing , 2006 .

[16]  Jean-Philippe Thiran,et al.  Multisensory interactions within human primary cortices revealed by BOLD dynamics. , 2007, Cerebral cortex.

[17]  Micah M. Murray,et al.  Early, Low-Level Auditory-Somatosensory Multisensory Interactions Impact Reaction Time Speed , 2009, Front. Integr. Neurosci..

[18]  Miriam Reiner,et al.  Multisensory enhancement: gains in choice and in simple response times , 2008, Experimental Brain Research.

[19]  B. Stein.  Neural mechanisms for synthesizing sensory information and producing adaptive behaviors , 1998, Experimental Brain Research.

[20]  John J. Foxe,et al.  Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: a high-density electrical mapping study , 2001, Neuropsychologia.

[21]  A. M. Dale,et al.  BORDERS OF MULTIPLE VISUAL AREAS IN HUMANS REVEALED BY FUNCTIONAL MRI , 1995 .

[22]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[23]  Micah M. Murray,et al.  Auditory–somatosensory multisensory interactions in front and rear space , 2007, Neuropsychologia.

[24]  Rolf Ulrich,et al.  Testing the race model inequality: An algorithm and computer programs , 2007, Behavior research methods.

[25]  M. Reiner,et al.  Sensory dominance in combinations of audio, visual and haptic stimuli , 2009, Experimental Brain Research.

[26]  E. Macaluso,et al.  Processing of multisensory spatial congruency can be dissociated from working memory and visuo‐spatial attention , 2007, The European journal of neuroscience.

[27]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[28]  C. Spence,et al.  Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision , 1998, Perception & psychophysics.

[29]  John J. Foxe,et al.  The case for feedforward multisensory convergence during early cortical processing , 2005, Neuroreport.

[30]  D. Raab.  Statistical facilitation of simple reaction times. , 1962, Transactions of the New York Academy of Sciences.

[31]  John J. Foxe,et al.  The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. , 2002, Brain research. Cognitive brain research.

[32]  Kathleen S. Rockland.  Connectional neuroanatomy: the changing scene , 2004, Brain Research.

[33]  C. K. Peck,et al.  Spatial disparity affects visual-auditory interactions in human sensorimotor processing , 1998, Experimental Brain Research.

[34]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[35]  D. Raab.  DIVISION OF PSYCHOLOGY: STATISTICAL FACILITATION OF SIMPLE REACTION TIMES* , 1962 .

[36]  John J. Foxe,et al.  Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. , 2005, Cerebral cortex.

[37]  Steven A. Hillyard,et al.  Effects of Spatial Congruity on Audio-Visual Multimodal Integration , 2005, Journal of Cognitive Neuroscience.

[38]  B. Stein,et al.  Spatial factors determine the activity of multisensory neurons in cat superior colliculus , 1986, Brain Research.

[39]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[40]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[41]  C. Spence,et al.  Spatial constraints on visual-tactile cross-modal distractor congruency effects , 2004, Cognitive, affective & behavioral neuroscience.

[42]  Hans Colonius,et al.  Visual-tactile spatial interaction in saccade generation , 2003, Experimental Brain Research.

[43]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[44]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[45]  M. Wallace,et al.  Early experience determines how the senses will interact. , 2007, Journal of neurophysiology.

[46]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.