Impact of the spatial congruence of redundant targets on within-modal and cross-modal integration

Although the topic of sensory integration has raised increasing interest, the differing behavioral outcome of combining unisensory versus multisensory inputs has surprisingly only been scarcely investigated. In the present experiment, observers were required to respond as fast as possible to (1) lateralized visual or tactile targets presented alone, (2) double stimulation within the same modality or (3) double stimulation across modalities. Each combination was either delivered within the same hemispace (spatially aligned) or in different hemispaces (spatially misaligned). Results show that the redundancy gains (RG) obtained from the cross-modal conditions were far greater than those obtained from combinations of two visual or two tactile targets. Consistently, we observed that the reaction time distributions of cross-modal targets, but not those of within-modal targets, surpass the predicted reaction time distribution based on the summed probability distributions of each constituent stimulus presented alone. Moreover, we found that the spatial alignment of the targets did not influence the RG obtained in cross-modal conditions, whereas within-modal stimuli produced a greater RG when the targets where delivered in separate hemispaces. These results suggest that within-modal and cross-modal integration are not only distinguishable by the amount of facilitation they produce, but also by the spatial configuration under which this facilitation occurs. Our study strongly supports the notion that estimates of the same event that are more independent produce enhanced integrative gains.

[1]  Micah M. Murray,et al.  Early, Low-Level Auditory-Somatosensory Multisensory Interactions Impact Reaction Time Speed , 2009, Front. Integr. Neurosci..

[2]  Bernard W. Balleine,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience , 2022 .

[3]  T. Stanford,et al.  The neural basis of multisensory integration in the midbrain: Its organization and maturation , 2009, Hearing Research.

[4]  Rolf Ulrich,et al.  Fusion prevents the redundant signals effect: evidence from stereoscopically presented stimuli. , 2011, Journal of experimental psychology. Human perception and performance.

[5]  Ana Tajadura-Jiménez,et al.  Auditory–somatosensory multisensory interactions are spatially modulated by stimulated body surface and acoustic spectra , 2009, Neuropsychologia.

[6]  M. Wallace,et al.  Enhanced multisensory integration in older adults , 2006, Neurobiology of Aging.

[7]  Bettina Forster,et al.  An ERP Investigation on Visuotactile Interactions in Peripersonal and Extrapersonal Space: Evidence for the Spatial Rule , 2009, Journal of Cognitive Neuroscience.

[8]  A. Opstal,et al.  Stimulus intensity modifies saccadic reaction time and visual response latency in the superior colliculus , 2006, Experimental Brain Research.

[9]  Miriam Reiner,et al.  Multisensory enhancement: gains in choice and in simple response times , 2008, Experimental Brain Research.

[10]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[11]  Jan Theeuwes,et al.  Early multisensory interactions affect the competition among multiple visual objects , 2011, NeuroImage.

[12]  Cristiana Cavina-Pratesi,et al.  Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time , 2002, Experimental Brain Research.

[13]  Franco Lepore,et al.  Multisensory gain within and across hemispaces in simple and choice reaction time paradigms , 2011, Experimental Brain Research.

[14]  P. Haggard,et al.  The brain’s fingers and hands , 2006, Experimental Brain Research.

[15]  Jon Driver,et al.  Covert Spatial Orienting in Audition: Exogenous and Endogenous Mechanisms , 1994 .

[16]  D. Senkowski,et al.  The multifaceted interplay between attention and multisensory integration , 2010, Trends in Cognitive Sciences.

[17]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[18]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[19]  B. Stein,et al.  The Merging of the Senses , 1993 .

[20]  M. Girelli,et al.  Neural Site of the Redundant Target Effect: Electrophysiological Evidence , 1998, Journal of Cognitive Neuroscience.

[21]  Micah M. Murray,et al.  Auditory–somatosensory multisensory interactions in front and rear space , 2007, Neuropsychologia.

[22]  C. K. Peck,et al.  Spatial disparity affects visual-auditory interactions in human sensorimotor processing , 1998, Experimental Brain Research.

[23]  J C Craig,et al.  Tactile attention and the perception of moving tactile stimuli , 1991, Perception & psychophysics.

[24]  Silvia Savazzi,et al.  Speeding Up Reaction Time with Invisible Stimuli , 2002, Current Biology.

[25]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[26]  Brigitte Röder,et al.  Multisensory processing in the redundant-target effect: A behavioral and event-related potential study , 2005, Perception & psychophysics.

[27]  N. Bolognini,et al.  Visual localization of sounds , 2005, Neuropsychologia.

[28]  C. Bonnet,et al.  Reaction time and visual area : searching for the determinants , 1992 .

[29]  Rolf Ulrich,et al.  Effects of redundant auditory stimuli on reaction time , 2007, Psychonomic bulletin & review.

[30]  J. Craig,et al.  Temporal order and tactile patterns , 1990, Perception & psychophysics.

[31]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[32]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[33]  I. Bernstein,et al.  Intersensory versus intrasensory contingent information processing. , 1972, Journal of experimental psychology.

[34]  Micah M. Murray,et al.  The Behavioral Relevance of Multisensory Neural Response Interactions , 2009, Frontiers in neuroscience.

[35]  D. Raab Statistical facilitation of simple reaction times. , 1962, Transactions of the New York Academy of Sciences.

[36]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[37]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[38]  John J. Foxe,et al.  Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: a high-density electrical mapping study , 2001, Neuropsychologia.

[39]  Hans Colonius,et al.  Visual-tactile spatial interaction in saccade generation , 2003, Experimental Brain Research.

[40]  Jeff Miller,et al.  Sensory and motor involvement in the enhanced redundant target effect: A study comparing anterior- and totally split-brain individuals , 2009, Neuropsychologia.

[41]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[42]  Steven A. Hillyard,et al.  Effects of Spatial Congruity on Audio-Visual Multimodal Integration , 2005, Journal of Cognitive Neuroscience.

[43]  John J. Foxe,et al.  Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. , 2000, Brain research. Cognitive brain research.

[44]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[45]  Charles Spence,et al.  Audiotactile interactions in near and far space , 2005, Experimental Brain Research.

[46]  D. Raab DIVISION OF PSYCHOLOGY: STATISTICAL FACILITATION OF SIMPLE REACTION TIMES* , 1962 .

[47]  B. Stein,et al.  Spatial factors determine the activity of multisensory neurons in cat superior colliculus , 1986, Brain Research.

[48]  Paul M. Corballis,et al.  Paradoxical Interhemispheric Summation in the Split Brain , 2002, Journal of Cognitive Neuroscience.

[49]  A. M. Dale,et al.  BORDERS OF MULTIPLE VISUAL AREAS IN HUMANS REVEALED BY FUNCTIONAL MRI , 1995 .

[50]  Benjamin A. Rowland,et al.  An Emergent Model of Multisensory Integration in Superior Colliculus Neurons , 2010, Front. Integr. Neurosci..

[51]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[52]  R. Schmidt,et al.  On the nature of intersensory facilitation of reaction time , 1983, Perception & psychophysics.

[53]  A. Diederich,et al.  The race model inequality: interpreting a geometric measure of the amount of violation. , 2006, Psychological review.

[54]  Luigi Tamè,et al.  Spatial coding of touch at the fingers: Insights from double simultaneous stimulation within and between hands , 2011, Neuroscience Letters.

[55]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[56]  Rolf Ulrich,et al.  Testing the race model inequality: An algorithm and computer programs , 2007, Behavior research methods.

[57]  G. Geffen,et al.  Hemispheric equivalence for simultaneity judgements of somatosensory stimuli , 1990 .

[58]  Charles Spence,et al.  Audiotactile multisensory interactions in human information processing , 2006 .

[59]  N. Bolognini,et al.  Enhancement of visual perception by crossmodal visuo-auditory interaction , 2002, Experimental Brain Research.

[60]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[61]  A. Diederich,et al.  Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model , 2004, Journal of Cognitive Neuroscience.

[62]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[63]  J. Todd,et al.  Reaction To Multiple Stimuli... , 2012 .

[64]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Covert Expectation-of-reward in Rat Ventral Striatum at Decision Points , 2022 .

[65]  C. Marzi,et al.  Does the redundant signal effect occur at an early visual stage? , 2007, Experimental Brain Research.

[66]  P. Reuter-Lorenz,et al.  Visual-auditory interactions in sensorimotor processing: saccades versus manual responses. , 1994, Journal of experimental psychology. Human perception and performance.

[67]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[68]  Benjamin A Rowland,et al.  The Differing Impact of Multisensory and Unisensory Integration on Behavior , 2009, The Journal of Neuroscience.

[69]  W. Jiang,et al.  Two cortical areas mediate multisensory integration in superior colliculus neurons. , 2001, Journal of neurophysiology.

[70]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[71]  J C Craig,et al.  Attending to two fingers: Two hands are better than one , 1985, Perception & psychophysics.

[72]  John J. Foxe,et al.  Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. , 2005, Cerebral cortex.

[73]  S Yantis,et al.  Dividing attention between color and shape: Evidence of coactivation , 1993, Perception & psychophysics.