Enhancement of response times to bi- and tri-modal sensory stimuli during active movements

Simultaneous activation of two sensory modalities can improve perception and enhance performance. This multi-sensory enhancement had been previously observed only in conditions wherein participants were not performing any movement. Since tactile perception is attenuated during active movements, we investigated whether a bi- and a tri-modal enhancement can occur also when participants are presented with tactile stimuli, while engaged in active movements. Participants held a pen-like stylus and performed bidirectional writing-like movements inside a restricted workspace. During these movements participants were given a uni-modal sensory signal (visual––a thin gray line; auditory––a brief sound; haptic––a mechanical resisting force delivered through the stylus) or a bi- or tri-modal combination of these uni-modal signals, and their task was to respond, by pressing a button on the stylus, as soon as any one of these three stimuli was detected. Results showed that a combination of tri-modal signals was detected faster than any of the bi-modal combinations, which in turn were detected faster than any of the uni-modal signals. These facilitations exceeded the “Race model” predictions. A breakdown of the time gained in the bi-modal combinations by hemispace, hands and gender, provide further support for the “inverse effectiveness” principle, as the maximal bi-modal enhancements occurred for the least effective uni-modal responses.

[1]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[2]  Jeff Miller,et al.  Timecourse of coactivation in bimodal divided attention , 1986, Perception & psychophysics.

[3]  H. E. Torebjörk,et al.  Gating of tactile input from the hand , 2004, Experimental Brain Research.

[4]  D. Raab DIVISION OF PSYCHOLOGY: STATISTICAL FACILITATION OF SIMPLE REACTION TIMES* , 1962 .

[5]  M. Wallace,et al.  Multisensory integration in the superior colliculus of the alert cat. , 1998, Journal of neurophysiology.

[6]  Hans Colonius,et al.  Visual-tactile spatial interaction in saccade generation , 2003, Experimental Brain Research.

[7]  J. Edeline,et al.  Evoked oscillations in the thalamo-cortical auditory system are present in anesthetized but not in unanesthetized rats. , 2003, Journal of neurophysiology.

[8]  M. Wallace,et al.  Enhanced multisensory integration in older adults , 2006, Neurobiology of Aging.

[9]  A. Diederich,et al.  Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time , 2004, Perception & psychophysics.

[10]  B. Stein,et al.  Enhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis , 1996, Journal of Cognitive Neuroscience.

[11]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[12]  Francesco Pavani,et al.  Acoustical Vision of Neglected Stimuli: Interaction among Spatially Converging Audiovisual Inputs in Neglect Patients , 2002, Journal of Cognitive Neuroscience.

[13]  N. Logothetis,et al.  Integration of Touch and Sound in Auditory Cortex , 2005, Neuron.

[14]  C. E. Chapman,et al.  Sensory perception during movement in man , 2004, Experimental Brain Research.

[15]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[16]  E. Fetz,et al.  Sensory input to primate spinal cord is presynaptically inhibited during voluntary movement , 2003, Nature Neuroscience.

[17]  Rolf Ulrich,et al.  Testing the race model inequality: An algorithm and computer programs , 2007, Behavior research methods.

[18]  P. Bertelson,et al.  The time-course of preparation: Confirmatory results with visual and auditory warning signals , 1969 .

[19]  Nadia Bolognini,et al.  Audiovisual Integration in Patients with Visual Deficit , 2005, Journal of Cognitive Neuroscience.

[20]  P M Rossini,et al.  Interhemispheric asymmetries in the perception of unimanual and bimanual cutaneous stimuli. A study using transcranial magnetic stimulation. , 1999, Brain : a journal of neurology.

[21]  D. Zellner,et al.  Influence of color on odor identification and liking ratings. , 1991, The American journal of psychology.

[22]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005 .

[23]  C. E. Chapman,et al.  Time course and magnitude of movement-related gating of tactile detection in humans. III. Effect of motor tasks. , 2002, Journal of neurophysiology.

[24]  J. Pernier,et al.  Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. , 2002, Cerebral cortex.

[25]  Cristiana Cavina-Pratesi,et al.  Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time , 2002, Experimental Brain Research.

[26]  J. Duysens,et al.  Gating of sensation and evoked potentials following foot stimulation during human gait , 1990, Experimental Brain Research.

[27]  A. Sanders 20 Stage Analysis of Reaction Processes , 1980 .

[28]  C. E. Chapman,et al.  Perception of vibrotactile stimuli during motor activity in human subjects , 2004, Experimental Brain Research.

[29]  E. Smith,et al.  Choice reaction time: an analysis of the major theoretical positions. , 1968, Psychological bulletin.

[30]  Nadia Bolognini,et al.  Audiovisuol integration in patients with visul deficit , 2005 .

[31]  Barry Stein,et al.  A Bayesian model unifies multisensory spatial localization with the physiological properties of the superior colliculus , 2007, Experimental Brain Research.

[32]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[33]  Hans Colonius,et al.  Intersensory facilitation in the motor component? , 1987 .

[34]  P. Boulinguez,et al.  Hemispheric asymmetry for trajectory perception. , 2003, Brain research. Cognitive brain research.

[35]  D. Zellner,et al.  Color affects perceived odor intensity. , 1990, Journal of experimental psychology. Human perception and performance.

[36]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[37]  D. Wolpert,et al.  Sensorimotor attenuation by central motor command signals in the absence of movement , 2006, Nature Neuroscience.

[38]  R J Snowden,et al.  Identification of Visual Stimuli is Improved by Accompanying Auditory Stimuli: The Role of Eye Movements and Sound Location , 2001, Perception.

[39]  M. Posner,et al.  On the selection of signals , 1973, Memory & cognition.

[40]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[41]  C. E. Chapman,et al.  Time course and magnitude of movement-related gating of tactile detection in humans. I. Importance of stimulus location. , 1998, Journal of neurophysiology.

[42]  H. Nagata,et al.  The merging of the senses: integration of subthreshold taste and smell , 2000, Nature Neuroscience.

[43]  Christopher T. Lovelace,et al.  An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection. , 2003, Brain research. Cognitive brain research.

[44]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[45]  John J. Foxe,et al.  Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. , 2004, Cerebral cortex.

[46]  C. E. Chapman,et al.  Time course and magnitude of movement-related gating of tactile detection in humans. II. Effects of stimulus intensity. , 2000, Journal of neurophysiology.

[47]  Thomas Rosemeier,et al.  Interaction of vestibular, somatosensory and visual signals for postural control and motion perception under terrestrial and microgravity conditions—a conceptual model , 1998, Brain Research Reviews.

[48]  H. E. Torebjörk,et al.  Gating of tactile input from the hand , 2004, Experimental Brain Research.

[49]  Barry E Stein,et al.  Neuron-specific response characteristics predict the magnitude of multisensory integration. , 2003, Journal of neurophysiology.

[50]  R. Malenka,et al.  Velocity-dependent suppression of cutaneous sensitivity during movement , 1982, Experimental Neurology.

[51]  R S Nickerson,et al.  Intersensory facilitation of reaction time: energy summation or preparation enhancement? , 1973, Psychological review.

[52]  D. Raab Statistical facilitation of simple reaction times. , 1962, Transactions of the New York Academy of Sciences.

[53]  W. Jiang,et al.  Two cortical areas mediate multisensory integration in superior colliculus neurons. , 2001, Journal of neurophysiology.