Motion Aftereffects Transfer between Touch and Vision

Current views on multisensory motion integration assume separate substrates where visual motion perceptually dominates tactile motion [1, 2]. However, recent neuroimaging findings demonstrate strong activation of visual motion processing areas by tactile stimuli [3-6], implying a potentially bidirectional relationship. To test the relationship between visual and tactile motion processing, we examined the transfer of motion aftereffects. In the well-known visual motion aftereffect, adapting to visual motion in one direction causes a subsequently presented stationary stimulus to be perceived as moving in the opposite direction [7, 8]. The existence of motion aftereffects in the tactile domain was debated [9-11], though robust tactile motion aftereffects have recently been demonstrated [12, 13]. By using a motion adaptation paradigm, we found that repeated exposure to visual motion in a given direction produced a tactile motion aftereffect, the illusion of motion in the opponent direction across the finger pad. We also observed that repeated exposure to tactile motion induces a visual motion aftereffect, biasing the perceived direction of counterphase gratings. These crossmodal aftereffects, operating both from vision to touch and from touch to vision, present strong behavioral evidence that the processing of visual and tactile motion rely on shared representations that dynamically impact modality-specific perception.

[1]  G. Essick,et al.  Tactile motion activates the human middle temporal/V5 (MT/V5) complex , 2002, The European journal of neuroscience.

[2]  J Driver,et al.  Crossmodal Spatial Influences of Touch on Extrastriate Visual Areas Take Current Gaze Direction into Account , 2002, Neuron.

[3]  J. H. Killebrew,et al.  Influence of visual motion on tactile motion perception. , 2006, Journal of neurophysiology.

[4]  James C. Craig,et al.  The prevalence of tactile motion aftereffects , 2002, Somatosensory & motor research.

[5]  Michael S Beauchamp,et al.  See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex , 2005, Current Opinion in Neurobiology.

[6]  J. Haxby,et al.  The effect of visual experience on the development of functional architecture in hMT+. , 2007, Cerebral cortex.

[7]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[8]  Wellington A. Thalman,et al.  The After-Effect of Movement in the Sense of Touch , 1922 .

[9]  Vincent Hayward,et al.  Compact, Portable, Modular, High-performance, Distributed Tactile Transducer Device Based on Lateral Skin Deformation , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[10]  Jérôme Ribot,et al.  Anisotropy in the representation of direction preferences in cat area 18 , 2008, The European journal of neuroscience.

[11]  Frans A. J. Verstraten,et al.  The Motion Aftereffect:A Modern Perspective , 1998 .

[12]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[13]  A Väljamäe,et al.  Filling-in visual motion with sounds. , 2008, Acta psychologica.

[14]  Tony Ro,et al.  Human MST But Not MT Responds to Tactile Stimulation , 2007, The Journal of Neuroscience.

[15]  Norimichi Kitagawa,et al.  Hearing visual motion in depth , 2002, Nature.

[16]  Randolph Blake,et al.  Perceiving object motion using vision and touch , 2004, Cognitive, affective & behavioral neuroscience.

[17]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[18]  T. Hendler,et al.  Visuo-haptic object-related activation in the ventral visual pathway , 2001, Nature Neuroscience.

[19]  John R. Votaw,et al.  Task-specific recruitment of dorsal and ventral visual areas during tactile perception , 2004, Neuropsychologia.

[20]  James C Craig,et al.  Visual Motion Interferes with Tactile Motion Perception , 2006, Perception.

[21]  Kenith V. Sobel,et al.  PSYCHOLOGICAL SCIENCE Research Article Neural Synergy Between Kinetic Vision and Touch , 2022 .

[22]  Amir Amedi,et al.  Combined activation and deactivation of visual cortex during tactile sensory processing. , 2007, Journal of neurophysiology.

[23]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[24]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[25]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[26]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[27]  Hiroshi Ashida,et al.  A hierarchical structure of motion system revealed by interocular transfer of flicker motion aftereffects , 2000, Vision Research.

[28]  Susumu Tachi,et al.  Tactile motion aftereffects produced by appropriate presentation for mechanoreceptors , 2007, Experimental Brain Research.

[29]  E. DeYoe,et al.  A comparison of visual and auditory motion processing in human cerebral cortex. , 2000, Cerebral cortex.

[30]  Y. Ejima,et al.  Anisotropy for Direction Discrimination in a Two-frame Apparent Motion Display , 1997, Vision Research.

[31]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[32]  Scott T. Grafton,et al.  Involvement of visual cortex in tactile discrimination of orientation , 1999, Nature.

[33]  John H. R. Maunsell,et al.  The visual field representation in striate cortex of the macaque monkey: Asymmetries, anisotropies, and individual variability , 1984, Vision Research.

[34]  Frans A. J. Verstraten,et al.  Independent Aftereffects of Attention and Motion , 2000, Neuron.

[35]  S. Nishida,et al.  Motion aftereffect with flickering test patterns reveals higher stages of motion processing , 1995, Vision Research.

[36]  M. Hollins,et al.  The tactile movement aftereffect. , 1994, Somatosensory & motor research.

[37]  Vincent Hayward,et al.  Tactile Rivalry Demonstrated with an Ambiguous Apparent-Motion Quartet , 2008, Current Biology.