Tactile and visual motion direction processing in hMT+/V5

The human motion complex hMT+/V5 is activated not only by visual motion, but also by tactile and auditory motion. Whilst direction-selectivity has been found within this complex for visual and auditory stimuli, it is unknown whether hMT+/V5 also contains direction-specific information from the tactile modality. In the current study, we sought to investigate whether hMT+/V5 contains direction-specific information about visual/tactile moving stimuli. Leftward and rightward moving stimuli were presented in the visual and tactile modalities in an event-related fMRI design. Using region-of-interest-based multivariate pattern analysis we could decode the two motion directions for both tactile and visual stimuli in hMT+/V5. The activity patterns of the two modalities differed significantly, indicating that motion direction information from different modalities may be carried by distinct sets of neuronal populations. Our findings show that hMT+/V5 contains specific information about the direction of a moving stimulus in both the tactile and visual modalities, supporting the theory of hMT+/V5 being a multimodal motion area.

[1]  Micah M. Murray,et al.  The Neural Bases of Multisensory Processes , 2011 .

[2]  Christoph Kayser,et al.  Do early sensory cortices integrate cross-modal information? , 2007, Brain Structure and Function.

[3]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[4]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[5]  L. Marks.  Similarities and differences among the senses. , 1983, The International journal of neuroscience.

[6]  D. Alais,et al.  Touch Interacts with Vision during Binocular Rivalry with a Tight Orientation Tuning , 2013, PloS one.

[7]  M. Ptito,et al.  Beyond visual, aural and haptic movement perception: hMT+ is activated by electrotactile motion stimulation of the tongue in sighted and in congenitally blind individuals , 2010, Brain Research Bulletin.

[8]  Karl J. Friston,et al.  A direct demonstration of functional specialization in human visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  J. Haynes.  Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[10]  Andreas Bartels,et al.  The Coding of Color, Motion, and Their Conjunction in the Human Visual Cortex , 2009, Current Biology.

[11]  S S Hsiao,et al.  The tactile integration of local motion cues is analogous to its visual counterpart , 2008, Proceedings of the National Academy of Sciences.

[12]  W. Singer,et al.  Capture of Auditory Motion by Vision Is Represented by an Activation Shift from Auditory to Visual Motion Cortex , 2008, The Journal of Neuroscience.

[13]  E. Bullmore,et al.  Activation of auditory cortex during silent lipreading. , 1997, Science.

[14]  D. Heeger,et al.  Retinotopy and Functional Subdivision of Human Areas MT and MST , 2002, The Journal of Neuroscience.

[15]  Tony Ro,et al.  Human MST But Not MT Responds to Tactile Stimulation , 2007, The Journal of Neuroscience.

[16]  Monica Gori,et al.  Cross-Sensory Facilitation Reveals Neural Interactions between Visual and Tactile Motion in Humans , 2011, Front. Psychology.

[17]  Joost X. Maier,et al.  Natural, Metaphoric, and Linguistic Auditory Direction Signals Have Distinct Influences on Visual Motion Processing , 2009, The Journal of Neuroscience.

[18]  Pavel Zahorik,et al.  Decoding the direction of auditory motion in blind humans , 2011, NeuroImage.

[19]  Daniela Bonino,et al.  Functional inhibition of the human middle temporal cortex affects non-visual motion perception: a repetitive transcranial magnetic stimulation study during tactile speed discrimination , 2011, Experimental biology and medicine.

[20]  Emiliano Ricciardi,et al.  Touching Motion: rTMS on the Human Middle Temporal Complex Interferes with Tactile Speed Perception , 2012, Brain Topography.

[21]  G. DeAngelis,et al.  A functional link between area MSTd and heading perception based on vestibular signals , 2007, Nature Neuroscience.

[22]  A. Dale,et al.  Visual motion aftereffect in human cortical area MT revealed by functional magnetic resonance imaging , 1995, Nature.

[23]  Yi Chen,et al.  Statistical inference and multiple testing correction in classification-based multi-voxel pattern analysis (MVPA): Random permutations and cluster size control , 2011, NeuroImage.

[24]  Vincent Hayward,et al.  Motion Aftereffects Transfer between Touch and Vision , 2009, Current Biology.

[25]  Felix Blankenburg,et al.  Tactile Motion and Pattern Processing Assessed with High-Field fMRI , 2011, PloS one.

[27]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[28]  J. Haxby,et al.  The effect of visual experience on the development of functional architecture in hMT+. , 2007, Cerebral cortex.

[29]  U. Noppeney,et al.  Audiovisual Synchrony Improves Motion Discrimination via Enhanced Connectivity between Early Visual and Auditory Areas , 2010, The Journal of Neuroscience.

[30]  Kenith V. Sobel,et al.  PSYCHOLOGICAL SCIENCE Research Article Neural Synergy Between Kinetic Vision and Touch , 2022 .

[31]  W. Singer,et al.  The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery , 1998, The European journal of neuroscience.

[32]  Susumu Tachi,et al.  Tactile motion aftereffects produced by appropriate presentation for mechanoreceptors , 2007, Experimental Brain Research.

[33]  Christoph Kayser,et al.  The Multisensory Nature of Unisensory Cortices: A Puzzle Continued , 2010, Neuron.

[34]  A Grinvald,et al.  Optical imaging reveals the functional architecture of neurons processing shape and motion in owl monkey area MT , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[35]  S. Soto-Faraco,et al.  Changing Reference Frames during the Encoding of Tactile Events , 2008, Current Biology.

[36]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[37]  G. DeAngelis,et al.  Visual–Vestibular Integration for Self-Motion Perception , 2012 .

[38]  Kenneth H. Britten,et al.  Mechanisms of self-motion perception. , 2008, Annual review of neuroscience.

[39]  Martin N. Hebart,et al.  The Decoding Toolbox (TDT): a new fMRI analysis package for SPM and MATLAB , 2012 .

[40]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[41]  S. Rombouts,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[42]  F. Tong,et al.  Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex , 2006, Current Biology.

[43]  Dora E Angelaki,et al.  Spatial Reference Frames of Visual, Vestibular, and Multimodal Heading Signals in the Dorsal Subdivision of the Medial Superior Temporal Area , 2007, The Journal of Neuroscience.

[44]  S. Zeki.  Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[45]  M. Sams,et al.  Primary auditory cortex activation by visual speech: an fMRI study at 3 T , 2005, Neuroreport.

[46]  Wendy Baccus,et al.  Form and motion make independent contributions to the response to biological motion in occipitotemporal cortex , 2012, NeuroImage.

[47]  Colline Poirier,et al.  Auditory motion perception activates visual motion areas in early blind subjects , 2006, NeuroImage.

[48]  Riitta Hari,et al.  Touch activates human auditory cortex , 2006, NeuroImage.

[49]  Lukas Scheef,et al.  Multimodal motion processing in area V5/MT: Evidence from an artificial class of audio-visual events , 2009, Brain Research.

[50]  Ankoor S. Shah,et al.  Auditory Cortical Neurons Respond to Somatosensory Stimulation , 2003, The Journal of Neuroscience.

[51]  Nicola Vanello,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[52]  John J. Foxe,et al.  Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. , 2000, Brain research. Cognitive brain research.

[53]  Bart Krekelberg,et al.  The Statistical Analysis of Multi-Voxel Patterns in Functional Imaging , 2013, PloS one.

[54]  T. Albright.  Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[55]  Alison J. Wiggett,et al.  Patterns of fMRI Activity Dissociate Overlapping Functional Brain Areas that Respond to Biological Motion , 2006, Neuron.

[56]  M. Morrone,et al.  Touch disambiguates rivalrous perception at early stages of visual analysis , 2010, Current Biology.

[57]  John H. R. Maunsell,et al.  The middle temporal visual area in the macaque: Myeloarchitecture, connections, functional properties and topographic organization , 1981, The Journal of comparative neurology.

[58]  G. Essick,et al.  Tactile motion activates the human middle temporal/V5 (MT/V5) complex , 2002, The European journal of neuroscience.

[59]  Fiona N. Newell,et al.  Static images of novel, moveable objects learned through touch activate visual area hMT+ , 2010, NeuroImage.

[60]  J. H. Killebrew,et al.  Influence of visual motion on tactile motion perception. , 2006, Journal of neurophysiology.

[61]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Alan C. Evans,et al.  A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. , 2000, Cerebral cortex.

[63]  A. Vanlierde,et al.  Specific activation of the V5 brain area by auditory motion processing: an fMRI study. , 2005, Brain research. Cognitive brain research.

[64]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[65]  A. T. Smith,et al.  Sensitivity to optic flow in human cortical areas MT and MST , 2006, The European journal of neuroscience.

[66]  Murray Mm,et al.  Visual–Vestibular Integration for Self-Motion Perception -- The Neural Bases of Multisensory Processes , 2012 .

[67]  D. Burr,et al.  Spatiotopic selectivity of BOLD responses to visual motion in human area MT , 2007, Nature Neuroscience.

[68]  Martin V. Butz,et al.  Remapping motion across modalities: tactile rotations influence visual motion judgments , 2010, Experimental Brain Research.