Dual pathways for haptic and visual perception of spatial and texture information

Segregation of information flow along a dorsally directed pathway for processing object location and a ventrally directed pathway for processing object identity is well established in the visual and auditory systems, but is less clear in the somatosensory system. We hypothesized that segregation of location vs. identity information in touch would be evident if texture is the relevant property for stimulus identity, given the salience of texture for touch. Here, we used functional magnetic resonance imaging (fMRI) to investigate whether the pathways for haptic and visual processing of location and texture are segregated, and the extent of bisensory convergence. Haptic texture-selectivity was found in the parietal operculum and posterior visual cortex bilaterally, and in parts of left inferior frontal cortex. There was bisensory texture-selectivity at some of these sites in posterior visual and left inferior frontal cortex. Connectivity analyses demonstrated, in each modality, flow of information from unisensory non-selective areas to modality-specific texture-selective areas and further to bisensory texture-selective areas. Location-selectivity was mostly bisensory, occurring in dorsal areas, including the frontal eye fields and multiple regions around the intraparietal sulcus bilaterally. Many of these regions received input from unisensory areas in both modalities. Together with earlier studies, the activation and connectivity analyses of the present study establish that somatosensory processing flows into segregated pathways for location and object identity information. The location-selective somatosensory pathway converges with its visual counterpart in dorsal frontoparietal cortex, while the texture-selective somatosensory pathway runs through the parietal operculum before converging with its visual counterpart in visual and frontal cortex. Both segregation of sensory processing according to object property and multisensory convergence appear to be universal organizing principles.

[1]  Xiaoping Hu,et al.  Tactile discrimination of grating orientation: fMRI activation patterns , 2005, Human brain mapping.

[2]  Gian Luca Romani,et al.  “What” versus “Where” in the audiovisual domain: An fMRI study , 2006, NeuroImage.

[3]  J. Rauschecker,et al.  Mechanisms and streams for processing of "what" and "where" in auditory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[4]  D. V. van Essen,et al.  The Processing of Visual Shape in the Cerebral Cortex of Human and Nonhuman Primates: A Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[5]  K. Sathian,et al.  Activation and Effective Connectivity Changes Following Explicit-Memory Training for Face–Name Pairs in Patients With Mild Cognitive Impairment , 2011, Neurorehabilitation and neural repair.

[6]  P. Roland,et al.  Shape and roughness activate different somatosensory areas in the human brain. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[7]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[8]  Mark W. Woolrich,et al.  Network modelling methods for FMRI , 2011, NeuroImage.

[9]  Synnöve Carlson,et al.  Multisensory Integration of Sounds and Vibrotactile Stimuli in Processing Streams for “What” and “Where” , 2009, The Journal of Neuroscience.

[10]  L. Optican,et al.  Cortical regions involved in visual texture perception: a fMRI study. , 1998, Brain research. Cognitive brain research.

[11]  Anjan Chatterjee,et al.  The Neural Basis for Spatial Relations , 2010, Journal of Cognitive Neuroscience.

[12]  K. Sathian,et al.  Altered responses to cutaneous stimuli in the second somatosensory cortex following lesions of the postcentral gyrus in infant and juvenile macaques , 1990, The Journal of comparative neurology.

[13]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[14]  Xiaoping Hu,et al.  Neural processing underlying tactile microspatial discrimination in the blind: a functional magnetic resonance imaging study. , 2008, Journal of vision.

[15]  Lucas Spierer,et al.  Getting in touch: Segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging , 2007, NeuroImage.

[16]  M. Preul The Human Brain: Surface, Blood Supply, and Three-Dimensional Sectional Anatomy , 2001 .

[17]  C. Grady,et al.  “What” and “where” in the human auditory system , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Alan Cowey,et al.  TMS can reveal contrasting functions of the dorsal and ventral visual processing streams , 2006, Experimental Brain Research.

[19]  L Krubitzer,et al.  A redefinition of somatosensory areas in the lateral sulcus of macaque monkeys , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  G. Orban,et al.  Attention to 3-D Shape, 3-D Motion, and Texture in 3-D Structure from Motion Displays , 2004, Journal of Cognitive Neuroscience.

[21]  M Mishkin,et al.  Serial and parallel processing of tactual information in somatosensory cortex of rhesus monkeys. , 1992, Journal of neurophysiology.

[22]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[23]  Fiona N. Newell,et al.  Vision and touch: Independent or integrated systems for the perception of texture? , 2008, Brain Research.

[24]  John J. Foxe,et al.  Tactile shape discrimination recruits human lateral occipital complex during early perceptual processing , 2010, Human brain mapping.

[25]  Péter Szigetvári,et al.  What and When? , 2019, Inauguration and Liturgical Kingship in the Long Twelfth Century.

[26]  P Servos,et al.  fMRI-derived cortical maps for haptic shape, texture, and hardness. , 2001, Brain research. Cognitive brain research.

[27]  C. Spence,et al.  Audiotactile interactions in roughness perception , 2002, Experimental Brain Research.

[28]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[29]  Xiaoping Hu,et al.  Verifying visual fixation to improve fMRI with predictive eye estimation regression (PEER) , 2007 .

[30]  Xiaoping Hu,et al.  Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception , 2007, Neuropsychologia.

[31]  K. Sathian,et al.  Multisensory cortical processing of object shape and its relation to mental imagery , 2004, Cognitive, affective & behavioral neuroscience.

[32]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[33]  C. Gross,et al.  Visuospatial properties of ventral premotor cortex. , 1997, Journal of neurophysiology.

[34]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[35]  Per E. Roland,et al.  Somatosensory detection of microgeometry, macrogeometry and kinesthesia after localized lesions of the cerebral hemispheres in man , 1987, Brain Research Reviews.

[36]  Harold Burton,et al.  Second Somatosensory Cortex and Related Areas , 1986 .

[37]  T. Hendler,et al.  Visuo-haptic object-related activation in the ventral visual pathway , 2001, Nature Neuroscience.

[38]  Mortimer Mishkin,et al.  Analogous neural models for tactual and visual learning , 1979, Neuropsychologia.

[39]  R. Kakigi,et al.  Serial processing in the human somatosensory system. , 2004, Cerebral cortex.

[40]  Roberta L. Klatzky,et al.  What vs. where in touch: an fMRI study , 2005, NeuroImage.

[41]  J. Kaiser,et al.  Multisensory Object Perception in the Primate Brain , 2010 .

[42]  Claude Alain,et al.  Assessing the auditory dual-pathway model in humans , 2004, NeuroImage.

[43]  D J Felleman,et al.  Somatotopic organization of the lateral sulcus of owl monkeys: Area 3b, s‐II, and a ventral somatosensory area , 1989, The Journal of comparative neurology.

[44]  Leslie G. Ungerleider,et al.  Tactile form and location processing in the human brain. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Alan Cowey,et al.  Differential and co-involvement of areas of the temporal and parietal streams in visual tasks , 2009, Neuropsychologia.

[46]  John W. Lane,et al.  Receptive Field Properties of the Macaque Second Somatosensory Cortex: Evidence for Multiple Functional Representations , 2004, The Journal of Neuroscience.

[47]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[48]  John H. R. Maunsell,et al.  Shape selectivity in primate lateral intraparietal cortex , 1998, Nature.

[49]  R. Caselli,et al.  Ventrolateral and dorsomedial somatosensory association cortex damage produces distinct somesthetic syndromes in humans , 1993, Neurology.

[50]  H. Duvernoy,et al.  The Human Brain: Surface, Three-Dimensional Sectional Anatomy with MRI, and Blood Supply , 1999 .

[51]  Ryuta Kawashima,et al.  A PET Study of Somatosensory Discrimination in Man. Microgeometry Versus Macrogeometry , 1994, The European journal of neuroscience.

[52]  Xiaoping Hu,et al.  Object familiarity modulates effective connectivity during haptic shape perception , 2010, NeuroImage.

[53]  David P. Friedman,et al.  Cortical connections of the somatosensory fields of the lateral sulcus of macaques: Evidence for a corticolimbic pathway for touch , 1986, The Journal of comparative neurology.

[54]  Isabel Gauthier,et al.  BOLD Activity during Mental Rotation and Viewpoint-Dependent Object Recognition , 2002, Neuron.

[55]  Mark Hollins,et al.  The coding of roughness. , 2007, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[56]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[57]  Elisabeth A. Murray,et al.  Relative contributions of SII and area 5 to tactile discrimination in monkeys , 1984, Behavioural Brain Research.

[58]  Amir Amedi,et al.  Combined activation and deactivation of visual cortex during tactile sensory processing. , 2007, Journal of neurophysiology.

[59]  M J Farah,et al.  Tactile agnosia. Underlying impairment and implications for normal tactile object recognition. , 1996, Brain : a journal of neurology.

[60]  Christopher R. Stambaugh,et al.  Simultaneous encoding of tactile information by three primate cortical areas , 1998, Nature Neuroscience.

[61]  Rainer Goebel,et al.  Mapping directed influence over the brain using Granger causality and fMRI , 2005, NeuroImage.

[62]  Rajan S. Patel,et al.  A Bayesian approach to determining connectivity of the human brain , 2006, Human brain mapping.

[63]  C. Spence,et al.  The multisensory perception of flavor , 2008, Consciousness and Cognition.

[64]  J. Fuster,et al.  Unit activity in monkey parietal cortex related to haptic perception and temporary memory , 2004, Experimental Brain Research.

[65]  Volkmar Glauche,et al.  Localization of human intraparietal areas AIP, CIP, and LIP using surface orientation and saccadic eye movement tasks , 2008, Human brain mapping.

[66]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[68]  Susan J. Lederman,et al.  Multisensory Texture Perception , 2010 .

[69]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[70]  David P. Friedman,et al.  Physiological evidence for serial processing in somatosensory cortex. , 1987, Science.

[71]  T. Allison,et al.  Functional magnetic resonance imaging of the differential sensitivity of human visual cortex to faces, letterstrings, and textures , 1996, NeuroImage.

[72]  Randall Stilla,et al.  Selective visuo‐haptic processing of shape and texture , 2008, Human brain mapping.

[73]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[74]  K. Sathian,et al.  Tactile sensing of surface features , 1989, Trends in Neurosciences.

[75]  A. Cavanna,et al.  Functional Connectivity of the Posteromedial Cortex , 2010, PloS one.

[76]  R. Nebes,et al.  Reliability and validity of some handedness questionnaire items. , 1974, Neuropsychologia.

[77]  B. Stein The new handbook of multisensory processes , 2012 .

[78]  Gregor Thut,et al.  Feeling by Sight or Seeing by Touch? , 2004, Neuron.

[79]  Gereon R Fink,et al.  The somatotopic organization of cytoarchitectonic areas on the human parietal operculum. , 2007, Cerebral cortex.

[80]  Xiaoping Hu,et al.  Posteromedial Parietal Cortical Activity and Inputs Predict Tactile Spatial Acuity , 2007, The Journal of Neuroscience.

[81]  Remco J. Renken,et al.  The effect of intra- and inter-subject variability of hemodynamic responses on group level Granger causality analyses , 2011, NeuroImage.

[82]  Norihiro Sadato,et al.  Tactile-visual cross-modal shape matching: a functional MRI study. , 2003, Brain research. Cognitive brain research.

[83]  W. Jiang,et al.  Neuronal encoding of texture changes in the primary and the secondary somatosensory cortical areas of monkeys during passive texture discrimination. , 1997, Journal of neurophysiology.

[84]  Xiaoping Hu,et al.  Art for reward's sake: Visual art recruits the ventral striatum , 2011, NeuroImage.

[85]  Amir Amedi,et al.  A Putative Model of Multisensory Object Representation , 2009, Brain Topography.

[86]  Emiliano Macaluso,et al.  Orienting of spatial attention and the interplay between the senses , 2010, Cortex.

[87]  Xiaoping Hu,et al.  Multivariate Granger causality analysis of fMRI data , 2009, Human brain mapping.

[88]  G. T. Coleman,et al.  Hierarchical equivalence of somatosensory areas I and II for tactile processing in the cerebral cortex of the marmoset monkey. , 2001, Journal of neurophysiology.

[89]  G. Boynton,et al.  Adaptation: from single cells to BOLD signals , 2006, Trends in Neurosciences.

[90]  Xiaoping Hu,et al.  Effective connectivity during haptic perception: A study using Granger causality analysis of functional magnetic resonance imaging data , 2008, NeuroImage.

[91]  Mark Holliins,et al.  Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis , 1993, Perception & psychophysics.

[92]  J. Pruett,et al.  Responses in primary somatosensory cortex of rhesus monkey to controlled application of embossed grating and bar patterns. , 1996, Somatosensory & motor research.

[93]  P. Roland,et al.  Somatosensory Activations of the Parietal Operculum of Man. A PET Study , 1995, The European journal of neuroscience.

[94]  E. Halgren,et al.  Sequences of cortical activation for tactile pattern discrimination using magnetoencephalography , 2009, Neuroreport.

[95]  John C Gore,et al.  Functional MRI and multivariate autoregressive models. , 2010, Magnetic resonance imaging.

[96]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[97]  K. Grill-Spector,et al.  fMR-adaptation: a tool for studying the functional properties of human cortical neurons. , 2001, Acta psychologica.

[98]  Jonathan S. Cant,et al.  fMR-adaptation reveals separate processing regions for the perception of form and texture in the human ventral stream , 2008, Experimental Brain Research.

[99]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[100]  Norihiro Sadato,et al.  T actile – visual cross-modal shape matching : a functional MRI study , 2003 .

[101]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[102]  J. Semmes,et al.  Behavioral consequences of selective subtotal ablations in the postcentral gyrus of Macaca mulatta. , 1974, Brain research.

[103]  S. Kastner,et al.  Two hierarchically organized neural systems for object information in human visual cortex , 2008, Nature Neuroscience.

[104]  H Burton,et al.  Response patterns in second somatosensory cortex (SII) of awake monkeys to passively applied tactile gratings. , 2000, Journal of neurophysiology.

[105]  H. C. Dijkerman,et al.  Somatosensory processes subserving perception and action , 2007, Behavioral and Brain Sciences.

[106]  Xiaoping Hu,et al.  Assessing and Compensating for Zero-Lag Correlation Effects in Time-Lagged Granger Causality Analysis of fMRI , 2010, IEEE Transactions on Biomedical Engineering.

[107]  Nikolaus Kriegeskorte,et al.  Face-identity change activation outside the face system: "release from adaptation" may not always indicate neuronal selectivity. , 2010, Cerebral cortex.

[108]  Leslie G. Ungerleider,et al.  The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[109]  Amir Amedi,et al.  Multisensory visual–tactile object related network in humans: insights gained using a novel crossmodal adaptation approach , 2009, Experimental Brain Research.