Recruitment of Foveal Retinotopic Cortex During Haptic Exploration of Shapes and Actions in the Dark

The role of the early visual cortex and higher-order occipitotemporal cortex has been studied extensively for visual recognition and to a lesser degree for haptic recognition and visually guided actions. Using a slow event-related fMRI experiment, we investigated whether tactile and visual exploration of objects recruit the same “visual” areas (and in the case of visual cortex, the same retinotopic zones) and if these areas show reactivation during delayed actions in the dark toward haptically explored objects (and if so, whether this reactivation might be due to imagery). We examined activation during visual or haptic exploration of objects and action execution (grasping or reaching) separated by an 18 s delay. Twenty-nine human volunteers (13 females) participated in this study. Participants had their eyes open and fixated on a point in the dark. The objects were placed below the fixation point and accordingly visual exploration activated the cuneus, which processes retinotopic locations in the lower visual field. Strikingly, the occipital pole (OP), representing foveal locations, showed higher activation for tactile than visual exploration, although the stimulus was unseen and location in the visual field was peripheral. Moreover, the lateral occipital tactile–visual area (LOtv) showed comparable activation for tactile and visual exploration. Psychophysiological interaction analysis indicated that the OP showed stronger functional connectivity with anterior intraparietal sulcus and LOtv during the haptic than visual exploration of shapes in the dark. After the delay, the cuneus, OP, and LOtv showed reactivation that was independent of the sensory modality used to explore the object. These results show that haptic actions not only activate “visual” areas during object touch, but also that this information appears to be used in guiding grasping actions toward targets after a delay. SIGNIFICANCE STATEMENT Visual presentation of an object activates shape-processing areas and retinotopic locations in early visual areas. Moreover, if the object is grasped in the dark after a delay, these areas show “reactivation.” Here, we show that these areas are also activated and reactivated for haptic object exploration and haptically guided grasping. Touch-related activity occurs not only in the retinotopic location of the visual stimulus, but also at the occipital pole (OP), corresponding to the foveal representation, even though the stimulus was unseen and located peripherally. That is, the same “visual” regions are implicated in both visual and haptic exploration; however, touch also recruits high-acuity central representation within early visual areas during both haptic exploration of objects and subsequent actions toward them. Functional connectivity analysis shows that the OP is more strongly connected with ventral and dorsal stream areas when participants explore an object in the dark than when they view it.

[1]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[2]  Ravi S. Menon,et al.  Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[3]  L. Jakobson,et al.  Differences in the visual control of pantomimed and natural grasping movements , 1994, Neuropsychologia.

[4]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[5]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[6]  E. DeYoe,et al.  Mapping striate and extrastriate visual areas in human cerebral cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[8]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[9]  C Dohle,et al.  Human anterior intraparietal area subserves prehension , 1998, Neurology.

[10]  Karl J. Friston,et al.  Multisubject fMRI Studies and Conjunction Analyses , 1999, NeuroImage.

[11]  S. Kosslyn,et al.  The role of area 17 in visual imagery: convergent evidence from PET and rTMS. , 1999, Science.

[12]  T. Hendler,et al.  Visuo-haptic object-related activation in the ventral visual pathway , 2001, Nature Neuroscience.

[13]  T. Hendler,et al.  Convergence of visual and tactile shape processing in the human lateral occipital complex. , 2002, Cerebral cortex.

[14]  K. Zilles,et al.  Crossmodal Processing of Object Features in Human Anterior Intraparietal Cortex An fMRI Study Implies Equivalencies between Humans and Monkeys , 2002, Neuron.

[15]  Maurizio Corbetta,et al.  Reactivation of networks involved in preparatory states. , 2002, Cerebral cortex.

[16]  H. Bekkering,et al.  Visual Search Is Modulated by Action Intentions , 2002, Psychological science.

[17]  Ravi S. Menon,et al.  Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas , 2003, Experimental Brain Research.

[18]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Mark D'Esposito,et al.  Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses , 2004, NeuroImage.

[20]  M. Goodale,et al.  An evolving view of duplex vision: separate but interacting cortical pathways for perception and action , 2004, Current Opinion in Neurobiology.

[21]  Richard J. Davidson,et al.  Comparison of fMRI motion correction software tools , 2005, NeuroImage.

[22]  Michael S Beauchamp,et al.  See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex , 2005, Current Opinion in Neurobiology.

[23]  Scott T. Grafton,et al.  Virtual lesions of the anterior intraparietal area disrupt goal-dependent on-line adjustments of grasp , 2005, Nature Neuroscience.

[24]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[25]  Kenneth F. Valyear,et al.  Human parietal cortex in action , 2006, Current Opinion in Neurobiology.

[26]  Xiaoping Hu,et al.  Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception , 2007, Neuropsychologia.

[27]  B. Wandell,et al.  Visual Field Maps in Human Cortex , 2007, Neuron.

[28]  Jody C. Culham,et al.  Does tool-related fMRI activity within the intraparietal sulcus reflect the plan to grasp? , 2007, NeuroImage.

[29]  Lotfi B Merabet,et al.  Visual Topography of Human Intraparietal Sulcus , 2007, The Journal of Neuroscience.

[30]  Wolfgang Grodd,et al.  Comparing Natural and Constrained Movements: New Insights into the Visuomotor Control of Grasping , 2007, PloS one.

[31]  William M. Stern,et al.  Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex , 2007, Nature Neuroscience.

[32]  Amir Amedi,et al.  Combined activation and deactivation of visual cortex during tactile sensory processing. , 2007, Journal of neurophysiology.

[33]  S. R. Lehky,et al.  Comparison of shape encoding in primate dorsal and ventral visual pathways. , 2007, Journal of neurophysiology.

[34]  J. Culham,et al.  The human dorsal stream adapts to real actions and 3D shape processing: a functional magnetic resonance imaging study. , 2008, Journal of neurophysiology.

[35]  N. Kanwisher,et al.  Feedback of pVisual Object Information to Foveal Retinotopic Cortex , 2008, Nature Neuroscience.

[36]  Amir Amedi,et al.  Multisensory visual–tactile object related network in humans: insights gained using a novel crossmodal adaptation approach , 2009, Experimental Brain Research.

[37]  B. Spehar,et al.  The Foveal Confluence in Human Visual Cortex , 2009, The Journal of Neuroscience.

[38]  Jody C. Culham,et al.  Ventral and dorsal stream contributions to the online control of immediate and delayed grasping: A TMS approach , 2009, Neuropsychologia.

[39]  Amir Amedi,et al.  A Putative Model of Multisensory Object Representation , 2009, Brain Topography.

[40]  Ivan Toni,et al.  Repetition suppression dissociates spatial frames of reference in human saccade generation. , 2010, Journal of neurophysiology.

[41]  I. Toni,et al.  Reference frames for reach planning in human parietofrontal cortex. , 2010, Journal of neurophysiology.

[42]  Scott T. Grafton,et al.  Human Posterior Parietal Cortex Flexibly Determines Reference Frames for Reaching Based on Sensory Context , 2010, Neuron.

[43]  John J. Foxe,et al.  Tactile shape discrimination recruits human lateral occipital complex during early perceptual processing , 2010, Human brain mapping.

[44]  Thomas E. Nichols,et al.  Everything You Never Wanted to Know about Circular Analysis, but Were Afraid to Ask , 2010, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[45]  Jody C Culham,et al.  Evaluation of preprocessing steps to compensate for magnetic field distortions due to body movements in BOLD fMRI. , 2010, Magnetic resonance imaging.

[46]  Glyn W. Humphreys,et al.  Impaired grasping in a patient with optic ataxia: Primary visuomotor deficit or secondary consequence of misreaching? , 2010, Neuropsychologia.

[47]  R. Malach,et al.  Cortical activity during tactile exploration of objects in blind and sighted humans. , 2010, Restorative neurology and neuroscience.

[48]  Ole Jensen,et al.  Multiple Reference Frames in Cortical Oscillatory Activity during Tactile Remapping for Saccades , 2011, The Journal of Neuroscience.

[49]  Hanna Damasio,et al.  Seeing touch is correlated with content-specific activity in primary somatosensory cortex. , 2011, Cerebral cortex.

[50]  Jody C. Culham,et al.  Neuroimaging reveals enhanced activation in a reach-selective brain area for objects located within participants’ typical hand workspaces , 2011, Neuropsychologia.

[51]  Jody C Culham,et al.  Functional magnetic resonance adaptation reveals the involvement of the dorsomedial stream in hand orientation for grasping. , 2011, Journal of neurophysiology.

[52]  I. Rentschler,et al.  Peripheral vision and pattern recognition: a review. , 2011, Journal of vision.

[53]  M. Pinsk,et al.  Visuotopic Organization of Macaque Posterior Parietal Cortex: A Functional Magnetic Resonance Imaging Study , 2011, The Journal of Neuroscience.

[54]  Thomas E. Nichols,et al.  Handbook of Functional MRI Data Analysis: Index , 2011 .

[55]  Sterling C. Johnson,et al.  A generalized form of context-dependent psychophysiological interactions (gPPI): A comparison to standard approaches , 2012, NeuroImage.

[56]  Timothy E. J. Behrens,et al.  Tools of the trade: psychophysiological interactions and functional connectivity. , 2012, Social cognitive and affective neuroscience.

[57]  Marlene Behrmann,et al.  Visuotopic Cortical Connectivity Underlying Attention Revealed with White-Matter Tractography , 2012, The Journal of Neuroscience.

[58]  Christopher D. Chambers,et al.  Is delayed foveal feedback critical for extra-foveal perception? , 2013, Cortex.

[59]  Liam D. Kaufman,et al.  Human fMRI Reveals That Delayed Action Re-Recruits Visual Perception , 2013, PloS one.

[60]  J. Gallivan A Motor-Oriented Organization of Human Ventral Visual Cortex? , 2014, The Journal of Neuroscience.

[61]  J. Randall Flanagan,et al.  Representation of Object Weight in Human Ventral Visual Cortex , 2014, Current Biology.

[62]  Glyn W. Humphreys,et al.  Haptic Shape Processing in Visual Cortex , 2014, Journal of Cognitive Neuroscience.

[63]  Luis Concha,et al.  The parietal cortices participate in encoding, short-term memory, and decision-making related to tactile shape. , 2014, Journal of neurophysiology.

[64]  W. Medendorp,et al.  Functional magnetic resonance imaging adaptation reveals the cortical networks for processing grasp-relevant object properties. , 2014, Cerebral cortex.

[65]  S. Lacey,et al.  Visuo-haptic multisensory object recognition, categorization, and representation , 2014, Front. Psychol..

[66]  Jacqueline C. Snow,et al.  Preserved Haptic Shape Processing after Bilateral LOC Lesions , 2015, The Journal of Neuroscience.

[67]  Jody C. Culham,et al.  Neural correlates of object size and object location during grasping actions , 2015, The European journal of neuroscience.

[68]  Frank T. M. Leoné,et al.  Flexible Reference Frames for Grasp Planning in Human Parietofrontal Cortex1,2,3 , 2015, eNeuro.

[69]  E. Aarnoutse,et al.  Action Preparation Shapes Processing in Early Visual Cortex , 2015, The Journal of Neuroscience.

[70]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[71]  G. Króliczak,et al.  Haptically Guided Grasping. fMRI Shows Right-Hemisphere Parietal Stimulus Encoding, and Bilateral Dorso-Ventral Parietal Gradients of Object- and Action-Related Processing during Grasp Execution , 2016, Front. Hum. Neurosci..

[72]  J Randall Flanagan,et al.  Planning Ahead: Object-Directed Sequential Actions Decoded from Human Frontoparietal and Occipitotemporal Networks. , 2015, Cerebral cortex.

[73]  Jody C. Culham,et al.  Human neuroimaging reveals the subcomponents of grasping, reaching and pointing actions , 2018, Cortex.