Representation of Object Weight in Human Ventral Visual Cortex

Skilled manipulation requires the ability to predict the weights of viewed objects based on learned associations linking object weight to object visual appearance. However, the neural mechanisms involved in extracting weight information from viewed object properties are unknown. Given that ventral visual pathway areas represent a wide variety of object features, one intriguing but as yet untested possibility is that these areas also represent object weight, a nonvisual motor-relevant object property. Here, using event-related fMRI and pattern classification techniques, we tested the novel hypothesis that object-sensitive regions in occipitotemporal cortex (OTC), in addition to traditional motor-related brain areas, represent object weight when preparing to lift that object. In two studies, the same participants prepared and then executed lifting actions with objects of varying weight. In the first study, we show that when lifting visually identical objects, where predicted weight is based solely on sensorimotor memory, weight is represented in object-sensitive OTC. In the second study, we show that when object weight is associated with a particular surface texture, that texture-sensitive OTC areas also come to represent object weight. Notably, these texture-sensitive areas failed to carry information about weight in the first study, when object surface properties did not specify weight. Our results indicate that the integration of visual and motor-relevant object information occurs at the level of single OTC areas and provide evidence that the ventral visual pathway is actively and flexibly engaged in processing object weight, an object property critical for action planning and control.

[1]  Alex Martin,et al.  A neural system for learning about object function. , 2006, Cerebral cortex.

[2]  Kenneth F. Valyear,et al.  Decoding Action Intentions from Preparatory Brain Activity in Human Parieto-Frontal Networks , 2011, The Journal of Neuroscience.

[3]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[4]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[5]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[6]  Ehud Zohary,et al.  Multiple Reference Frames for Saccadic Planning in the Human Parietal Cortex , 2011, The Journal of Neuroscience.

[7]  Paul B. Johnson,et al.  Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. , 1997, Annual review of neuroscience.

[8]  Benjamin D. Singer,et al.  Retinotopic Organization of Human Ventral Visual Cortex , 2009, The Journal of Neuroscience.

[9]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[10]  Philippe A. Chouinard,et al.  Role of the Primary Motor and Dorsal Premotor Cortices in the Anticipation of Forces during Object Lifting , 2005, The Journal of Neuroscience.

[11]  E. DeYoe,et al.  Mapping striate and extrastriate visual areas in human cerebral cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Jonathan S. Cant,et al.  fMR-adaptation reveals separate processing regions for the perception of form and texture in the human ventral stream , 2008, Experimental Brain Research.

[13]  Jun Tanji,et al.  Differential involvement of neurons in the dorsal and ventral premotor cortex during processing of visual signals for action planning. , 2006, Journal of neurophysiology.

[14]  Lee A Baugh,et al.  Material evidence: interaction of well-learned priors and sensorimotor memory when lifting objects. , 2012, Journal of neurophysiology.

[15]  Hanna Damasio,et al.  Seeing touch is correlated with content-specific activity in primary somatosensory cortex. , 2011, Cerebral cortex.

[16]  J Randall Flanagan,et al.  Where One Hand Meets the Other: Limb-Specific and Action-Dependent Movement Plans Decoded from Preparatory Signals in Single Human Frontoparietal Brain Areas , 2013, The Journal of Neuroscience.

[17]  Eli Brenner,et al.  Size illusion influences how we lift but not how we grasp an object , 1996, Experimental Brain Research.

[18]  Bastiaan R Bloem,et al.  Weight-Specific Anticipatory Coding of Grip Force in Human Dorsal Premotor Cortex , 2012, The Journal of Neuroscience.

[19]  L. Pessoa,et al.  Decoding near-threshold perception of fear from distributed single-trial brain activation. , 2006, Cerebral cortex.

[20]  Robert W. Kentridge,et al.  Separate channels for processing form, texture, and color: evidence from FMRI adaptation and visual object agnosia. , 2010, Cerebral cortex.

[21]  P. Strick,et al.  Imaging the premotor areas , 2001, Current Opinion in Neurobiology.

[22]  Essa Yacoub,et al.  The Evaluation of Preprocessing Choices in Single-Subject BOLD fMRI Using NPAIRS Performance Metrics , 2003, NeuroImage.

[23]  Janaina Mourão Miranda,et al.  Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data , 2005, NeuroImage.

[24]  Lotfi B Merabet,et al.  Visual Topography of Human Intraparietal Sulcus , 2007, The Journal of Neuroscience.

[25]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[26]  Robert W. Kentridge,et al.  Separate processing of texture and form in the ventral stream: evidence from FMRI and visual agnosia. , 2010, Cerebral cortex.

[27]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[28]  Gouki Okazawa,et al.  Representation of the Material Properties of Objects in the Visual Cortex of Nonhuman Primates , 2014, The Journal of Neuroscience.

[29]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[30]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[31]  Clayton E. Curtis,et al.  Maintenance of Spatial and Motor Codes during Oculomotor Delayed Response Tasks , 2004, The Journal of Neuroscience.

[32]  T. Albright,et al.  Remembering Visual Motion: Neural Correlates of Associative Plasticity and Motion Recall in Cortical Area MT , 2007, Neuron.

[33]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[34]  Craig S. Chapman,et al.  Activity patterns in the category‐selective occipitotemporal cortex predict upcoming motor actions , 2013, The European journal of neuroscience.

[35]  I. Toni,et al.  Spatial and effector processing in the human parietofrontal network for reaches and saccades. , 2009, Journal of neurophysiology.

[36]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[37]  Tom M. Mitchell,et al.  Classifying Instantaneous Cognitive States from fMRI Data , 2003, AMIA.

[38]  R. Andersen,et al.  Dorsal Premotor Neurons Encode the Relative Position of the Hand, Eye, and Goal during Reach Planning , 2006, Neuron.

[39]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[40]  K. J. Cole,et al.  Memory representations underlying motor commands used during manipulation of common and novel objects. , 1993, Journal of neurophysiology.

[41]  Fraser W. Smith,et al.  Decoding Effector-Dependent and Effector-Independent Movement Intentions from Human Parieto-Frontal Brain Activity , 2011, The Journal of Neuroscience.

[42]  Jonathan S. Cant,et al.  Living in a material world: how visual cues to material properties affect the way that we lift objects and perceive their weight. , 2009, Journal of neurophysiology.

[43]  A. Oliva,et al.  A Real-World Size Organization of Object Responses in Occipitotemporal Cortex , 2012, Neuron.

[44]  Hanna Damasio,et al.  Predicting visual stimuli on the basis of activity in auditory cortices , 2010, Nature Neuroscience.

[45]  Herman Martins Gomes,et al.  Cross-modal responses in the primary visual cortex encode complex objects and correlate with tactile discrimination , 2011, Proceedings of the National Academy of Sciences.

[46]  R. Johansson,et al.  Coordinated isometric muscle commands adequately and erroneously programmed for the weight during lifting task with precision grip , 2004, Experimental Brain Research.

[47]  Jody C Culham,et al.  Decoding the neural mechanisms of human tool use , 2013, eLife.

[48]  Fraser W. Smith,et al.  Decoding Visual Object Categories in Early Somatosensory Cortex , 2013, Cerebral cortex.

[49]  S. Jackson,et al.  The Ponzo illusion affects grip-force but not grip-aperture scaling during prehension movements. , 2000, Journal of experimental psychology. Human perception and performance.

[50]  W. T. Thach,et al.  Motor mechanisms of the CNS: cerebrocerebellar interrelations. , 1969, Annual review of physiology.

[51]  H. Alkadhi,et al.  Localization of the motor hand area to a knob on the precentral gyrus. A new landmark. , 1997, Brain : a journal of neurology.

[52]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[53]  S. Edelman,et al.  Cue-Invariant Activation in Object-Related Areas of the Human Occipital Lobe , 1998, Neuron.

[54]  M. Pinsk,et al.  Visuotopic Organization of Macaque Posterior Parietal Cortex: A Functional Magnetic Resonance Imaging Study , 2011, The Journal of Neuroscience.

[55]  Jody C. Culham,et al.  Mental blocks: fMRI reveals top-down modulation of early visual cortex when obstacles interfere with grasp planning , 2011, Neuropsychologia.

[56]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[57]  I. Toni,et al.  Integration of target and effector information in the human brain during reach planning. , 2007, Journal of neurophysiology.

[58]  Jonathan S. Cant,et al.  Scratching Beneath the Surface: New Insights into the Functional Properties of the Lateral Occipital Area and Parahippocampal Place Area , 2011, The Journal of Neuroscience.

[59]  Louise P. Kirsch,et al.  Information about the Weight of Grasped Objects from Vision and Internal Models Interacts within the Primary Motor Cortex , 2010, The Journal of Neuroscience.

[60]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[61]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[62]  J. Flanagan,et al.  Independence of perceptual and sensorimotor predictions in the size–weight illusion , 2000, Nature Neuroscience.

[63]  L. Jakobson,et al.  A neurological dissociation between perceiving objects and grasping them , 1991, Nature.

[64]  Jonathan S. Cant,et al.  Object Ensemble Processing in Human Anterior-Medial Ventral Visual Cortex , 2012, The Journal of Neuroscience.

[65]  Naokazu Goda,et al.  Transformation from image-based to perceptual representation of materials along the human ventral visual pathway , 2011, NeuroImage.

[66]  Nikolaus Kriegeskorte,et al.  Comparison of multivariate classifiers and response normalizations for pattern-information fMRI , 2010, NeuroImage.

[67]  R. Johansson,et al.  Experience Can Change Distinct Size-Weight Priors Engaged in Lifting Objects and Judging their Weights , 2008, Current Biology.