Task-context-dependent Linear Representation of Multiple Visual Objects in Human Parietal Cortex

A host of recent studies have reported robust representations of visual object information in the human parietal cortex, similar to those found in ventral visual cortex. In ventral visual cortex, both monkey neurophysiology and human fMRI studies showed that the neural representation of a pair of unrelated objects can be approximated by the averaged neural representation of the constituent objects shown in isolation. In this study, we examined whether such a linear relationship between objects exists for object representations in the human parietal cortex. Using fMRI and multivoxel pattern analysis, we examined object representations in human inferior and superior intraparietal sulcus, two parietal regions previously implicated in visual object selection and encoding, respectively. We also examined responses from the lateral occipital region, a ventral object processing area. We obtained fMRI response patterns to object pairs and their constituent objects shown in isolation while participants viewed these objects and performed a 1-back repetition detection task. By measuring fMRI response pattern correlations, we found that all three brain regions contained representations for both single object and object pairs. In the lateral occipital region, the representation for a pair of objects could be reliably approximated by the average representation of its constituent objects shown in isolation, replicating previous findings in ventral visual cortex. Such a simple linear relationship, however, was not observed in either parietal region examined. Nevertheless, when we equated the amount of task information present by examining responses from two pairs of objects, we found that representations for the average of two object pairs were indistinguishable in both parietal regions from the average of another two object pairs containing the same four component objects but with a different pairing of the objects (i.e., the average of AB and CD vs. that of AD and CB). Thus, when task information was held consistent, the same linear relationship may govern how multiple independent objects are represented in the human parietal cortex as it does in ventral visual cortex. These findings show that object and task representations coexist in the human parietal cortex and characterize one significant difference of how visual information may be represented in ventral visual and parietal regions.

[1]  Russell A. Epstein,et al.  Constructing scenes from objects in human occipitotemporal cortex , 2011, Nature Neuroscience.

[2]  Dwight J. Kravitz,et al.  The ventral visual pathway: an expanded neural framework for the processing of object quality , 2013, Trends in Cognitive Sciences.

[3]  Lawrence H Snyder,et al.  Single Neurons in Posterior Parietal Cortex of Monkeys Encode Cognitive Set , 2004, Neuron.

[4]  W. Medendorp,et al.  Functional magnetic resonance imaging adaptation reveals the cortical networks for processing grasp-relevant object properties. , 2014, Cerebral cortex.

[5]  N. Kanwisher,et al.  Cortical Regions Involved in Perceiving Object Shape , 2000, The Journal of Neuroscience.

[6]  J. Assad,et al.  Dynamic coding of behaviourally relevant stimuli in parietal cortex , 2002, Nature.

[7]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[8]  S. Kastner,et al.  Two hierarchically organized neural systems for object information in human visual cortex , 2008, Nature Neuroscience.

[9]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[10]  David J. Freedman,et al.  Experience-dependent representation of visual categories in parietal cortex , 2006, Nature.

[11]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[12]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[14]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[15]  John H. R. Maunsell,et al.  Shape selectivity in primate lateral intraparietal cortex , 1998, Nature.

[16]  K. Grill-Spector,et al.  The dynamics of object-selective activation correlate with recognition performance in humans , 2000, Nature Neuroscience.

[17]  J. Duncan,et al.  Adaptive Coding of Task-Relevant Information in Human Frontoparietal Cortex , 2011, The Journal of Neuroscience.

[18]  Dwight J. Kravitz,et al.  A Retinotopic Basis for the Division of High-Level Scene Processing between Lateral and Ventral Human Occipitotemporal Cortex , 2015, The Journal of Neuroscience.

[19]  Yaoda Xu,et al.  Goal-Directed Visual Processing Differentially Impacts Human Ventral and Dorsal Visual Representations , 2017, The Journal of Neuroscience.

[20]  M. Carandini,et al.  Normalization as a canonical neural computation , 2013, Nature Reviews Neuroscience.

[21]  Yaoda Xu,et al.  Distinctive Neural Mechanisms Supporting Visual Object Individuation and Identification , 2009, Journal of Cognitive Neuroscience.

[22]  E. Vogel,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004 .

[23]  Tutis Vilis,et al.  Equal degrees of object selectivity for upper and lower visual field stimuli. , 2010, Journal of neurophysiology.

[24]  Dwight J. Kravitz,et al.  A new neural framework for visuospatial processing , 2011, Nature Reviews Neuroscience.

[25]  Nancy Kanwisher,et al.  Attention and biased competition in multi-voxel object representations , 2010 .

[26]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[27]  Johan Wagemans,et al.  The distributed representation of random and meaningful object pairs in human occipitotemporal cortex: The weighted average as a general rule , 2013, NeuroImage.

[28]  S. R. Lehky,et al.  Comparison of shape encoding in primate dorsal and ventral visual pathways. , 2007, Journal of neurophysiology.

[29]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[30]  Russell A. Epstein,et al.  Decoding the Representation of Multiple Simultaneous Objects in Human Occipitotemporal Cortex , 2009, Current Biology.

[31]  Su Keun Jeong,et al.  The Contribution of Human Superior Intraparietal Sulcus to Visual Short-Term Memory and Perception , 2016 .

[32]  Jacqueline Gottlieb,et al.  Integration of Exogenous Input into a Dynamic Salience Map Revealed by Perturbing Attention , 2006, The Journal of Neuroscience.

[33]  R. Desimone,et al.  Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4 , 1999, The Journal of Neuroscience.

[34]  K. Grill-Spector,et al.  Relating retinotopic and object-selective responses in human lateral occipital cortex. , 2008, Journal of neurophysiology.

[35]  John Duncan,et al.  Multi-voxel coding of stimuli, rules, and responses in human frontoparietal cortex , 2011, NeuroImage.

[36]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[37]  David C. Plaut,et al.  ‘What’ Is Happening in the Dorsal Visual Pathway , 2016, Trends in Cognitive Sciences.

[38]  James J DiCarlo,et al.  Multiple Object Response Normalization in Monkey Inferotemporal Cortex , 2005, The Journal of Neuroscience.

[39]  Jacqueline Gottlieb,et al.  Spatial and non-spatial functions of the parietal cortex , 2010, Current Opinion in Neurobiology.

[40]  M. Chun,et al.  Selecting and perceiving multiple visual objects , 2009, Trends in Cognitive Sciences.

[41]  Yaoda Xu,et al.  Decoding the content of visual short-term memory under distraction in occipital and parietal areas , 2015, Nature Neuroscience.

[42]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[43]  Su Keun Jeong,et al.  Behaviorally Relevant Abstract Object Identity Representation in the Human Parietal Cortex , 2016, The Journal of Neuroscience.

[44]  A. Caramazza,et al.  Conceptual Object Representations in Human Anterior Temporal Cortex , 2012, The Journal of Neuroscience.

[45]  H. P. Op de Beeck,et al.  Task Context Overrules Object- and Category-Related Representational Content in the Human Parietal Cortex , 2017, Cerebral cortex.

[46]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[47]  Yaoda Xu The Role of the Superior Intraparietal Sulcus in Supporting Visual Short-Term Memory for Multifeature Objects , 2007, The Journal of Neuroscience.