Shape coding in occipito-temporal cortex relies on object silhouette, curvature and medial-axis.

Object recognition relies on different transformations of the retinal input, carried out by the visual system, that range from local contrast to object shape and category. While some of those transformations are thought to occur at specific stages of the visual hierarchy, the features they represent are correlated (e.g., object shape and identity) and selectivity for the same feature overlaps in many brain regions. This may be explained either by collinearity across representations, or may instead reflect the coding of multiple dimensions by the same cortical population. Moreover, orthogonal and shared components may differently impact on distinctive stages of the visual hierarchy. We recorded functional MRI (fMRI) activity while participants passively attended to object images and employed a statistical approach that partitioned orthogonal and shared object representations to reveal their relative impact on brain processing. Orthogonal shape representations (silhouette, curvature and medial-axis) independently explained distinct and overlapping clusters of selectivity in occitotemporal (OTC) and parietal cortex. Moreover, we show that the relevance of shared representations linearly increases moving from posterior to anterior regions. These results indicate that the visual cortex encodes shared relations between different features in a topographic fashion and that object shape is encoded along different dimensions, each representing orthogonal features.

[1]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Emiliano Ricciardi,et al.  Emotionotopy in the human right temporo-parietal cortex , 2019, Nature Communications.

[3]  Eric T. Carlson,et al.  Medial Axis Shape Coding in Macaque Inferotemporal Cortex , 2012, Neuron.

[4]  Daria Proklova,et al.  Disentangling Representations of Object Shape and Object Category in Human Visual Cortex: The Animate–Inanimate Distinction , 2016, Journal of Cognitive Neuroscience.

[5]  James H Elder,et al.  Cue dynamics underlying rapid detection of animals in natural scenes. , 2009, Journal of vision.

[6]  Keiji Tanaka Columns for complex visual object features in the inferotemporal cortex: clustering of cells with similar but slightly different stimulus selectivities. , 2003, Cerebral cortex.

[7]  Leslie G. Ungerleider,et al.  Curvature-processing network in macaque visual cortex , 2014, Proceedings of the National Academy of Sciences.

[8]  Jack L. Gallant,et al.  Fourier power, subjective distance, and object categories all provide plausible models of BOLD responses in scene-selective visual areas , 2015, Front. Comput. Neurosci..

[9]  Bruno Rossion,et al.  The fusiform face area is tuned for curvilinear patterns with more high-contrasted elements in the upper part , 2006, NeuroImage.

[10]  Victor A. F. Lamme,et al.  Spatially Pooled Contrast Responses Predict Neural and Perceptual Similarity of Naturalistic Image Categories , 2012, PLoS Comput. Biol..

[11]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Chris I. Baker,et al.  Evaluating the correspondence between face-, scene-, and object-selectivity and retinotopic organization within lateral occipitotemporal cortex , 2016, Journal of vision.

[13]  John A. Pyles,et al.  Comparing visual representations across human fMRI and computational vision. , 2013, Journal of vision.

[14]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[15]  J M Wolfe,et al.  Curvature is a Basic Feature for Visual Search Tasks , 1992, Perception.

[16]  Vladislav Ayzenberg,et al.  Skeletal descriptions of shape provide unique perceptual information for object recognition , 2019, bioRxiv.

[17]  Michelle R. Greene,et al.  Visual scenes are categorized by function. , 2016, Journal of experimental psychology. General.

[18]  Anitha Pasupathy,et al.  Transformation of shape information in the ventral pathway , 2007, Current Opinion in Neurobiology.

[19]  Marlene Behrmann,et al.  Altered large-scale organization of shape processing in visual agnosia , 2020, Cortex.

[20]  Sidney R. Lehky,et al.  Dimensionality of Object Representations in Monkey Inferotemporal Cortex , 2014, Neural Computation.

[21]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[22]  Tom Hartley,et al.  Low-Level Image Properties of Visual Objects Predict Patterns of Neural Response across Category-Selective Regions of the Ventral Visual Pathway , 2014, The Journal of Neuroscience.

[23]  Charles E Connor,et al.  Underlying principles of visual shape selectivity in posterior inferotemporal cortex , 2004, Nature Neuroscience.

[24]  H. P. Op de Beeck,et al.  Dissociations and Associations between Shape and Category Representations in the Two Visual Pathways , 2015, The Journal of Neuroscience.

[25]  Tomaso Poggio,et al.  Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex , 2007, The Journal of Neuroscience.

[26]  Selmaan N. Chettih,et al.  Single-neuron perturbations reveal feature-specific competition in V1 , 2019, Nature.

[27]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[28]  H. Komatsu,et al.  Image statistics underlying natural texture selectivity of neurons in macaque V4 , 2014, Proceedings of the National Academy of Sciences.

[29]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[30]  Emiliano Ricciardi,et al.  Foreground-Background Segmentation Revealed during Natural Image Viewing , 2017, eNeuro.

[31]  Alex R. Wade,et al.  Multivariate Patterns in the Human Object-Processing Pathway Reveal a Shift from Retinotopic to Shape Curvature Representations in Lateral Occipital Areas, LO-1 and LO-2 , 2016, The Journal of Neuroscience.

[32]  D C Van Essen,et al.  Information processing in the primate visual system: an integrated systems perspective. , 1992, Science.

[33]  Emiliano Ricciardi,et al.  Modality-independent encoding of individual concepts in the left parietal cortex , 2017, Neuropsychologia.

[34]  Jack L. Gallant,et al.  Pycortex: an interactive surface visualizer for fMRI , 2015, Front. Neuroinform..

[35]  P. Roelfsema,et al.  The Segmentation of Proto-Objects in the Monkey Primary Visual Cortex , 2019, Current Biology.

[36]  J Brendan Ritchie,et al.  The Ventral Visual Pathway Represents Animal Appearance over Animacy, Unlike Human Behavior and Deep Neural Networks , 2019, The Journal of Neuroscience.

[37]  Arnold W. M. Smeulders,et al.  Visual dictionaries as intermediate features in the human brain , 2015, Front. Comput. Neurosci..

[38]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[39]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[40]  Marlene Behrmann,et al.  Correction: The large-scale organization of shape processing in the ventral and dorsal pathways. , 2017 .

[41]  Barbara L. Finlay,et al.  Systematic, balancing gradients in neuron density and number across the primate isocortex , 2012, Front. Neuroanat..

[42]  Radoslaw Martin Cichy,et al.  The representational dynamics of task and object processing in humans , 2018, eLife.

[43]  Frédéric E Theunissen,et al.  The Hierarchical Cortical Organization of Human Speech Processing , 2017, The Journal of Neuroscience.

[44]  John A. Creager,et al.  Comments: Orthogonal and Nonorthogonal Methods for Partitioning Regression Variance , 1971 .

[45]  T. Poggio,et al.  A model of V4 shape selectivity and invariance. , 2007, Journal of neurophysiology.

[46]  F. D. Lange,et al.  Shape Perception Simultaneously Up- and Downregulates Neural Activity in the Primary Visual Cortex , 2014, Current Biology.

[47]  Sven J. Dickinson,et al.  Canonical Skeletons for Shape Matching , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[48]  Kim F. Nimon,et al.  Understanding the Results of Multiple Linear Regression , 2013 .

[49]  I. Biederman,et al.  Tuning for shape dimensions in macaque inferior temporal cortex , 2005, The European journal of neuroscience.

[50]  Mark Hymers,et al.  Specialized and independent processing of orientation and shape in visual field maps LO1 and LO2 , 2013, Nature Neuroscience.

[51]  H. Blum Biological shape and visual science (part I) , 1973 .

[52]  I. Biederman,et al.  Representation of regular and irregular shapes in macaque inferotemporal cortex. , 2005, Cerebral cortex.

[53]  R. Vogels,et al.  Inferotemporal neurons represent low-dimensional configurations of parameterized shapes , 2001, Nature Neuroscience.

[54]  Adam S. Lowet,et al.  Seeing structure: Shape skeletons modulate perceived similarity , 2018, Attention, perception & psychophysics.

[55]  Ha Hong,et al.  Explicit information for category-orthogonal object properties increases along the ventral stream , 2016, Nature Neuroscience.

[56]  Marius V Peelen,et al.  Shape-independent object category responses revealed by MEG and fMRI decoding. , 2016, Journal of neurophysiology.

[57]  Irving Biederman,et al.  Cortical representation of medial axis structure. , 2013, Cerebral cortex.

[58]  Kechen Zhang,et al.  A Sparse Object Coding Scheme in Area V4 , 2011, Current Biology.

[59]  Pieter R. Roelfsema,et al.  Texture Segregation Causes Early Figure Enhancement and Later Ground Suppression in Areas V1 and V4 of Visual Cortex , 2016, Cerebral cortex.

[60]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[61]  Lucy S. Petro,et al.  Contextual Feedback to Superficial Layers of V1 , 2015, Current Biology.

[62]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[63]  Li Fei-Fei,et al.  Distinct contributions of functional and deep neural network features to representational similarity of scenes in human brain and behavior , 2018, eLife.

[64]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Jonas Kubilius,et al.  Deep Neural Networks as a Computational Model for Human Shape Sensitivity , 2016, PLoS Comput. Biol..

[66]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[67]  Natalia Y. Bilenko,et al.  The “Parahippocampal Place Area” Responds Preferentially to High Spatial Frequencies in Humans and Monkeys , 2011, PLoS biology.

[68]  Eero P. Simoncelli,et al.  Selectivity and tolerance for visual texture in macaque V2 , 2016, Proceedings of the National Academy of Sciences.

[69]  Talia Konkle,et al.  Mid-level visual features underlie the high-level categorical organization of the ventral stream , 2018, Proceedings of the National Academy of Sciences.

[70]  Stella F. Lourenco,et al.  Skeletal representations of shape in human vision: Evidence for a pruned medial axis model , 2019, Journal of vision.

[71]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[72]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[73]  Alex R. Wade,et al.  Global shape aftereffects in composite radial frequency patterns. , 2016, Journal of vision.

[74]  Kim Nimon,et al.  An R package to compute commonality coefficients in the multiple regression case: An introduction to the package and a practical example , 2008, Behavior research methods.

[75]  Nikolaus Kriegeskorte,et al.  Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation , 2014, PLoS Comput. Biol..

[76]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[77]  George A Alvarez,et al.  Mid-level perceptual features contain early cues to animacy. , 2017, Journal of vision.

[78]  Björn Ommer,et al.  Beyond straight lines — Object detection using curvature , 2011, 2011 18th IEEE International Conference on Image Processing.

[79]  Luca Turella,et al.  Common spatiotemporal processing of visual features shapes object representation , 2018, Scientific Reports.