Cortical representation of medial axis structure.

The identity of an object is not only specified by its parts but also by the relations among the parts. Rearranging parts can produce a completely different object, in the same manner as rearranging the phonemes in "fur" can yield "rough." How does the visual system represent the relative positions of parts? Between-part relations can be characterized by specifying the relations between the medial axes (imaginary lines through the centers) of an object's parts. A functional magnetic resonance imaging multivoxel classification study tested whether the medial axis structure is represented in the human visual system independent of part identity and overall object orientation. Stimuli were line drawings of novel 3-part geometrical objects, which differed in the relations between their parts' medial axes (i.e., in their medial axis structures), the geons that composed each object, and the objects' orientations in plane and in depth. In regions of interest throughout visual cortex, a support vector machine classifier was trained to distinguish objects that shared either the same medial axis structures or the same orientations. By the level of V3, different medial axis structures were more accurately classified than different orientations, indicating a change in the representation of shape compared with earlier visual areas.

[1]  K. Holyoak,et al.  A symbolic-connectionist theory of relational inference and generalization. , 2003, Psychological review.

[2]  I Biederman,et al.  Neurocomputational bases of object and face recognition. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[3]  Benjamin B. Kimia,et al.  On the role of medial geometry in human vision , 2003, Journal of Physiology-Paris.

[4]  D. J. Felleman,et al.  Cortical connections of areas V3 and VP of macaque monkey extrastriate visual cortex , 1997, The Journal of comparative neurology.

[5]  Hanna Damasio,et al.  Predicting visual stimuli on the basis of activity in auditory cortices , 2010, Nature Neuroscience.

[6]  Irving Biederman,et al.  Where do objects become scenes? , 2010, Cerebral Cortex.

[7]  Y. Yamane,et al.  Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns , 2001, Nature Neuroscience.

[8]  J. Wagemans,et al.  Mental rotation versus invariant features in object perception from different viewpoints: an fMRI study , 2002, Neuropsychologia.

[9]  M. Tarr,et al.  Mental rotation and orientation-dependence in shape recognition , 1989, Cognitive Psychology.

[10]  R. Brubaker Models for the perception of speech and visual form: Weiant Wathen-Dunn, ed.: Cambridge, Mass., The M.I.T. Press, I–X, 470 pages , 1968 .

[11]  Richard G. Kurial,et al.  Representation and recognition , 1990 .

[12]  G. Aguirre,et al.  Different spatial scales of shape similarity representation in lateral and ventral LOC. , 2009, Cerebral cortex.

[13]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[14]  Irving Biederman,et al.  Predicting the psychophysical similarity of faces and non-face complex shapes by image-based measures , 2012, Vision Research.

[15]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[16]  HARRY BLUM,et al.  Shape description using weighted symmetric axis features , 1978, Pattern Recognit..

[17]  D. J. Felleman,et al.  Receptive field properties of neurons in area V3 of macaque monkey extrastriate cortex. , 1987, Journal of neurophysiology.

[18]  Martin I Sereno,et al.  Brain mapping in animals and humans , 1998, Current Opinion in Neurobiology.

[19]  Keiji Tanaka,et al.  Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. , 2007, Journal of neurophysiology.

[20]  P. Jolicoeur The time to name disoriented natural objects , 1985, Memory & cognition.

[21]  Manabu Tanifuji,et al.  Representation of the spatial relationship among object parts by neurons in macaque inferotemporal cortex. , 2006, Journal of neurophysiology.

[22]  Edward F. Ester,et al.  Spatially Global Representations in Human Primary Visual Cortex during Working Memory Maintenance , 2009, The Journal of Neuroscience.

[23]  I. Biederman,et al.  What makes faces special? , 2006, Vision Research.

[24]  S. Zeki,et al.  Colour coding in rhesus monkey prestriate cortex. , 1973, Brain research.

[25]  Jeremy Freeman,et al.  Orientation Decoding Depends on Maps, Not Columns , 2011, The Journal of Neuroscience.

[26]  Z. Kourtzi,et al.  Neural coding of global form in the human visual cortex. , 2008, Journal of neurophysiology.

[27]  Andrew T. Smith,et al.  The confounding effect of response amplitude on MVPA performance measures , 2011, NeuroImage.

[28]  Sabine Kastner,et al.  The functional neuroanatomy of object agnosia: A case study , 2010 .

[29]  N. Kanwisher,et al.  Discrimination Training Alters Object Representations in Human Extrastriate Cortex , 2006, The Journal of Neuroscience.

[30]  I Biederman,et al.  To what extent can matching algorithms based on direct outputs of spatial filters account for human object recognition? , 1996, Spatial vision.

[31]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[32]  Isabel Gauthier,et al.  Dissociating viewpoint costs in mental rotation and object recognition , 2010 .

[33]  C. Connor,et al.  Shape representation in area V4: position-specific tuning for boundary conformation. , 2001, Journal of neurophysiology.

[34]  Donald D. Hoffman,et al.  Salience of visual parts , 1997, Cognition.

[35]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[36]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[37]  N. Kanwisher,et al.  Only some spatial patterns of fMRI response are read out in task performance , 2007, Nature Neuroscience.

[38]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[39]  C. Connor,et al.  Population coding of shape in area V4 , 2002, Nature Neuroscience.

[40]  Jiye G. Kim,et al.  Adaptation in the fusiform face area (FFA): Image or person? , 2009, Vision Research.

[41]  I. Biederman,et al.  Shape Tuning in Macaque Inferior Temporal Cortex , 2003, The Journal of Neuroscience.

[42]  Tamal K. Dey,et al.  Defining and computing curve-skeletons with medial geodesic function , 2006, SGP '06.

[43]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[44]  Charles E Connor,et al.  Underlying principles of visual shape selectivity in posterior inferotemporal cortex , 2004, Nature Neuroscience.

[45]  J. Gallant,et al.  Natural Stimulus Statistics Alter the Receptive Field Structure of V1 Neurons , 2004, The Journal of Neuroscience.

[46]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[47]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[48]  Isabel Gauthier,et al.  BOLD Activity during Mental Rotation and Viewpoint-Dependent Object Recognition , 2002, Neuron.

[49]  B. Tversky,et al.  Objects, parts, and categories. , 1984 .

[50]  W. Hayward Effects of outline shape in object recognition , 1998 .

[51]  D. C. Essen,et al.  Neurons in monkey visual area V2 encode combinations of orientations , 2007, Nature Neuroscience.

[52]  Raymond J. Dolan,et al.  fMRI Activity Patterns in Human LOC Carry Information about Object Exemplars within Category , 2008, Journal of Cognitive Neuroscience.

[53]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[54]  S Thesen,et al.  Prospective acquisition correction for head motion with image‐based tracking for real‐time fMRI , 2000, Magnetic resonance in medicine.

[55]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[56]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[57]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[58]  J. B. Levitt,et al.  Functional properties of neurons in macaque area V3. , 1997, Journal of neurophysiology.

[59]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[60]  Raul Rodriguez-Esteban,et al.  Global optimization of cerebral cortex layout. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[61]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[62]  Stefan Pollmann,et al.  Neuroinformatics Original Research Article Pymvpa: a Unifying Approach to the Analysis of Neuroscientifi C Data , 2022 .

[63]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[64]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[65]  M. Farah,et al.  Distinct Patterns of Viewpoint-Dependent BOLD Activity during Common-Object Recognition and Mental Rotation , 2006, Perception.

[66]  I. Biederman,et al.  Tuning for shape dimensions in macaque inferior temporal cortex , 2005, The European journal of neuroscience.

[67]  R. Savoy Functional Magnetic Resonance Imaging (fMRI) , 2002 .

[68]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[69]  Johan Wagemans,et al.  Perceived Shape Similarity among Unfamiliar Objects and the Organization of the Human Object Vision Pathway , 2008, The Journal of Neuroscience.

[70]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[71]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[72]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[73]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[74]  H. D. Peters The Wechsler Intelligence Scale for Children Revised: A Review. , 1975 .

[75]  M. Behrmann,et al.  Independent representation of parts and the relations between them: evidence from integrative agnosia. , 2006, Journal of experimental psychology. Human perception and performance.

[76]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[77]  I. Biederman,et al.  Priming contour-deleted images: Evidence for intermediate representations in visual object recognition , 1991, Cognitive Psychology.

[78]  Manish Singh,et al.  Bayesian estimation of the shape skeleton , 2010 .

[79]  I. Biederman,et al.  Neural encoding of relative position. , 2011, Journal of experimental psychology. Human perception and performance.

[80]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[81]  Deborah Silver,et al.  Curve-Skeleton Properties, Applications, and Algorithms , 2007, IEEE Trans. Vis. Comput. Graph..

[82]  I. Biederman,et al.  Neural evidence for intermediate representations in object recognition , 2006, Vision Research.

[83]  D. Chklovskii,et al.  Maps in the brain: what can we learn from them? , 2004, Annual review of neuroscience.