Inferotemporal neurons represent low-dimensional configurations of parameterized shapes

Behavioral studies with parameterized shapes have shown that the similarities among these complex stimuli can be represented using a low number of dimensions. Using psychophysical measurements and single-cell recordings in macaque inferotemporal (IT) cortex, we found an agreement between low-dimensional parametric configurations of shapes and the representation of shape similarity at the behavioral and neuronal level. The shape configurations, computed from both the perceived and neuron-based similarities, revealed a low number of dimensions and contained the same stimulus order as the parametric configurations. However, at a metric level, the behavioral and neural representations deviated consistently from the parametric configurations. These findings suggest an ordinally faithful but metrically biased representation of shape similarity in IT.

[1]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[2]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[3]  R. Shepard,et al.  Perceptual-cognitive explorations of a toroidal set of free-form stimuli , 1973 .

[4]  P. Dean,et al.  Effects of inferotemporal lesions on the behavior of monkeys. , 1976, Psychological bulletin.

[5]  R N Shepard,et al.  Multidimensional Scaling, Tree-Fitting, and Clustering , 1980, Science.

[6]  A. Wright,et al.  Pictorial similarity judgments and the organization of visual memory in the rhesus monkey. , 1982, Journal of experimental psychology. General.

[7]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[8]  A. Wright,et al.  Pictorial similarity judgments and the organization of visual memory in the rhesus monkey. , 1982, Journal of experimental psychology. General.

[9]  R. Nosofsky American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[10]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Ingwer Borg,et al.  Measuring the Similarity of MDS Configurations. , 1985, Multivariate behavioral research.

[12]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[13]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[14]  Gregory Ashby,et al.  Toward a Unified Theory of Similarity and Recognition , 1988 .

[15]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[16]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[17]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[18]  Perceptual similarity of closed contours , 1992 .

[19]  C. Gross,et al.  Neural ensemble coding in inferior temporal cortex. , 1994, Journal of neurophysiology.

[20]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[21]  Brian P. Dyre,et al.  Perceptual similarity of shapes generated from Fourier descriptors. , 1996, Journal of experimental psychology. Human perception and performance.

[22]  E. Rolls,et al.  INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[23]  Gregory Ashby,et al.  A neuropsychological theory of multiple systems in category learning. , 1998, Psychological review.

[24]  Keiji Tanaka,et al.  Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. , 1998, Journal of neurophysiology.

[25]  Shimon Edelman,et al.  Representation of objective similarity among three-dimensional shapes in the monkey , 1998, Biological Cybernetics.

[26]  S. Edelman,et al.  Representation of object similarity in human vision: psychophysics and a computational model , 1998, Vision Research.

[27]  S Edelman,et al.  Representation is representation of similarities , 1996, Behavioral and Brain Sciences.

[28]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[29]  Shimon Edelman,et al.  Representation and recognition in vision , 1999 .

[30]  R. Vogels Categorization of complex visual images by rhesus monkeys. Part 2: single‐cell study , 1999, The European journal of neuroscience.

[31]  S. Wise,et al.  Role of the Hippocampal System in Conditional Motor Learning: Mapping Antecedents to Action , 1999, Hippocampus.

[32]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[33]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[34]  T. Bussey,et al.  Role of prefrontal cortex in a network for arbitrary visuomotor mapping , 2000, Experimental Brain Research.

[35]  R. Vogels,et al.  Spatial sensitivity of macaque inferior temporal neurons , 2000, The Journal of comparative neurology.

[36]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[37]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[38]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[39]  I. Biederman,et al.  Inferior Temporal Neurons Show Greater Sensitivity to Nonaccidental than to Metric Shape Differences , 2001, Journal of Cognitive Neuroscience.

[40]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[41]  Karin Ackermann,et al.  Categories and Concepts , 2003, Job 28. Cognition in Context.