Toward direct visualization of the internal shape representation space by fMRI

Reports of columnar organization of the macaque inferotemporal cortex (Tanaka, 1992, 1993a) indicate that ensembles of cells responding to particular objects may be both sufficiently extensive and properly localized to allow their detection and discrimination by means of functional magnetic resonance imaging (fMRI). A recently developed theory of object representation by ensembles of coarsely tuned units (Edelman, 1998; Edelman & Duvdevani-Bar, 1997b) and its implementation as a computer model of recognition and categorization (Cutzu & Edelman, 1998; Edelman & Duvdevani-Bar, 1997a) provide a computational framework in which such findings can be interpreted in a straightforward fashion. Taken together, these developments in the study of object representation and recognition suggest that direct visualization of the internal representations may be easier than was previously thought. In this paper, we show how fMRI techniques can be used to investigate the internal representation of objects in the human visual cortex. Our initial results reveal that the activation of most voxels in object-related areas remains unaffected by a coarse scrambling of the natural images used as stimuli and that a map of the representation space of object categories in individual subjects can be derived from the distributed pattern of voxel activation in those areas.

[1]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[2]  R. Shepard.  The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[3]  R. D. Middlebrook.  Differential amplifiers , 1963 .

[4]  J. Kruskal.  Nonmetric multidimensional scaling: A numerical method , 1964 .

[5]  R. Shepard,et al.  Second-order isomorphism of internal representations: Shapes of states ☆ , 1970 .

[6]  Amnon Rapoport,et al.  Structures in the subjective lexicon , 1971 .

[7]  R. Shepard,et al.  Perceptual-cognitive explorations of a toroidal set of free-form stimuli , 1973 .

[8]  M. P. Friedman,et al.  HANDBOOK OF PERCEPTION , 1977 .

[9]  Steven W. Keele,et al.  Mechanisms of Attention. , 1978 .

[10]  R N Shepard,et al.  Multidimensional Scaling, Tree-Fitting, and Clustering , 1980, Science.

[11]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[12]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[13]  H. Spitzer,et al.  Increased attention enhances both behavioral and neuronal performance. , 1988, Science.

[14]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[15]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[16]  R. Grieve,et al.  Impact Cratering on the Earth , 1990 .

[17]  R. Barlow,et al.  What the brain tells the eye. , 1990, Scientific American.

[18]  T. Poggio.  A theory of how the brain might work. , 1990, Cold Spring Harbor symposia on quantitative biology.

[19]  Thomas D Albright.  Motion perception and the mind-body problem , 1991, Current Biology.

[20]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Minami Ito,et al.  Columns for visual features of objects in monkey inferotemporal cortex , 1992, Nature.

[22]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[23]  James M. Brown,et al.  Visual search for simple volumetric shapes , 1992, Perception & psychophysics.

[24]  Keiji Tanaka.  Inferotemporal cortex and higher visual functions , 1992, Current Opinion in Neurobiology.

[25]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[26]  R. Desimone,et al.  Activity of neurons in anterior inferior temporal cortex during a short- term memory task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[28]  K. Tanaka.  Column structure of inferotemporal cortex: "visual alphabet" or "differential amplifiers"? , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[29]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[30]  K. Jöreskog,et al.  Applied Factor Analysis in the Natural Sciences. , 1997 .

[31]  T. Allison,et al.  Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. , 1994, Cerebral cortex.

[32]  Leslie G. Ungerleider,et al.  The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  S. Edelman,et al.  Computational Approaches to Shape Constancy , 1994 .

[34]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[35]  N. Logothetis,et al.  View-dependent object recognition by monkeys , 1994, Current Biology.

[36]  D. Perrett,et al.  Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. , 1994, Cerebral cortex.

[37]  T. Allison,et al.  Face recognition in human extrastriate cortex. , 1994, Journal of neurophysiology.

[38]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[39]  Shimon Edelman,et al.  Representation of Similarity in Three-Dimensional Object Discrimination , 1995, Neural Computation.

[40]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[41]  S. Edelman.  Representation of Similarity in 3D Object Discrimination , 1995 .

[42]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[43]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[44]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Keiji Tanaka,et al.  Optical Imaging of Functional Organization in the Monkey Inferotemporal Cortex , 1996, Science.

[46]  A. Dale,et al.  New images from human visual cortex , 1996, Trends in Neurosciences.

[47]  Josh H. McDermott,et al.  Functional imaging of human visual recognition. , 1996, Brain research. Cognitive brain research.

[48]  S E Petersen,et al.  Detection of cortical activation during averaged single trials of a cognitive task using functional magnetic resonance imaging. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[49]  S Edelman,et al.  Faithful representation of similarities among three-dimensional shapes in human vision. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[51]  E. DeYoe,et al.  Mapping striate and extrastriate visual areas in human cerebral cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Leslie G. Ungerleider,et al.  Neural correlates of category-specific knowledge , 1996, Nature.

[53]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[54]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[55]  David L. Sheinberg,et al.  Visual object recognition. , 1996, Annual review of neuroscience.

[56]  S Edelman,et al.  A model of visual recognition and categorization. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[57]  S. Edelman,et al.  Computational Theories of Object Recognition Edelman -computation and Object Recognition Ii Box 1. Structural Descriptions ~ 7~ Recognition by Components Varieties of Alignment Multidimensional Histograms Approximation in Feature Space , 2022 .

[58]  Shimon Edelman,et al.  Similarity, Connectionism, and the Problem of Representation in Vision , 1997, Neural Computation.

[59]  Keiji Tanaka.  Mechanisms of visual object recognition: monkey and human studies , 1997, Current Opinion in Neurobiology.

[60]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[61]  J. Mazziotta,et al.  A Locus in Human Extrastriate Cortex for Visual Shape Analysis , 1997, Journal of Cognitive Neuroscience.

[62]  Hilary Buxton,et al.  A similarity-based method for the generalization of face recognition over pose and expression , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[63]  S. Edelman,et al.  Human Brain Mapping 6:316–328(1998) � A Sequence of Object-Processing Stages Revealed by fMRI in the Human Occipital Lobe , 2022 .

[64]  Shimon Edelman,et al.  Representation of objective similarity among three-dimensional shapes in the monkey , 1998, Biological Cybernetics.

[65]  A. O'Toole,et al.  Stimulus-specific effects in face recognition over changes in viewpoint , 1998, Vision Research.

[66]  S. Edelman,et al.  Representation of object similarity in human vision: psychophysics and a computational model , 1998, Vision Research.

[67]  S Edelman,et al.  Representation is representation of similarities , 1996, Behavioral and Brain Sciences.