Strategies of shape representation in macaque visual area V2

Contours and surface textures provide powerful cues used in image segmentation and the analysis of object shape. To learn more about how the visual system extracts and represents these visual cues, we studied the responses of V2 neurons in awake, fixating monkeys to complex contour stimuli (angles, intersections, arcs, and circles) and texture patterns such as non-Cartesian gratings, along with conventional bars and sinusoidal gratings. Substantial proportions of V2 cells conveyed information about many contour and texture characteristics associated with our stimuli, including shape, size, orientation, and spatial frequency. However, the cells differed considerably in terms of their degree of selectivity for the various stimulus characteristics. On average, V2 cells responded better to grating stimuli but were more selective for contour stimuli. Metric multidimensional scaling and principal components analysis showed that, as a population, V2 cells show strong correlations in how they respond to different stimulus types. The first two and five principal components accounted for 69% and 85% of the overall response variation, respectively, suggesting that the response correlations simplified the population representation of shape information with relatively little loss of information. Moreover, smaller random subsets of the population carried response correlation patterns very similar to the population as a whole, indicating that the response correlations were a widespread property of V2 cells. Thus, V2 cells extract information about a number of higher order shape cues related to contours and surface textures and about similarities among many of these shape cues. This may reflect an efficient strategy of representing cues for image segmentation and object shape using finite neuronal resources.

[1]  N. Giri Multivariate Statistical Analysis : Revised And Expanded , 2003 .

[2]  R. Freeman,et al.  Stereoscopic depth processing in the visual cortex: a coarse-to-fine mechanism , 2003, Nature Neuroscience.

[3]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[4]  C. Gilbert,et al.  On a common circle: natural scenes and Gestalt rules. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[5]  G. Laurent,et al.  Dynamic optimization of odor representations by slow temporal patterning of mitral cell activity. , 2001, Science.

[6]  Refractor Vision , 2000, The Lancet.

[7]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[8]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[9]  H. Sebastian Seung,et al.  The Manifold Ways of Perception , 2000, Science.

[10]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[11]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[12]  J. Bakin,et al.  Visual Responses in Monkey Areas V1 and V2 to Three-Dimensional Surface Configurations , 2000, The Journal of Neuroscience.

[13]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[14]  Hong Zhou,et al.  Representation of stereoscopic edges in monkey visual cortex , 2000, Vision Research.

[15]  J. Hegdé,et al.  Selectivity for Complex Shapes in Primate Visual Area V2 , 2000, The Journal of Neuroscience.

[16]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[17]  P. E. Hallett,et al.  Reliability and dimensionality of judgments of visually textured materials , 2000, Perception & psychophysics.

[18]  W. Geisler,et al.  Perceptual organization of two-dimensional patterns. , 2000, Psychological review.

[19]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[20]  Terrence J. Sejnowski,et al.  Neuronal Tuning: To Sharpen or Broaden? , 1999, Neural Computation.

[21]  David J. Field Visual coding, redundancy, and “feature detection” , 1998 .

[22]  J. Taube Head direction cells and the neurophysiological basis for a sense of direction , 1998, Progress in Neurobiology.

[23]  J. Thompson,et al.  Invited commentary: Re: "Multiple comparisons and related issues in the interpretation of epidemiologic data". , 1998, American journal of epidemiology.

[24]  Diane C. Rogers-Ramachandran,et al.  Psychophysical evidence for boundary and surface systems in human vision , 1998, Vision Research.

[25]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[26]  E. Bullmore,et al.  Society for Neuroscience Abstracts , 1997 .

[27]  Anna W. Roe,et al.  The Functional Architecture of Area V2 in the Macaque Monkey , 1997 .

[28]  D. C. Essen,et al.  Neural responses to polar, hyperbolic, and Cartesian gratings in area V4 of the macaque monkey. , 1996, Journal of neurophysiology.

[29]  A. Olshan,et al.  Multiple comparisons and related issues in the interpretation of epidemiologic data. , 1995, American journal of epidemiology.

[30]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[31]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[32]  Subrata Rakshit,et al.  Information theoretic approach to space-frequency localization , 1994, Optics & Photonics.

[33]  D. V. Essen,et al.  Neural mechanisms of form and motion processing in the primate visual system , 1994, Neuron.

[34]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[35]  López del Val Ja,et al.  Principal components analysis , 1993 .

[36]  E. Peterhans,et al.  Functional Organization of Area V2 in the Alert Macaque , 1993, The European journal of neuroscience.

[37]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[38]  D. V. van Essen,et al.  Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. , 1993, Science.

[39]  T. Sejnowski,et al.  A critique of pure vision , 1993 .

[40]  David Mumford,et al.  Filtering, Segmentation and Depth , 1993, Lecture Notes in Computer Science.

[41]  A. Fuchs,et al.  Discharge patterns in nucleus prepositus hypoglossi and adjacent medial vestibular nucleus during horizontal eye movement in behaving macaques. , 1992, Journal of neurophysiology.

[42]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[43]  R. Eagleson,et al.  Measurement of the 2D affine Lie group parameters for visual motion analysis. , 1992, Spatial vision.

[44]  Pietro Perona,et al.  Deformable kernels for early vision , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[46]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[47]  J. Gentle,et al.  Randomization and Monte Carlo Methods in Biology. , 1990 .

[48]  Alan L. Yuille,et al.  Computational theories of low-level vision , 1990 .

[49]  J. Hollerbach,et al.  Visual cognition and action , 1990 .

[50]  George H. Dunteman,et al.  Principal Components Analysis , 1990 .

[51]  C. J. Huberty,et al.  Multivariate analysis versus multiple univariate analyses. , 1989 .

[52]  S Grossberg,et al.  Cortical dynamics of three-dimensional form, color, and brightness perception: II. Binocular theory , 1988, Perception & psychophysics.

[53]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[54]  S. Grossberg Cortical dynamics of three-dimensional form, color, and brightness perception: I. Monocular theory , 1987, Perception & psychophysics.

[55]  J A Morse,et al.  Analysis of variance and covariance. , 1984, Orthopedic nursing.

[56]  W. Köhler Gestalt Psychology: An Introduction to New Concepts in Modern Psychology , 1970 .

[57]  R. Sokal,et al.  THE COMPARISON OF DENDROGRAMS BY OBJECTIVE METHODS , 1962 .

[58]  P. Sneath,et al.  Numerical Taxonomy , 1962, Nature.

[59]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[60]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .