Pre-attentive segmentation in the primary visual cortex.

The activities of neurons in primary visual cortex have been shown to be significantly influenced by stimuli outside their classical receptive fields. We propose that these contextual influences serve pre-attentive visual segmentation by causing relatively higher neural responses to important or conspicuous image locations, making them more salient for perceptual pop-out. These locations include boundaries between regions, smooth contours, and pop-out targets against backgrounds. The mark of these locations is the breakdown of spatial homogeneity in the input. for instance, at the border between two texture regions of equal mean luminance. This breakdown causes changes in contextual influences, often resulting in higher responses at the border than at surrounding locations. This proposal is implemented in a biologically based model of VI in which contextual influences are mediated by intra-cortical horizontal connections. The behavior of the model is demonstrated using examples of texture segmentation, figure-ground segregation, target-distractor asymmetry, and contour enhancement, and is compared with psychophysical and physiological data. The model predicts (1) how neural responses should be tuned to the orientation of nearby texture borders, (2) a set of qualitative constraints on the structure of the intracortical connections, and (3) stimulus-dependent biases in estimating the locations of the region borders by pre-attentive vision.

[1]  D. Fitzpatrick.  The functional organization of local circuits in visual cortex: insights from the study of tree shrew striate cortex. , 1996, Cerebral cortex.

[2]  D. V. van Essen,et al.  Response modulation by texture surround in primate area V1: Correlates of “popout” under anesthesia , 1999, Visual Neuroscience.

[3]  Terry Caelli,et al.  An adaptive computational model for texture segmentation , 1988, IEEE Trans. Syst. Man Cybern..

[4]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[5]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[6]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jack L. Gallant,et al.  Two-dimensional and three-dimensional texture processing in visual cortex of the macaque monkey , 1995 .

[8]  T. Wiesel,et al.  Clustered intrinsic connections in cat visual cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  David C. Somers,et al.  Vector-based Integration of Local and Long-range Information in Visual Cortex , 1995 .

[10]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[11]  J. B. Levitt,et al.  Contrast dependence of contextual effects in primate visual cortex , 1997, nature.

[12]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[13]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[14]  Li Zhaoping.  Visual segmentation without classification: A proposed function for primary visual cortex , 1998 .

[15]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Zhaoping Li.  A V1 Model of Pop Out and Asymmetty in Visual Search , 1998, NIPS.

[17]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[18]  J. Wolfe,et al.  Visual search for oriented lines: the role of angular relations between targets and distractors. , 1992, Spatial vision.

[19]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[20]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[21]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[22]  C. Li,et al.  Extensive integration field beyond the classical receptive field of cat's striate cortical neurons--classification and tuning properties. , 1994, Vision research.

[23]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[24]  T. Wiesel,et al.  The influence of contextual stimuli on the orientation selectivity of cells in primary visual cortex of the cat , 1990, Vision Research.

[25]  Ruxandra Sireteanu,et al.  Texture segregation in infants and children , 1992, Behavioural Brain Research.

[26]  D. Fitzpatrick,et al.  Patterns of excitation and inhibition evoked by horizontal connections in visual cortex share a common relationship to orientation columns , 1995, Neuron.

[27]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[28]  M. Landy,et al.  Discrimination of orientation-defined texture edges , 1995, Vision Research.

[29]  C. Gilbert,et al.  Synaptic physiology of horizontal connections in the cat's visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  Hans-Christoph Nothdurft,et al.  Different approaches to the coding of visual segmentation , 1997 .

[31]  K. M. Wong.  Primary Cortical Dynamics for Visual Grouping , 1998 .

[32]  U. Polat,et al.  Lateral interactions between spatial channels: Suppression and facilitation revealed by lateral masking experiments , 1993, Vision Research.

[33]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[34]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[35]  T. S. Lee,et al.  A Bayesian framework for understanding texture segmentation in the primary visual cortex , 1995, Vision Research.

[36]  J. Maunsell,et al.  Visual effects of lesions of cortical area V2 in macaques , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[38]  S Grossberg,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985, Perception & psychophysics.

[39]  I Kovács,et al.  A closed curve is much more than an incomplete one: effect of closure in figure-ground segmentation. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[40]  E. White.  Cortical Circuits , 1989, Birkhäuser Boston.

[41]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[42]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[43]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[44]  U Polat,et al.  Spatial interactions in human vision: from near to far via experience-dependent cascades of connections. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[45]  M Stemmler,et al.  Lateral interactions in primary visual cortex: a model bridging physiology and psychophysics. , 1995, Science.

[46]  H. Meinhardt.  Models of biological pattern formation , 1982 .

[47]  H C Nothdurft,et al.  Common properties of visual segmentation. , 1994, Ciba Foundation symposium.

[48]  Shimon Ullman.  Sequence Seeking and Counterstreams: A Model for Bidirectional Information Flow in the Cortex , 1995 .

[49]  C T Scialfa,et al.  Preferential processing of target features in texture segmentation , 1995, Perception & psychophysics.

[50]  T Caelli.  Texture classification and segmentation algorithms in man and machines. , 1993, Spatial vision.

[51]  Gregory Bock,et al.  Higher-order processing in the visual system , 1994 .

[52]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[53]  H. Nothdurft.  Sensitivity for structure gradient in texture discrimination tasks , 1985, Vision Research.

[54]  D. G. Albrecht,et al.  Striate cortex of monkey and cat: contrast response function. , 1982, Journal of neurophysiology.

[55]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[56]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[57]  S. Kastner,et al.  Neuronal Correlates of Pop-out in Cat Striate Cortex , 1997, Vision Research.

[58]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[59]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[60]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[61]  C. Gilbert.  Horizontal integration and cortical dynamics , 1992, Neuron.

[62]  Ulf Grenander.  Regular structures , 1981, Lectures in pattern theory / U. Grenander.

[63]  W. D. Ross,et al.  Visual brain and visual perception: how does the cortex do perceptual grouping? , 1997, Trends in Neurosciences.

[64]  D Sagi,et al.  Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[65]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[66]  Victor A. F. Lamme.  The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  E. Todorov,et al.  Vector-space integration of local and long-range information in visual cortex 7 , 1995 .

[68]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[69]  H. C. Nothdurft,et al.  Texture segmentation and pop-out from orientation contrast , 1991, Vision Research.

[70]  R. Browse,et al.  Asymmetries in visual texture discrimination. , 1989, Spatial vision.

[71]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..