Visual segmentation by contextual influences via intra-cortical interactions in the primary visual cortex.

Stimuli outside classical receptive fields have been shown to exert a significant influence over the activities of neurons in the primary visual cortex. We propose that contextual influences are used for pre-attentive visual segmentation. The difference between contextual influences near and far from region boundaries makes neural activities near region boundaries higher than elsewhere, making boundaries more salient for perceptual pop-out. The cortex thus computes global region boundaries by detecting the breakdown of homogeneity or translation invariance in the input, using local intra-cortical interactions mediated by the horizontal connections. This proposal is implemented in a biologically based model of V1, and demonstrated using examples of texture segmentation and figure-ground segregation. The model is also the first that performs texture or region segmentation in exactly the same neural circuit that solves the dual problem of the enhancement of contours, as is suggested by experimental observations. The computational framework in this model is simpler than previous approaches, making it implementable by V1 mechanisms, though higher-level visual mechanisms are needed to refine its output. However, it easily handles a class of segmentation problems that are known to be tricky. Its behaviour is compared with psycho-physical and physiological data on segmentation, contour enhancement, contextual influences and other phenomena such as asymmetry in visual search.

[1]  Z Li,et al.  Pre-attentive segmentation in the primary visual cortex. , 1998, Spatial vision.

[2]  H. C. Nothdurft,et al.  Texture segmentation and pop-out from orientation contrast , 1991, Vision Research.

[3]  G. Shepherd The Synaptic Organization of the Brain , 1979 .

[4]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[5]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[7]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[8]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[9]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[10]  D Sagi,et al.  Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[11]  D. Fitzpatrick The functional organization of local circuits in visual cortex: insights from the study of tree shrew striate cortex. , 1996, Cerebral cortex.

[12]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[13]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[14]  H. Nothdurft Sensitivity for structure gradient in texture discrimination tasks , 1985, Vision Research.

[15]  Victor A. F. Lamme The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[17]  David C. Somers,et al.  Vector-based Integration of Local and Long-range Information in Visual Cortex , 1995 .

[18]  Peter Dayan,et al.  Computational Differences between Asymmetrical and Symmetrical Networks , 1998, NIPS.

[19]  U. Polat,et al.  Lateral interactions between spatial channels: Suppression and facilitation revealed by lateral masking experiments , 1993, Vision Research.

[20]  Peter Sollich,et al.  Advances in neural information processing systems 11 , 1999 .

[21]  Zhaoping Li A V1 Model of Pop Out and Asymmetty in Visual Search , 1998, NIPS.

[22]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[23]  T. Wiesel,et al.  The influence of contextual stimuli on the orientation selectivity of cells in primary visual cortex of the cat , 1990, Vision Research.

[24]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[25]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[26]  Leif H. Finkel,et al.  Salient Contour Extraction by Temporal Binding in a Cortically-based Network , 1996, NIPS.

[27]  H. Meinhardt Models of biological pattern formation , 1982 .

[28]  Michael J. Hawken,et al.  Macaque VI neurons can signal ‘illusory’ contours , 1993, Nature.

[29]  H. Blum Biological shape and visual science. I. , 1973, Journal of theoretical biology.

[30]  M Stemmler,et al.  Lateral interactions in primary visual cortex: a model bridging physiology and psychophysics. , 1995, Science.

[31]  Ruxandra Sireteanu,et al.  Texture segregation in infants and children , 1992, Behavioural Brain Research.

[32]  C. Li,et al.  Extensive integration field beyond the classical receptive field of cat's striate cortical neurons--classification and tuning properties. , 1994, Vision research.

[33]  C. Gilbert,et al.  Synaptic physiology of horizontal connections in the cat's visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Steven W. Zucker,et al.  Two Stages of Curve Detection Suggest Two Styles of Visual Computation , 1989, Neural Computation.

[35]  J. B. Levitt,et al.  Contrast dependence of contextual effects in primate visual cortex , 1997, nature.

[36]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[37]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[38]  T. S. Lee,et al.  A Bayesian framework for understanding texture segmentation in the primary visual cortex , 1995, Vision Research.

[39]  W. D. Ross,et al.  Visual brain and visual perception: how does the cortex do perceptual grouping? , 1997, Trends in Neurosciences.

[40]  K. M. Wong Primary Cortical Dynamics for Visual Grouping , 1998 .

[41]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[42]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Jack L. Gallant,et al.  Two-dimensional and three-dimensional texture processing in visual cortex of the macaque monkey , 1995 .

[44]  S Grossberg,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985, Perception & psychophysics.

[45]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[46]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[47]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[48]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  C. Gilbert Horizontal integration and cortical dynamics , 1992, Neuron.

[50]  D. Fitzpatrick,et al.  Patterns of excitation and inhibition evoked by horizontal connections in visual cortex share a common relationship to orientation columns , 1995, Neuron.

[51]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[52]  M. Landy,et al.  Discrimination of orientation-defined texture edges , 1995, Vision Research.

[53]  H C Nothdurft,et al.  Common properties of visual segmentation. , 1994, Ciba Foundation symposium.

[54]  Shimon Ullman Sequence Seeking and Counterstreams: A Model for Bidirectional Information Flow in the Cortex , 1995 .

[55]  C T Scialfa,et al.  Preferential processing of target features in texture segmentation , 1995, Perception & psychophysics.

[56]  J. Maunsell,et al.  Visual effects of lesions of cortical area V2 in macaques , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  I Kovács,et al.  A closed curve is much more than an incomplete one: effect of closure in figure-ground segmentation. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[58]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[59]  U Polat,et al.  Spatial interactions in human vision: from near to far via experience-dependent cascades of connections. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[60]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[61]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[62]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[63]  E. Todorov,et al.  Vector-space integration of local and long-range information in visual cortex 7 , 1995 .

[64]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[65]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[66]  H. Blum Biological shape and visual science (part I) , 1973 .

[67]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[68]  T. Wiesel,et al.  Clustered intrinsic connections in cat visual cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.