FigureGround Segregation in a Recurrent Network Architecture

Here we propose a model of how the visual brain segregates textured scenes into figures and background. During texture segregation, locations where the properties of texture elements change abruptly are assigned to boundaries, whereas image regions that are relatively homogeneous are grouped together. Boundary detection and grouping of image regions require different connection schemes, which are accommodated in a single network architecture by implementing them in different layers. As a result, all units carry signals related to boundary detection as well as grouping of image regions, in accordance with cortical physiology. Boundaries yield an early enhancement of network responses, but at a later point, an entire figural region is grouped together, because units that respond to it are labeled with enhanced activity. The model predicts which image regions are preferentially perceived as figure or as background and reproduces the spatio-temporal profile of neuronal activity in the visual cortex during texture segregation in intact animals, as well as in animals with cortical lesions.

[1]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[2]  Walter Gerbino,et al.  Convexity and Symmetry in Figure-Ground Organization , 1976 .

[3]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[4]  S. Zeki The representation of colours in the cerebral cortex , 1980, Nature.

[5]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[6]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[7]  S Grossberg,et al.  Neural dynamics of brightness perception: Features, boundaries, diffusion, and resonance , 1984, Perception & Psychophysics.

[8]  S. Ullman Visual routines , 1984, Cognition.

[9]  S. L. Tanimoto,et al.  Image Processing with Hierarchical Cellular Logic , 1985 .

[10]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[11]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[12]  T. Caelli Three processing characteristics of visual texture segmentation. , 1985, Spatial vision.

[13]  K. Tanaka,et al.  Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  田中 啓治 Analysis of Local and Wide-Field Movements in the Superior Temporal Visual Areas of the Macaque Monkey , 1987 .

[15]  Kunihiko Fukushima,et al.  A neural network for visual pattern recognition , 1988, Computer.

[16]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[17]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[18]  G. Orban,et al.  Laminar analysis of motion information processing in macaque V5 , 1989, Brain Research.

[19]  L. Finkel,et al.  Integration of distributed cortical systems by reentry: a computer simulation of interactive functionally segregated visual areas , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  G. Moraglia,et al.  Display organization and the detection of horizontal line segments , 1989, Perception & psychophysics.

[21]  R. Desimone,et al.  Spectral properties of V4 neurons in the macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[23]  I. Rock,et al.  The legacy of Gestalt psychology. , 1990, Scientific American.

[24]  M. Peterson,et al.  Shape recognition contributions to figure-ground reversal: which route counts? , 1991, Journal of experimental psychology. Human perception and performance.

[25]  H. Nothdurft Feature analysis and the role of similarity in preattentive vision , 1992, Perception & psychophysics.

[26]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[27]  J. Theeuwes Perceptual selectivity for color and form , 1992, Perception & psychophysics.

[28]  J. Maunsell,et al.  Visual effects of lesions of cortical area V2 in macaques , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  S. Grossberg,et al.  Neural dynamics of motion perception: Direction fields, apertures, and resonant grouping , 1993, Perception & psychophysics.

[31]  R. Born,et al.  Segregation of global and local motion processing in primate middle temporal visual area , 1993, Nature.

[32]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[33]  E. Vandenbussche,et al.  Two stages in visual texture segregation: a lesion study in the cat , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  S Grossberg,et al.  3-D vision and figure-ground separation by visual cortex , 2010, Perception & psychophysics.

[35]  B. Gibson Visual attention and objects: one versus two or convex versus concave? , 1994, Journal of experimental psychology. Human perception and performance.

[36]  J. Bullier,et al.  Visual latencies in areas V1 and V2 of the macaque monkey , 1995, Visual Neuroscience.

[37]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[38]  Victor A. F. Lamme The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.

[40]  M Stemmler,et al.  Lateral interactions in primary visual cortex: a model bridging physiology and psychophysics. , 1995, Science.

[41]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[42]  W. Merigan,et al.  Basic visual capacities and shape discrimination after lesions of extrastriate area V4 in macaques , 1996, Visual Neuroscience.

[43]  A. Burkhalter,et al.  Different Balance of Excitation and Inhibition in Forward and Feedback Circuits of Rat Visual Cortex , 1996, The Journal of Neuroscience.

[44]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[45]  Leslie G. Ungerleider,et al.  Cue-dependent deficits in grating orientation discrimination after V4 lesions in macaques , 1996, Visual Neuroscience.

[46]  S. Kastner,et al.  Neuronal Correlates of Pop-out in Cat Striate Cortex , 1997, Vision Research.

[47]  Stephen Grossberg,et al.  Neural dynamics of motion grouping: from aperture ambiguity to object speed and direction , 1997 .

[48]  G A Orban,et al.  Functional impact of cerebral connections. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[49]  C. Koch,et al.  Constraints on cortical and thalamic projections: the no-strong-loops hypothesis , 1998, Nature.

[50]  Victor A. F. Lamme,et al.  Feedforward, horizontal, and feedback processing in the visual cortex , 1998, Current Opinion in Neurobiology.

[51]  R. O’Reilly,et al.  Figure-ground organization and object recognition processes: an interactive account. , 1998, Journal of experimental psychology. Human perception and performance.

[52]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[53]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[54]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[55]  S. Grossberg The Link between Brain Learning, Attention, and Consciousness , 1999, Consciousness and Cognition.

[56]  Rodney J. Douglas,et al.  Feedback interactions between neuronal pointers and maps for attentional processing , 1999, Nature Neuroscience.

[57]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[58]  Victor A. F. Lamme,et al.  Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the macaque monkey. , 1999, Cerebral cortex.

[59]  Z Li,et al.  Contextual influences in V1 as a basis for pop out and asymmetry in visual search. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[61]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[62]  H. A. Pham,et al.  Perceptual deficits after lesions of inferotemporal cortex in macaques. , 2000, Cerebral cortex.

[63]  C. Gilbert,et al.  Spatial distribution of contextual interactions in primary visual cortex and in visual perception. , 2000, Journal of neurophysiology.

[64]  J. Bullier,et al.  Response modulations by static texture surround in area V1 of the macaque monkey do not depend on feedback connections from V2. , 2001, Journal of neurophysiology.

[65]  F. Hamker A dynamic model of how feature cues guide spatial attention , 2004, Vision Research.