Neural Dynamics of Perceptual Grouping: Textures, Boundaries, And Emergent Segmentations

A real-time visual processing theory is used to analyse and explain a wide variety of perceptual grouping and segmentation phenomena, including the grouping of textured images, randomly defined images, and images built up from periodic scenic elements. The theory explains how “local” feature processing and “emergent” features work together to segment a scene, how segmentations may arise across image regions which do not contain any luminance differences, how segmentations may override local image properties in favor of global statistical factors, and why segmentations that powerfully influence object recognition may be barely visible or totally invisible. Network interactions within a Boundary Contour System (BCS), a Feature Contour System (FCS), and an Object Recognition System (ORS) are used to explain these phenomena. The BCS is defined by a hierarchy of orientationally tuned interactions, which can be divided into two successive subsystems, called the OC Filter and the CC Loop. The OC Filter contains two successive stages of oriented receptive fields which are sensitive to different properties of image contrasts. The OC Filter generates inputs to the CC Loop, which contains successive stages of spatially short-range competitive interactions and spatially long-range cooperative interactions. Feedback between the competitive and cooperative stages synthesizes a global context-sensitive segmentation from among the many possible groupings of local featural elements. The properties of the BCS provide a unified explanation of several ostensibly different Gestalt rules. The BCS also suggests explanations and predictions concerning the architecture of the striate and prestriate visual cortices. The BCS embodies new ideas concerning the foundations of geometry, on-line statistical decision theory, and the resolution of uncertainty in quantum measurement systems. Computer simulations establish the formal competence of the BCS as a perceptual grouping system. The properties of the BCS are compared with probabilistic and artificial intelligence models of segmentation. The total network suggests a new approach to the design of computer vision systems, and promises to provide a universal set of rules for perceptual grouping of scenic edges, textures, and smoothly shaded regions.

[1]  P. Dodwell.  The Lie transformation group model of visual perception , 1983, Perception & psychophysics.

[2]  B Julesz,et al.  Psychophysical evidence for global feature processing in visual texture discrimination. , 1979, Journal of the Optical Society of America.

[3]  K. Prazdny.  On the nature of inducing forms generating perceptions of illusory contours , 1985, Perception & psychophysics.

[4]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[5]  J Gordon,et al.  Nonlinearity in the perception of form , 1985, Perception & psychophysics.

[6]  J. Krauskopf.  Effect of retinal image stabilization on the appearance of heterochromatic targets. , 1963, Journal of the Optical Society of America.

[7]  R. Desimone,et al.  Shape recognition and inferior temporal neurons. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[8]  T Caelli.  Energy processing and coding factors in texture discrimination and image processing , 1983, Perception & psychophysics.

[9]  K Prazdny,et al.  Illusory contours are not caused by simultaneous brightness contrast , 1983, Perception & psychophysics.

[10]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  S Grossberg,et al.  Neural dynamics of brightness perception: Features, boundaries, diffusion, and resonance , 1984, Perception & Psychophysics.

[12]  J. Beck.  Similarity grouping and peripheral discriminability under uncertainty. , 1972, The American journal of psychology.

[13]  G. Sperling.  Binocular Vision: A Physical and a Neural Theory , 1970 .

[14]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  L. Glass,et al.  Pattern Recognition in Humans: Correlations Which Cannot be Perceived , 1976, Perception.

[16]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[17]  N. Kawabata.  Perception at the blind spot and similarity grouping , 1984, Perception & psychophysics.

[18]  K Prazdny,et al.  On the Perception of Glass Patterns , 1984, Perception.

[19]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985 .

[20]  C. Redies,et al.  The neon color effect in the ehrenstein pattern Dependence on wavelength and illuminance , 1984, Vision Research.

[21]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[22]  T Caelli,et al.  On discriminating visual textures and images , 1982, Perception & psychophysics.

[23]  S. Zeki.  Colour coding in the cerebral cortex: The reaction of cells in monkey visual cortex to wavelengths and colours , 1983, Neuroscience.

[24]  Stephen Grossberg,et al.  The Qijantized Geometry of Visual Space: The Coherent Computation of Depth, Form and Lightness , 1987 .

[25]  Max Wertheimer,et al.  Untersuchungen zur Lehre von der Gestalt , .

[26]  L. Spillmann,et al.  Colored neon flanks and line gap enhancement , 1984, Vision Research.

[27]  R. Gregory,et al.  Border Locking and the Café Wall Illusion , 1979, Perception.

[28]  M. McCourt.  Brightness Induction and the Café Wall Illusion , 1983, Perception.

[29]  H. V. Tuijl,et al.  A new visual illusion: Neonlike color spreading and complementary color induction between subjective contours , 1975 .

[30]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[31]  H. V. Tuijl,et al.  Neon color spreading and structural information measures , 1979, Perception & psychophysics.

[32]  S. Zeki.  Colour coding in the cerebral cortex: The responses of wavelength-selective and colour-coded cells in monkey visual cortex to changes in wavelength composition , 1983, Neuroscience.

[33]  T Caelli,et al.  The discrimination of structure in vectorgraphs: Local and global effects , 1982, Perception & psychophysics.

[34]  B. Julesz.  Binocular depth perception of computer-generated patterns , 1960 .

[35]  George A. Kaplan,et al.  Kinetic disruption of optical texture: The perception of depth at an edge , 1969 .

[36]  H. V. Tuijl,et al.  Sensory Conditions for the Occurrence of the Neon Spreading Illusion , 1979 .

[37]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[38]  J. Beck.  Perceptual Grouping Produced by Changes in Orientation and Shape , 1966, Science.

[39]  S Grossberg,et al.  Some developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks. , 1975, Journal of theoretical biology.

[40]  L. Spillmann,et al.  The Neon Color Effect in the Ehrenstein Illusion , 1981, Perception.

[41]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[42]  S. Grossberg.  How does a brain build a cognitive code , 1980 .

[43]  Leslie G. Ungerleider,et al.  Contour, color and shape analysis beyond the striate cortex , 1985, Vision Research.

[44]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[45]  W. Hoffman.  Higher visual perception as prolongation of the basic lie transformation group , 1970 .

[46]  Parvati Dev,et al.  Perception of Depth Surfaces in Random-Dot Stereograms: A Neural Model , 1975, Int. J. Man Mach. Stud..

[47]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[48]  J. Wolfe.  Global Factors in the Hermann Grid Illusion , 1984, Perception.