Edge co-occurrence in natural images predicts contour grouping performance

The human brain manages to correctly interpret almost every visual image it receives from the environment. Underlying this ability are contour grouping mechanisms that appropriately link local edge elements into global contours. Although a general view of how the brain achieves effective contour grouping has emerged, there have been a number of different specific proposals and few successes at quantitatively predicting performance. These previous proposals have been developed largely by intuition and computational trial and error. A more principled approach is to begin with an examination of the statistical properties of contours that exist in natural images, because it is these statistics that drove the evolution of the grouping mechanisms. Here we report measurements of both absolute and Bayesian edge co-occurrence statistics in natural images, as well as human performance for detecting natural-shaped contours in complex backgrounds. We find that contour detection performance is quantitatively predicted by a local grouping rule derived directly from the co-occurrence statistics, in combination with a very simple integration rule (a transitivity rule) that links the locally grouped contour elements into longer contours.

[1]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989, Psychological review.

[2]  D. C. Beardslee,et al.  Readings in perception , 1958 .

[3]  D. Foster,et al.  Multiple orientation-selective mechanisms for line-target detection , 1998 .

[4]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[5]  J. Beck,et al.  Line segregation. , 1989, Spatial vision.

[6]  Suzanne P. McKee,et al.  Constraints on long range interactions mediating contour detection , 1998, Vision Research.

[7]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[8]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[9]  G. Buchsbaum,et al.  Chromaticity coordinates of frequency-limited functions. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[10]  G Westheimer,et al.  Dynamics of spatial summation in primary visual cortex of alert monkeys. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[11]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[12]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[13]  Kathy T. Mullen,et al.  Contour integration with colour and luminance contrast , 1996, Vision Research.

[14]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[15]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jitendra Malik,et al.  Detecting Curvilinear Structure in Images , 1991 .

[17]  E. R. Dixon Spectral distribution of Australian daylight , 1978 .

[18]  W. Geisler,et al.  Perceptual organization of two-dimensional patterns. , 2000, Psychological review.

[19]  K. Miller,et al.  Ocular dominance column development: analysis and simulation. , 1989, Science.

[20]  R F Hess,et al.  Spatial-frequency tuning of visual contour integration. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  D. G. Albrecht,et al.  Visual cortex neurons in monkeys and cats: Detection, discrimination, and identification , 1997, Visual Neuroscience.

[22]  Steven C. Dakin,et al.  The detection of structure in glass patterns: Psychophysics and computational models , 1997, Vision Research.

[23]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[24]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[25]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[26]  I. Ohzawa,et al.  Asymmetric Suppression Outside the Classical Receptive Field of the Visual Cortex , 1999, The Journal of Neuroscience.

[27]  Eero P. Simoncelli Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[28]  Jeffrey A. Sloan,et al.  Spatial frequency analysis of the visual environment: Anisotropy and the carpentered environment hypothesis , 1978, Vision Research.

[29]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[30]  Robert F Hess,et al.  Contour integration in the peripheral field , 1999, Vision Research.

[31]  D. P. Gallogly,et al.  Image Structure Models of Texture and Contour Visibility , 2000 .

[32]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989 .

[33]  L. Finkel,et al.  Extraction of perceptually salient contours by striate cortical networks , 1998, Vision Research.

[34]  E. Brunswik,et al.  Ecological cue-validity of proximity and of other Gestalt factors. , 1953, The American journal of psychology.

[35]  D. B. Judd,et al.  Spectral Distribution of Typical Daylight as a Function of Correlated Color Temperature , 1964 .

[36]  D Purves,et al.  The distribution of oriented contours in the real world. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[37]  I Kovács,et al.  A closed curve is much more than an incomplete one: effect of closure in figure-ground segmentation. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.