Ecological statistics of Gestalt laws for the perceptual organization of contours.

Although numerous studies have measured the strength of visual grouping cues for controlled psychophysical stimuli, little is known about the statistical utility of these various cues for natural images. In this study, we conducted experiments in which human participants trace perceived contours in natural images. These contours are automatically mapped to sequences of discrete tangent elements detected in the image. By examining relational properties between pairs of successive tangents on these traced curves, and between randomly selected pairs of tangents, we are able to estimate the likelihood distributions required to construct an optimal Bayesian model for contour grouping. We employed this novel methodology to investigate the inferential power of three classical Gestalt cues for contour grouping: proximity, good continuation, and luminance similarity. The study yielded a number of important results: (1) these cues, when appropriately defined, are approximately uncorrelated, suggesting a simple factorial model for statistical inference; (2) moderate image-to-image variation of the statistics indicates the utility of general probabilistic models for perceptual organization; (3) these cues differ greatly in their inferential power, proximity being by far the most powerful; and (4) statistical modeling of the proximity cue indicates a scale-invariant power law in close agreement with prior psychophysics.

[1]  K. Koffka Principles Of Gestalt Psychology , 1936 .

[2]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[3]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[4]  E. Brunswik,et al.  Ecological cue-validity of proximity and of other Gestalt factors. , 1953, The American journal of psychology.

[5]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[6]  J. Hochberg,et al.  Brightness and Proximity Factors in Grouping , 1960 .

[7]  Tadasu Oyama,et al.  Perceptual Grouping as a Function of Proximity , 1961 .

[8]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[9]  W. Uttal,et al.  On the detectability of straight lines in visual noise: An extension of French’s paradigm into the millisecond domain , 1970 .

[10]  J. Hochberg ORGANIZATION AND THE GESTALT TRADITION , 1974 .

[11]  L. Glass,et al.  Pattern Recognition in Humans: Correlations Which Cannot be Perceived , 1976, Perception.

[12]  Azriel Rosenfeld,et al.  An Application of Relaxation Labeling to Line and Curve Enhancement , 1977, IEEE Transactions on Computers.

[13]  H. Barlow The efficiency of detecting changes of density in random dot patterns , 1978, Vision Research.

[14]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[15]  P. G. Vos,et al.  Configurational effects on the enumeration of dots: Counting by groups , 1982, Memory & cognition.

[16]  A. Watson Summation of grating patches indicates many types of detector at one retinal location , 1982, Vision Research.

[17]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[18]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[19]  K A Stevens,et al.  The relation between proximity and brightness similarity in dot patterns , 1983, Perception & psychophysics.

[20]  H. Wilson,et al.  Modified line-element theory for spatial-frequency and width discrimination. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[21]  R. Watt,et al.  Spatial filters and the localization of luminance changes in human vision , 1984, Vision Research.

[22]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[23]  A. Parker,et al.  Two-dimensional spatial structure of receptive fields in monkey striate cortex. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[24]  S. Zucker,et al.  Points and Endpoints: A Size/Spacing Constraint for Dot Grouping , 1988, Perception.

[25]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[26]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Steven W. Zucker,et al.  Two Stages of Curve Detection Suggest Two Styles of Visual Computation , 1989, Neural Computation.

[28]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  J. Beck,et al.  Line segregation. , 1989, Spatial vision.

[31]  Eric Saund,et al.  Symbolic Construction of a 2-D Scale-Space Image , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  John K. Tsotsos,et al.  Shape representation and recognition from curvature , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Daniel P. Huttenlocher,et al.  Finding convex edge groupings in an image , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[36]  W. Freeman Steerable filters and local analysis of image structure , 1992 .

[37]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[38]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[39]  James Elder,et al.  The effect of contour closure on the rapid discrimination of two-dimensional shapes , 1993, Vision Research.

[40]  G. Logan,et al.  Evaluating a computational model of perceptual grouping by proximity , 1993, Perception & Psychophysics.

[41]  James Elder,et al.  A measure of closure , 1994, Vision Research.

[42]  D. Mumford Elastica and Computer Vision , 1994 .

[43]  Deformable Kernels for Early Vision , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1995, Neural Computation.

[45]  Tao Daniel Alter,et al.  The role of saliency and error propagation in visual object recognition , 1995 .

[46]  M. Kubovy,et al.  Grouping by Proximity and Multistability in Dot Lattices: A Quantitative Gestalt Theory , 1995 .

[47]  Steven W. Zucker,et al.  Computing Contour Closure , 1996, ECCV.

[48]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[49]  Edward H. Adelson,et al.  Noise removal via Bayesian wavelet coring , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[50]  J.H. Elder,et al.  Scale space localization, blur, and contour-based image coding , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[51]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, ECCV.

[52]  David W. Jacobs,et al.  Robust and Efficient Detection of Salient Convex Groups , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[54]  Eero P. Simoncelli Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[55]  M. Kubovy,et al.  On the Lawfulness of Grouping by Proximity , 1998, Cognitive Psychology.

[56]  S. Zucker,et al.  Evidence for boundary-specific grouping , 1998, Vision Research.

[57]  James H. Elder,et al.  Image editing in the contour domain , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[58]  D. Foster,et al.  Multiple orientation-selective mechanisms for line-target detection , 1998 .

[59]  Daniel Crevier,et al.  A Probabilistic Method for Extracting Chains of Collinear Segments , 1999, Comput. Vis. Image Underst..

[60]  Eero P. Simoncelli Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[61]  D. Earle Glass Patterns: Grouping by Contrast Similarity , 1999, Perception.

[62]  Lance R. Williams,et al.  Segmentation of salient closed contours from real images , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[63]  A B Watson,et al.  Visual detection of spatial contrast patterns: evaluation of five simple models. , 2000, Optics express.

[64]  C. Gilbert,et al.  On a common circle: natural scenes and Gestalt rules. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[65]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[66]  James H. Elder,et al.  Contour grouping with strong prior models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[67]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[68]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[69]  B. Spehar The role of contrast polarity in perceptual closure , 2002, Vision Research.

[70]  James H. Elder,et al.  Psychophysical receptive fields of edge detection mechanisms , 2004, Vision Research.

[71]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[72]  David G. Lowe,et al.  Organization of smooth image curves at multiple scales , 1988, International Journal of Computer Vision.

[73]  Steven W. Zucker,et al.  Potentials, valleys, and dynamic global coverings , 1991, International Journal of Computer Vision.

[74]  James H. Elder,et al.  Are Edges Incomplete? , 1999, International Journal of Computer Vision.

[75]  Norbert Krüger,et al.  Collinearity and Parallelism are Statistically Significant Second-Order Relations of Complex Cell Responses , 1998, Neural Processing Letters.