Inferring global pereeptual contours from local features

We address the problem of contour inference from partial data, as obtained from state-of-the-art edge detectors.We argue that in order to obtain more pereeptually salient contours, it is necessary to impose generic constraints such as continuity and co-curvilinearity.The implementation is in the form of a convolution with a mask which encodes both the orientation and the strength of the possible continuations. We first show how the mask, called the “Extension field” is derived, then how the contributions from different sites are collected to produce a saliency map.We show that the scheme can handle a variety of input data, from dot patterns to oriented edgels in a unified manner, and demonstrate results on a variety of input stimuli.We also present a similar approach to the problem of inferring contours formed by end points. In both cases, the scheme is non-linear, non iterative, and unified in the sense that all types of input tokens are handled in the same manner.

[1]  S. Ullman,et al.  Filling-in the gaps: The shape of subjective contours and a model for their generation , 1976, Biological Cybernetics.

[2]  Pietro Perona Steerable-scalable kernels for edge detection and junction analysis , 1992, Image Vis. Comput..

[3]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[5]  Rüdiger von der Heydt,et al.  A computational model of neural contour processing: Figure-ground segregation and illusory contours , 1993, 1993 (4th) International Conference on Computer Vision.

[6]  S. Sutherland Seeing things , 1989, Nature.

[7]  I. Rock,et al.  The legacy of Gestalt psychology. , 1990, Scientific American.

[8]  G. Kanizsa Subjective contours. , 1976, Scientific American.

[9]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Kokichi Sugihara,et al.  An Algebraic Approach to Shape-from-Image Problems , 1984, Artif. Intell..

[11]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[12]  G. Guy,et al.  Perceptual grouping using global saliency-enhancing operators , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[13]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[14]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[15]  M. Wertheimer Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[16]  Richard S. Weiss,et al.  Perceptual Grouping Of Curved Lines , 1989, Other Conferences.

[17]  Yee-Hong Yang,et al.  Shading Logic: A Heuristic Approach to Recover Shape from Shading , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Ramakant Nevatia,et al.  Segmentation and description based on perceptual organization , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Ramakant Nevatia,et al.  Perception of 3-D Surfaces from 2-D Contours , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[21]  Narendra Ahuja,et al.  Extraction of early perceptual structure in dot patterns: Integrating region, boundary, and component gestalt , 1989, Comput. Vis. Graph. Image Process..

[22]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[23]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1997, Neural Computation.

[24]  Steven W. Zucker,et al.  The Organization Of Curve Detection: Coarse Tangent Fields And Fine Spline Coverings , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[25]  Gérard G. Medioni,et al.  Hierarchical Decomposition and Axial Shape Description , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  David L. Waltz,et al.  Generating Semantic Descriptions From Drawings of Scenes With Shadows , 1972 .

[27]  Bahram Parvin,et al.  A dynamic system for object description and correspondence , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.