Contour Grouping with Prior Models

Conventional approaches to perceptual grouping assume little specific knowledge about the object(s) of interest. However, there are many applications in which such knowledge is available and useful. Here, we address the problem of finding the bounding contour of an object in an image when some prior knowledge about the object is available. We introduce a framework for combining prior probabilistic knowledge of the appearance of the object with probabilistic models for contour grouping. A constructive search technique is used to compute candidate closed object boundaries, which are then evaluated by combining figure, ground, and prior probabilities to compute the maximum a posteriori estimate. A significant advantage of our formulation is that it rigorously combines probabilistic local cues with important global constraints such as simplicity (no self-intersections), closure, completeness, and nontrivial scale priors. We apply this approach to the problem of computing exact lake boundaries from satellite imagery, given approximate prior knowledge from an existing digital database. We quantitatively evaluate the performance of our algorithm and find that it exceeds the performance of human mapping experts and a competing active contour approach, even with relatively weak prior knowledge. While the priors may be task-specific, the approach is general, as we demonstrate by applying it to a completely different problem: the computation of human skin boundaries in natural imagery.

[1]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[2]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[3]  James Elder,et al.  The effect of contour closure on the rapid discrimination of two-dimensional shapes , 1993, Vision Research.

[4]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[5]  David G. Lowe,et al.  Organization of smooth image curves at multiple scales , 1988, International Journal of Computer Vision.

[6]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Michael A. Arbib,et al.  Computational Techniques in the Visual Segmentation of Static Scenes. , 1977 .

[8]  Gian Luca Foresti,et al.  Grouping as a Searching Process for Minimum-Energy Configurations of Labelled Random Fields , 1996, Comput. Vis. Image Underst..

[9]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[10]  Seth Hutchinson,et al.  A Probabilistic Approach to Perceptual Grouping , 1996, Comput. Vis. Image Underst..

[11]  Ivan Laptev,et al.  Automatic extraction of roads from aerial images based on scale space and snakes , 2000 .

[12]  Daniel P. Huttenlocher,et al.  Finding convex edge groupings in an image , 2004, International Journal of Computer Vision.

[13]  Alberto Martelli,et al.  An application of heuristic search methods to edge and contour detection , 1976, CACM.

[14]  Michael Lindenbaum,et al.  A Probabilistic Interpretation of the Saliency Network , 2000, ECCV.

[15]  Eric Saund Labeling of curvilinear structure across scales by token grouping , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  A. Amir,et al.  Quantitative Analysis of Grouping Processes , 1996, ECCV.

[17]  Miguel Cazorla,et al.  Junction detection and grouping with probabilistic edge models and Bayesian A , 2002, Pattern Recognit..

[18]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  K. Rockland,et al.  Divergent feedback connections from areas V4 and TEO in the macaque , 1994, Visual Neuroscience.

[20]  Lance R. Williams,et al.  Segmentation of salient closed contours from real images , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Edward H. Adelson,et al.  Noise removal via Bayesian wavelet coring , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[22]  Steven W. Zucker,et al.  Radial Projection: An Efficient Update Rule for Relaxation Labeling , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[24]  Ivan Laptev,et al.  Automatic extraction of roads from aerial images based on scale space and snakes , 2000, Machine Vision and Applications.

[25]  Fredric M. Wolf,et al.  The prevalence of colinear contours in the real world , 2001, Neurocomputing.

[26]  Ingemar J. Cox,et al.  A Bayesian multiple-hypothesis approach to edge grouping and contour segmentation , 1993, International Journal of Computer Vision.

[27]  Donald Geman,et al.  An Active Testing Model for Tracking Roads in Satellite Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  David W. Jacobs Robust and efficient detection of convex groups , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Eero P. Simoncelli Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[30]  Jaakko Hintikka,et al.  On the Logic of Perception , 1969 .

[31]  Lance R. Williams,et al.  A Comparison of Measures for Detecting Natural Shapes in Cluttered Backgrounds , 1998, International Journal of Computer Vision.

[32]  Steven W. Zucker,et al.  Computing Contour Closure , 1996, ECCV.

[33]  Patrick Cavanagh,et al.  What's up in top-down processing? , 1991 .

[34]  K A Stevens,et al.  The relation between proximity and brightness similarity in dot patterns , 1983, Perception & psychophysics.

[35]  John K. Tsotsos,et al.  Recognizing planar curves using curvature-tuned smoothing , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[36]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Daniel Crevier Bayesian Extraction of Collinear Segment Chains from Digital Images , 2000 .

[38]  Sudeep Sarkar,et al.  A Framework for Performance Characterization of Intermediate-Level Grouping Modules , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Norbert Krüger,et al.  Collinearity and Parallelism are Statistically Significant Second-Order Relations of Complex Cell Responses , 1998, Neural Processing Letters.

[40]  Jitendra Malik,et al.  Contour Continuity in Region Based Image Segmentation , 1998, ECCV.

[41]  Tyng-Luh Liu,et al.  Visual Deconstruction: Recognizing Articulated Objects , 1997, EMMCVPR.

[42]  Tao Daniel Alter,et al.  The role of saliency and error propagation in visual object recognition , 1995 .

[43]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Michael Lindenbaum,et al.  A Generic Grouping Algorithm and Its Quantitative Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  David W. Jacobs,et al.  Robust and Efficient Detection of Salient Convex Groups , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Daniel Crevier,et al.  A Probabilistic Method for Extracting Chains of Collinear Segments , 1999, Comput. Vis. Image Underst..

[47]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[48]  Alan L. Yuille,et al.  Fundamental Limits of Bayesian Inference: Order Parameters and Phase Transitions for Road Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  James H. Elder,et al.  Image Editing in the Contour Domain , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1997, Neural Computation.

[51]  Christophe Chesnaud,et al.  Statistical Region Snake-Based Segmentation Adapted to Different Physical Noise Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  I Kovács,et al.  A closed curve is much more than an incomplete one: effect of closure in figure-ground segmentation. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[54]  Ugo Montanari,et al.  On the optimal detection of curves in noisy pictures , 1971, CACM.

[55]  J. Elder,et al.  Ecological statistics of Gestalt laws for the perceptual organization of contours. , 2002, Journal of vision.

[56]  C. Gilbert,et al.  On a common circle: natural scenes and Gestalt rules. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  E. Brunswik,et al.  Ecological cue-validity of proximity and of other Gestalt factors. , 1953, The American journal of psychology.

[59]  Pascal Fua,et al.  Fast, Accurate and Consistent Modeling of Drainage and Surrounding Terrain , 1998, International Journal of Computer Vision.

[60]  Patrick Cavanagh,et al.  Top-down processing in vision , 1999 .