Optimal Contour Closure by Superpixel Grouping

Detecting contour closure, i.e., finding a cycle of disconnected contour fragments that separates an object from its background, is an important problem in perceptual grouping. Searching the entire space of possible groupings is intractable, and previous approaches have adopted powerful perceptual grouping heuristics, such as proximity and co-curvilinearity, to manage the search. We introduce a new formulation of the problem, by transforming the problem of finding cycles of contour fragments to finding subsets of superpixels whose collective boundary has strong edge support in the image. Our cost function, a ratio of a novel learned boundary gap measure to area, promotes spatially coherent sets of superpixels. Moreover, its properties support a global optimization procedure using parametric maxflow. We evaluate our framework by comparing it to two leading contour closure approaches, and find that it yields improved performance.

[1]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[2]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[3]  James L. McClelland,et al.  B-Spline Contour Representation and Symmetry Detection , 1993 .

[4]  James Elder,et al.  A measure of closure , 1994, Vision Research.

[5]  Allen R. Hanson,et al.  Perceptual completion of occluded surfaces , 1996, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1995, Neural Computation.

[7]  Steven W. Zucker,et al.  Computing Contour Closure , 1996, ECCV.

[8]  Tat-Jen Cham,et al.  Geometric Saliency of Curve Correspondances and Grouping of Symmetric Comntours , 1996, ECCV.

[9]  Antti Ylä-Jääski,et al.  Grouping Symmetrical Structures for Object Segmentation and Description , 1996, Comput. Vis. Image Underst..

[10]  Roberto Cipolla,et al.  Computer Vision — ECCV '96 , 1996, Lecture Notes in Computer Science.

[11]  David W. Jacobs,et al.  Robust and Efficient Detection of Salient Convex Groups , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  M. Wertheimer,et al.  A source book of Gestalt psychology. , 1939 .

[13]  Ian H. Jermyn,et al.  Globally Optimal Regions and Boundaries as Minimum Ratio Weight Cycles , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Mads Nielsen,et al.  Computer Vision — ECCV 2002 , 2002, Lecture Notes in Computer Science.

[15]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[16]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jitendra Malik,et al.  Recovering human body configurations: combining segmentation and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[18]  A. Jepson,et al.  Perceptual grouping for contour extraction , 2004, ICPR 2004.

[19]  Jun Wang,et al.  Salient closed boundary extraction with ratio contour , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jitendra Malik,et al.  Cue Integration for Figure/Ground Labeling , 2005, NIPS.

[21]  Jitendra Malik,et al.  Scale-invariant contour completion using conditional random fields , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Allan D. Jepson,et al.  Robust Boundary DetectionWith Adaptive Grouping , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[23]  Allan D. Jepson,et al.  Robust Boundary Detection With Adaptive Grouping , 2006 .

[24]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Vladimir Kolmogorov,et al.  Applications of parametric maxflow in computer vision , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[26]  Gang Song,et al.  Untangling Cycles for Contour Grouping , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Song Wang,et al.  Edge Grouping Combining Boundary and Region Information , 2007, IEEE Transactions on Image Processing.

[28]  Jitendra Malik,et al.  Using contours to detect and localize junctions in natural images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Song Wang,et al.  Globally Optimal Grouping for Symmetric Closed Boundaries by Combining Boundary and Region Information , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Sven J. Dickinson,et al.  Multiscale Symmetric Part Detection and Grouping , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[31]  Cristian Sminchisescu,et al.  Constrained parametric min-cuts for automatic object segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .