Object Segmentation by Graph Partitioning ∗

Segmentation and recognition have long been treated as two separated processes. We propose a mechanism based on spectral graph partitioning that readily couple the two processes into one. A part-based object recognition system detects parts, supplies their partial segmentations and an evaluation of how well possible labellings on these parts go together based on the statistics of object spatial configurations. We integrate the top-level part grouping into the low-level pixel grouping based on feature similarity to segregate objects of interest from the background. We demonstrate that object part consistency and image pixel coherence can work together to eliminate local false positives and labelling ambiguities at high level, while at the same time overcome occlusion and weak contours at low level.

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[4]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Pietro Perona,et al.  A Factorization Approach to Grouping , 1998, ECCV.

[6]  S. Palmer Vision Science : Photons to Phenomenology , 1999 .

[7]  Ronen Basri,et al.  Fast multiscale image segmentation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  Jianbo Shi,et al.  Grouping with Bias , 2001, NIPS.

[9]  Jianbo Shi,et al.  Perceiving Shapes through Region and Boundary Interaction , 2001 .

[10]  Michael J. Black,et al.  Learning image statistics for Bayesian tracking , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Refractor Vision , 2000, The Lancet.

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[14]  Martial Hebert,et al.  Combining Simple Discriminators for Object Discrimination , 2002, ECCV.

[15]  Jitendra Malik,et al.  Contour and Texture Analysis for Image Segmentation , 2001, International Journal of Computer Vision.