Snakecut: an Integrated Approach Based on Active Contour and GrabCut for Automatic Foreground Object Segmentation

Interactive techniques for extracting the foreground object from an image have been the interest of research in computer vision for a long time. This paper addresses the problem of an efficient, semi-interactive extraction of a foreground object from an image. Snake (also known as Active contour) and GrabCut are two popular techniques, extensively used for this task. Active contour is a deformable contour, which segments the object using boundary discontinuities by minimizing the energy function associated with the contour. GrabCut provides a convenient way to encode color features as segmentation cues to obtain foreground segmentation from local pixel similarities using modified iterated graph-cuts. This paper first presents a comparative study of these two segmentation techniques, and illustrates conditions under which either or both of them fail. We then propose a novel formulation for integrating these two complimentary techniques to obtain an automatic foreground object segmentation. We call our proposed integrated approach as “SnakeCut”, which is based on a probabilistic framework. To validate our approach, we show results both on simulated and natural images.

[1]  Pong C. Yuen,et al.  Classification of partially occluded objects using 3-point matching and distance transformation , 1994, Pattern Recognit..

[2]  Demetri Terzopoulos,et al.  Deformable models , 2000, The Visual Computer.

[3]  S. Brendle,et al.  Calculus of Variations , 1927, Nature.

[4]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[5]  David G. Kirkpatrick,et al.  Linear Time Euclidean Distance Algorithms , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[7]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[8]  Jannik Fritsch,et al.  Interactive object learning for robot companions using mosaic images , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[10]  Sukhendu Das,et al.  External Force Modeling of Snakes Using DWT for Texture Object Segmentation , 2006 .

[11]  D CohenLaurent On active contour models and balloons , 1991 .

[12]  Sukhendu Das,et al.  Integrating Linear Subspace Analysis and Iterative Graphcuts For Content-Based Video Retrieval , 2006 .

[13]  Gary E. Ford,et al.  The Position-Orientation Masking Approach to Parametric Search for Template Matching , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jannik Fritsch,et al.  A multi-modal object attention system for a mobile robot , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Dah-Jye Lee,et al.  Using distance transform to solve real-time machine vision inspection problems , 2007, Machine Vision and Applications.

[16]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[17]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[18]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[19]  Frederic Fol Leymarie,et al.  Tracking Deformable Objects in the Plane Using an Active Contour Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.