Interactive video segmentation based on quasi-flat zones

Video data is continuously increasing in personal databases and Web repositories. To exploit such data, a prior segmentation is often needed in order to get the objects-of-interest to be further processed. However, the segmentation of a given video is often not unique and indeed depends on user needs. Personalized segmentation may be achieved using interactive methods but only if their computational cost stays reasonable to enable user interactivity. We address here the problem of interactive video segmentation and introduce a 2-step segmentation scheme: 1) offline processing to automatically extract quasi-flat zones from video data, and 2) online processing to interactively gather quasi-flat zones and build objects-of-interest. Our approach is able to deal with multiple objects, robust to errors introduced by the automatic segmentation step, and does not require to perform again the whole segmentation process each time the user provides some feedback.

[1]  Scott Cohen,et al.  LIVEcut: Learning-based interactive video segmentation by evaluation of multiple propagated cues , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Roberto de Alencar Lotufo,et al.  Watershed from propagated markers: An interactive method to morphological object segmentation in image sequences , 2010, Image Vis. Comput..

[3]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Pierre Soille On Genuine Connectivity Relations Based on Logical Predicates , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[5]  Pierre Soille,et al.  Constrained Connectivity and Transition Regions , 2009, ISMM.

[6]  Pierre Gançarski,et al.  Spatio-temporal Quasi-Flat Zones for Morphological Video Segmentation , 2011, ISMM.

[7]  Pierre Soille,et al.  Constrained connectivity for hierarchical image partitioning and simplification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Philippe Salembier,et al.  Connected operators and pyramids , 1993, Optics & Photonics.

[9]  Serge Beucher,et al.  Marker-controlled segmentation: an application to electrical borehole imaging , 1992, J. Electronic Imaging.

[10]  Noel E. O'Connor,et al.  A comparative evaluation of interactive segmentation algorithms , 2010, Pattern Recognit..

[11]  L. Zhi,et al.  Interactive video object segmentation: fast seeded region merging approach , 2004 .

[12]  Pierre Gançarski,et al.  Video Object Mining: Issues and Perspectives , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.