Interactive Object Extraction from a Video Based on Seed-Line Tracking

This paper presents a method for extracting a non-rigid moving object from a video sequence. In order to actualize object extraction with minimal user interaction, we combine alpha matting and seed-line tracking. In the proposed method, the object region is separated from background based on seed lines given by user as a cue, and then the seed lines are automatically tracked to the next frames to actualize automatic object extraction from the frame sequence. With the alpha matting, the boundary of the object region in each frame is refined. The experimental results have shown that by the seed-line tracking user input can be significantly reduced and that the boundary refinement by alpha matting works effectively.

[1]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[3]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Jiaya Jia,et al.  Poisson matting , 2004, SIGGRAPH 2004.

[6]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[7]  David Salesin,et al.  Video matting of complex scenes , 2002, SIGGRAPH.

[8]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[9]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Jian Sun,et al.  Video object cut and paste , 2005, SIGGRAPH 2005.

[11]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Yutaro Takei,et al.  Extraction of non-rigid moving objects from a video with interactive image cutout and seed-line tracking , 2013, 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS).

[13]  David Salesin,et al.  Keyframe-based tracking for rotoscoping and animation , 2004, ACM Trans. Graph..

[14]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, SIGGRAPH 2005.