Extracting the Foreground from Video Based on a New Sampling Method

In this paper, we propose a new video matting method based on sampling. By detecting the movement of foreground and background objects from video, we define the local transformation which transfer the small areas between different frames in the video. By the local transformation, foreground and the occluded background object can be sampled from neighbor frames. Benefited from temporal consistency, we can get high quality alpha matte. Experiment results show that our method achieves ideal results in the scenes where old method get poor results.

[1]  Chi-Keung Tang,et al.  KNN Matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Deepu Rajan,et al.  Weighted color and texture sample selection for image matting , 2012, CVPR.

[3]  Jitendra Malik,et al.  Large displacement optical flow , 2009, CVPR.

[4]  Lina J. Karam,et al.  Background recovery from video sequences using motion parameters , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Oscar C. Au,et al.  Color clustering matting , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[6]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, SIGGRAPH 2005.

[7]  Yan Gao,et al.  Video composition by optimized 3D mean‐value coordinates , 2012, Comput. Animat. Virtual Worlds.

[8]  Qinping Zhao,et al.  Image Matting with Local and Nonlocal Smooth Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Jian Sun,et al.  Video object cut and paste , 2005, SIGGRAPH 2005.

[10]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..

[11]  Ying Wu,et al.  Nonlocal matting , 2011, CVPR 2011.

[12]  Yuanjie Zheng,et al.  Learning based digital matting , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Guillermo Sapiro,et al.  Video SnapCut: robust video object cutout using localized classifiers , 2009, SIGGRAPH 2009.

[14]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[15]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[16]  Chongzhao Han,et al.  A Background Reconstruction Algorithm based on Pixel Intensity Classification in Remote Video Surveillance System 1 , 2001 .

[17]  Hai Liu,et al.  Detecting and extracting natural snow from videos , 2010, Inf. Process. Lett..

[18]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.