Automatic Frame Composition Using Histogram Based Graph Cut

In this paper, we present an automatic background composition method using histogram-based graph cut. The proposed method consists of four steps: i) initial label map generation, ii) label map update, iii) object extraction by segmentation, and iv) dynamic background composition. Since the proposed method can minimize the user interaction for generating the initial label map and updating, it is suitable for simple interaction using a low-speed processor and limited memory space. Experimental results show that the proposed method provides better segmentation results compared with existing state-of-the-art methods with significantly reduced computational complexity. The proposed automatic object segmentation and background composition method can be applied to video editing, video conference, and video contents creation using low-cost mobile devices such as smart phones, smart TVs, and tablet PCs.

[1]  King Ngi Ngan,et al.  FaceSeg: Automatic Face Segmentation for Real-Time Video , 2009, IEEE Transactions on Multimedia.

[2]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, SIGGRAPH 2005.

[3]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  David Salesin,et al.  Video matting of complex scenes , 2002, SIGGRAPH.

[6]  Jian Sun,et al.  Video object cut and paste , 2005, SIGGRAPH 2005.

[7]  Li Yao,et al.  A distance map based skeletonization algorithm and its application in fiber recognition , 2008, 2008 International Conference on Audio, Language and Image Processing.

[8]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[9]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Harry Shum,et al.  Pop-up light field: An interactive image-based modeling and rendering system , 2004, TOGS.

[11]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[13]  Alain Trémeau,et al.  Regions adjacency graph applied to color image segmentation , 2000, IEEE Trans. Image Process..

[14]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.