Fast video object segmentation using Markov random field

A fast video object segmentation algorithm is proposed in this paper. The algorithm utilizes the motion vectors from blocks with variable block sizes to identify background motion model and moving objects. Markov random field is used to model the foreground field to enhance spatial and temporal continuity of objects. To speed up the segmentation time, time-consuming spatial segmentation techniques are avoided. Instead, spatial information in the form of Walsh Hadamard transform coefficients is utilized to improve segmentation accuracy. Experimental results show that the proposed algorithm can effectively extract moving objects from different kind of video sequences. The computation time of the segmentation process is merely about 75 ms per CIF frame using a normal PC, allowing the algorithm to be applied in real-time applications such as video surveillance and conferencing.

[1]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[2]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Wen Gao,et al.  Semantic object segmentation by a spatio-temporal MRF model , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Yi-Ping Hung,et al.  A Bayesian approach to video object segmentation via merging 3-D watershed volumes , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[8]  Wai-kuen Cham,et al.  Fast Motion Estimation for H.264/AVC in Walsh–Hadamard Domain , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Amir Averbuch,et al.  Automatic segmentation of moving objects in video sequences: a region labeling approach , 2002, IEEE Trans. Circuits Syst. Video Technol..

[10]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[11]  Yang Wang,et al.  Spatiotemporal video segmentation based on graphical models , 2005, IEEE Transactions on Image Processing.

[12]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[13]  King Ngi Ngan,et al.  Fast and efficient method for block edge classification , 2006, IWCMC '06.

[14]  Jie Wei,et al.  MRF-MAP-MFT visual object segmentation based on motion boundary field , 2003, Pattern Recognit. Lett..

[15]  M. Meribout Video Segmentation for Content-based Coding , 2004 .

[16]  Rita Cucchiara,et al.  Object segmentation in videos from moving camera with MRFs on color and motion features , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..