Modified intelligent scissors and adaptive frame skipping for video object segmentation

MPEG-4 introduces the concept of video object to support content-based functionalities. Video object segmentation is a crucial step for object-based coding and manipulation. In this paper, a robust semi- automatic video object segmentation scheme is proposed. To efficiently and accurately define the initial object contour, modified intelligent scissors is proposed on the basis of original intelligent scissors. It can improve about 6-8 times the processing speed with only slight sacrifice of accuracy, which just meets the requirements of initial object extraction for semi-automatic approach. To avoid errors accumulating and propagating during object tracking, an adaptive frame skipping scheme is proposed to decompose video sequence into video clips. For rigid and non-rigid video objects, two different image segmentation algorithms are utilized, and then region-based backward projection technique is adopted to interpolate the video object plane (VOPs) of other frames within every video clip. The proposed approach can cope with occlusion/disocclusion problem to most extent. Experimental results demonstrate the effectiveness and robustness of the method.

[1]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[2]  Demin Wang Unsupervised video segmentation based on watersheds and temporal tracking , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  Yang Gaobo,et al.  Modified intelligent scissors and video decomposing for video object segmentation , 2003 .

[4]  Ming-Chieh Lee,et al.  Semantic video object tracking using region-based classification , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[5]  A. Murat Tekalp,et al.  Video object tracking with feedback of performance measures , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Shipeng Li,et al.  Interactive tracker - a semi-automatic video object tracking and segmentation system , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[7]  Huitao Luo,et al.  Rubberband: an improved graph search algorithm for interactive object segmentation , 2002, Proceedings. International Conference on Image Processing.

[8]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[9]  C.-C. Jay Kuo,et al.  Fast and accurate moving object extraction technique for MPEG-4 object-based video coding , 1998, Electronic Imaging.

[10]  Noel E. O'Connor,et al.  Evaluating and combining digital video shot boundary detection algorithms , 2000 .

[11]  Georgios Tziritas,et al.  Robust object boundary determination using a locally adaptive level set algorithm , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[12]  William A. Pearlman,et al.  Semi-automatic semantic video object extraction by active contour model , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).