Automatic video sequence segmentation using object tracking

Emerging video standards address content-based function-alities and interactive multimedia. MPEG-4 segments the frames into video object planes (VOP) with each VOP corresponding to one semantically meaningful object. In this paper a new automatic video sequence segmentation algorithm is presented that can extract such VOP's. A binary model for moving objects is automatically derived and tracked in subsequent frames using the generalised Haus-dorr distance. The model is updated every frame to accommodate for rotation and changes in shape. For that an update mechanism consisiting of two components is proposed. To improve the segmentation and reduce the computational complexity stationary background is ltered by a novel technique. Experimental results demonstrate the performance of our proposed algorithm.

[1]  Daniel P. Huttenlocher,et al.  Tracking non-rigid objects in complex scenes , 1993, 1993 (4th) International Conference on Computer Vision.

[2]  Roland Mech,et al.  A noise robust method for segmentation of moving objects in video sequences , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[4]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[7]  Giuseppe Russo,et al.  Automatic moving-object and background segmentation by means of higher order statistics , 1997, Electronic Imaging.