Extraction of video object with complex motion

Object segmentation is a problem within the scope of MPEG-4 standardization activities. This paper proposes a novel technique to extract the moving objects in the video sequences. Our approach is based on the integration of mosaic-based temporal segmentation and color-based spatial segmentation. The mosaic representation of video allows us to fully exploit the spatio-temporal information in the video scene to achieve robust segmentation. Compared with the related works which detect motion by the difference of two consecutive frames, our approach uses the information aggregated over a group of frames. Thus, our system is more robust and is able to extract the non-rigid object that has complex motion from one frame to the next.

[1]  Dinh-Tuan Pham,et al.  Image segmentation using probabilistic fuzzy c-means clustering , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[3]  Yo-Sung Ho,et al.  A VOP generation tool: automatic segmentation of moving objects in image sequences based on spatio-temporal information , 1999, IEEE Trans. Circuits Syst. Video Technol..

[4]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[5]  Michal Irani,et al.  Video indexing based on mosaic representations , 1998, Proc. IEEE.

[6]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[7]  Ioannis Patras,et al.  Video Segmentation by MAP Labeling of Watershed Segments , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  P. Anandan,et al.  Efficient representations of video sequences and their applications , 1996, Signal Process. Image Commun..

[9]  Russell M. Mersereau,et al.  Fast algorithms for the estimation of motion vectors , 1999, IEEE Trans. Image Process..

[10]  Walter Stechele,et al.  A video segmentation algorithm for hierarchical object representations and its implementation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[11]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[12]  Wen Gao,et al.  Color image segmentation using density-based clustering , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[13]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Liang-Hua Chen,et al.  On the preview of digital movies , 2003, J. Vis. Commun. Image Represent..

[15]  Michael G. Strintzis,et al.  Motion and disparity field estimation using rate-distortion optimization , 1998, IEEE Trans. Circuits Syst. Video Technol..