Memory-Based Moving Object Extraction for Video Indexing

Extracting moving objects from a video shot provides a good low-level representation of videos. It provides objec t trajectory, color, shape characteristics. Combined with s pecific domain knowledge, it can be a powerful cue as what is going in a video shot. This paper proposes a unsupervised moving object extraction/tracking system that attempts to capture salient moving objects from an image sequence. The novelty of the proposed system lies in that it requires no object initialization and it is aimed to tolerate noisy segm entations at individual frame level. A temporal stack structure is used as a memory device to filter and learn salient objects. The learning of moving object takes a bottom-up approach, moving from independent motion segmentation results at each frame level to a learned whole object char-

[1]  Yair Weiss,et al.  Smoothness in layers: Motion segmentation using nonparametric mixture estimation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  King Ngi Ngan,et al.  Automatic segmentation of moving objects for video object plane generation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  Stephen W. Smoliar,et al.  Developing power tools for video indexing and retrieval , 1994, Electronic Imaging.

[4]  Edward H. Adelson,et al.  A unified mixture framework for motion segmentation: incorporating spatial coherence and estimating the number of models , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[6]  Ya-Qin Zhang,et al.  A confidence measure based moving object extraction system built for compressed domain , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[7]  P. Anandan,et al.  A Unified Approach to Moving Object Detection in 2D and 3D Scenes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jitendra Malik,et al.  Motion segmentation and tracking using normalized cuts , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Roland Mech,et al.  A noise robust method for segmentation of moving objects in video sequences , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.