Supervised object segmentation and tracking for MPEG-4 VOP generation

This paper presents an object-based segmentation and tracking scheme for video sequences. The probability density function (PDF) of each image to be segmented is modeled as a mixture of independent object PDF. In the first image of the sequence, the parameters of the mixture are initially estimated based on user interaction. These parameters are then iteratively updated using the expectation maximization (EM) algorithm. A classification procedure applied to the results of the EM algorithm allows an object-based segmentation of the image to be constructed. In subsequent images of the sequence, the segmented objects are automatically tracked using motion estimation/compensation and a similar EM-based segmentation framework. Results indicate that accurate object segmentations and robust tracking can be obtained using this flexible approach.

[1]  Noel E. O'Connor,et al.  Object detection and tracking using an EM-based motion estimation and segmentation framework , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  Fernando Pereira,et al.  MPEG-4: Context and objectives , 1997, Signal Process. Image Commun..

[3]  M. Bierling,et al.  Displacement Estimation By Hierarchical Blockmatching , 1988, Other Conferences.

[4]  Noel E. O'Connor,et al.  Supervised Semantic Object Segmentation and Tracking via EM-based Estimation of Mixture Density Parameters , 1998, NMBIA.

[5]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..