Simultaneous alpha map generation and 2-D mesh tracking for multimedia applications

We propose a semi-automatic alpha-map generation method, where video object boundaries that are marked interactively on some key-frames are tracked in all other frames using only YUV data to generate alpha-maps. We use a 2-D triangular mesh to represent and track video objects. One of the major problems in alpha plane generation by object tracking is the detection and classification of uncovered regions due to object motion and self-occlusion (especially in the presence of out-of-plane rotations). The proposed method can identify uncovered regions and then classify them as belonging to the object of interest or not based on color and motion similarities.

[1]  Alex Pentland,et al.  Cooperative Robust Estimation Using Layers of Support , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. Murat Tekalp,et al.  Tracking Motion and Intensity Variations Using Hierarchical 2-D Mesh Modeling for Synthetic Object Transfiguration , 1996, CVGIP Graph. Model. Image Process..

[3]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[4]  Patrick Bouthemy,et al.  Region-Based Tracking Using Affine Motion Models in Long Image Sequences , 1994 .

[5]  A. Murat Tekalp,et al.  An algorithm for simultaneous motion estimation and scene segmentation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Charles Kervrann,et al.  Robust tracking of stochastic deformable models in long image sequences , 1994, Proceedings of 1st International Conference on Image Processing.

[7]  A. Murat Tekalp,et al.  Two-dimensional triangular mesh-based mosaicking for object tracking in the presence of occlusion , 1997, Electronic Imaging.

[8]  A. Murat Tekalp,et al.  2-D mesh-based tracking of deformable objects with occlusion , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[9]  James W. Davis,et al.  Real-time closed-world tracking , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.