Model-based segmentation and tracking of head-and-shoulder video objects for real time multimedia services

A statistical model-based video segmentation algorithm is presented for head-and-shoulder type video. This algorithm uses domain knowledge by abstracting the head-and-shoulder object with a blob-based statistical region model and a shape model. The object segmentation problem is then converted into a model detection and tracking problem. At the system level, a hierarchical structure is designed and spatial and temporal filters are used to improve segmentation quality. This algorithm runs in real time over a QCIF size video, and segments it into background, head and shoulder three video objects on average Pentium PC platforms. Due to its real time feature, this algorithm is appropriate for real time multimedia services such as videophone and web chat. Simulation results are offered to compare MPEG-4 performance with H.263 on segmented video objects with respects to compression efficiency, bit rate adaptation and functionality.

[1]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[2]  최재각,et al.  결합 유사성 척도를 이용한 시공간 영상 분할 ( Spatio-Temporal Video Segmentation Using a Joint Similarity Measure ) , 1997 .

[3]  Guojun Lu,et al.  Region-based shape representation and similarity measure suitable for content-based image retrieval , 1999, Multimedia Systems.

[4]  Paulo Lobato Correia,et al.  A video object generation tool allowing friendly user interaction , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[5]  Til Aach,et al.  Statistical model-based change detection in moving video , 1993, Signal Process..

[6]  C. S. Choi,et al.  Human Facial Motion Analysis and Synthesis with Application to Model-Based Coding , 1993 .

[7]  A. Murat Tekalp,et al.  Simultaneous motion estimation and segmentation , 1997, IEEE Trans. Image Process..

[8]  V. Michael Bove,et al.  Segmentation of an image sequence using multi-dimensional image attributes , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[9]  SceneMartin Bichsel.  Segmenting Simply Connected Moving Objects in aStatic , 1994 .

[10]  Changick Kim,et al.  A fast and robust moving object segmentation in video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[11]  Shih-Fu Chang,et al.  An integrated approach for content-based video object segmentation and retrieval , 1999, IEEE Trans. Circuits Syst. Video Technol..

[12]  Levent Onural,et al.  Utilization of the recursive shortest spanning tree algorithm for video-object segmentation by 2-D affine motion modeling , 2000, IEEE Trans. Circuits Syst. Video Technol..

[13]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[14]  L. Masera,et al.  Foreground/background segmentation in videotelephony , 1989, Signal Process. Image Commun..

[15]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[16]  Alexandros Eleftheriadis,et al.  MPEG‐4: An object‐based multimedia coding standard supporting mobile applications , 1998, Mob. Networks Appl..

[17]  Huitao Luo,et al.  Designing an interactive tool for video object segmentation and annotation , 1999, MULTIMEDIA '99.

[18]  Peter Eisert,et al.  Motion-based analysis and segmentation of image sequences using 3-D scene models , 1998, Signal Process..

[19]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[20]  Ming-Chieh Lee,et al.  Semiautomatic segmentation and tracking of semantic video objects , 1998, IEEE Trans. Circuits Syst. Video Technol..

[21]  Fernando Pereira,et al.  The role of analysis in content-based video coding and indexing , 1998, Signal Process..

[22]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[23]  Michael G. Strintzis,et al.  Tracking textured deformable objects using a finite-element mesh , 1998, IEEE Trans. Circuits Syst. Video Technol..

[24]  A. Murat Tekalp,et al.  Region-Based Parametric Motion Segmentation Using Color Information , 1998, Graph. Model. Image Process..

[25]  A. Murat Tekalp,et al.  Semi-automatic video object segmentation in the presence of occlusion , 2000, IEEE Trans. Circuits Syst. Video Technol..