An interactive authoring system for video object segmentation and annotation

An interactive authoring system is proposed for semi-automatic video object (VO) segmentation and annotation. This system features a new contour interpolation algorithm, which enables the user to define the contour of a VO on multiple frames while the computer interpolates the missing contours of this object on every frame automatically. Typical active contour (snake) model is adapted and the contour interpolation problem is decomposed into a two-directional contour tracking problem and a merging problem. In addition, new user interaction models are designed for the user to interact with the computer. Experiments indicate that this system offers a good balance between algorithm complexity and user interaction efficiency.

[1]  Shih-Fu Chang,et al.  AMOS: an active system for MPEG-4 video object segmentation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Alberto Martelli,et al.  An application of heuristic search methods to edge and contour detection , 1976, CACM.

[3]  Yuh-Lin Chang,et al.  Tracking deformable objects with the active contour model , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[4]  V. Michael Bove,et al.  Hyperlinked television research at the MIT Media Laboratory , 2000, IBM Syst. J..

[5]  Tulika Mitra,et al.  Zodiac: A History-Based Interactive Video Authoring System , 1998, ACM Multimedia.

[6]  A. Murat Tekalp,et al.  Tracking visible boundary of objects using occlusion adaptive motion snake , 2000, IEEE Trans. Image Process..

[7]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[9]  Ioannis Pitas,et al.  Segmentation and tracking of faces in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[10]  V. Michael Bove,et al.  Segmentation of an image sequence using multi-dimensional image attributes , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[11]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[13]  A. Murat Tekalp,et al.  Occlusion adaptive motion snake , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[14]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[15]  Fernando Pereira,et al.  The role of analysis in content-based video coding and indexing , 1998, Signal Process..

[16]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[17]  Ming-Chieh Lee,et al.  Semantic video object tracking using region-based classification , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).