Novel tracking-based moving object extraction algorithm

Moving object extraction plays a fundamental role in computer vision, pattern recognition, object-based video coding and indexing. However, the low-level visual homogeneity criteria (like color, texture, intensity, motion, and so on) for segmentation do not lead to regions that immediately correspond to meaningful objects from the human point of view, because a semantic video object can contain totally different gray levels, colors, textures, or even motion. In this paper, a novel moving object extraction algorithm is proposed by collaborative integration of the results of a semantic object generation algorithm and a temporal tracking technique. First, the semantic objects are generated by a seeded region aggregation procedure according to some perceptual visual models or by a human– computer interaction procedure. Second, the correspondence of these extracted semantic objects along the time axis is further exploited through a temporal tracking procedure.

[1]  Rong Wang,et al.  Image sequence segmentation based on 2D temporal entropic thresholding , 1996, Pattern Recognit. Lett..

[2]  Ming-Chieh Lee,et al.  Semiautomatic segmentation and tracking of semantic video objects , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  David W. Murray,et al.  Scene Segmentation from Visual Motion Using Global Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Cheng-Hong Yang,et al.  Motion-based video segmentation using continuation method and robust cost functions , 1998, Electronic Imaging.

[5]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[7]  Minoru Asada,et al.  MDL-Based Segmentation and Motion Modeling in a Long Image Sequence of Scene with Multiple Independently Moving Objects , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  A. Murat Tekalp,et al.  Temporal video segmentation using unsupervised clustering and semantic object tracking , 1998, J. Electronic Imaging.

[9]  Steven D. Blostein,et al.  Motion-based object segmentation and estimation using the MDL principle , 1995, IEEE Trans. Image Process..

[10]  Norbert Diehl,et al.  Object-oriented motion estimation and segmentation in image sequences , 1991, Signal Process. Image Commun..

[11]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jianping Fan,et al.  An improved automatic isotropic color edge detection technique , 2001, Pattern Recognit. Lett..

[13]  Demin Wang,et al.  A multiscale gradient algorithm for image segmentation using watershelds , 1997, Pattern Recognit..

[14]  Ying Xu,et al.  2D image segmentation using minimum spanning trees , 1997, Image Vis. Comput..

[15]  M. Hötter,et al.  Image segmentation based on object oriented mapping parameter estimation , 1988 .

[16]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Luis Torres,et al.  Region-based video coding using mathematical morphology , 1995 .

[18]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Shih-Fu Chang,et al.  Model-based classification of visual information for content-based retrieval , 1998, Electronic Imaging.

[20]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[21]  Shih-Fu Chang,et al.  An integrated approach for content-based video object segmentation and retrieval , 1999, IEEE Trans. Circuits Syst. Video Technol..

[22]  Anup Basu,et al.  Motion Tracking with an Active Camera , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[24]  Levent Onural,et al.  Image sequence analysis for emerging interactive multimedia services-the European COST 211 framework , 1998, IEEE Trans. Circuits Syst. Video Technol..

[25]  A. Rosenfeld,et al.  Computer vision: basic principles , 1988, Proc. IEEE.

[26]  Jianping Fan,et al.  Spatiotemporal segmentation for compact video representation , 2001, Signal Process. Image Commun..