Region-Based Parametric Motion Segmentation Using Color Information

This paper presents pixel-based and region-based parametric motion segmentation methods for robust motion segmentation with the goal of aligning motion boundaries with those of real objects in a scene. We first describe a two-step iterative procedure for parametric motion segmentation by either motion-vector or motion-compensated intensity matching. We next present a region-based extension of this method, whereby all pixels within a predefined spatial region are assigned the same motion label. These predefined regions may be fixed- or variable-size blocks or arbitrary-shaped areas defined by color or texture uniformity. A particular combination of these pixel-based and region-based methods is then proposed as a complete algorithm to obtain the best possible segmentation results on a variety of image sequences. Experimental results showing the benefits of the proposed scheme are provided.

[1]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[2]  M. Hötter,et al.  Image segmentation based on object oriented mapping parameter estimation , 1988 .

[3]  P. Schroeter,et al.  Multi-frame based segmentation of moving objects by combining luminance and motion , 1994 .

[4]  Jean-Marc Odobez,et al.  Direct Model-Based Image Motion Segmentation for Dynamic Scene Analysis , 1995, ACCV.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[7]  A. Murat Tekalp,et al.  Multistage affine parameter clustering for improved motion segmentation , 1996, Electronic Imaging.

[8]  Edward H. Adelson,et al.  A unified mixture framework for motion segmentation: incorporating spatial coherence and estimating the number of models , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Philippe Salembier,et al.  Morphological multiscale segmentation for image coding , 1994, Signal Process..

[10]  Sang Uk Lee,et al.  On the color image segmentation algorithm based on the thresholding and the fuzzy c-means techniques , 1990, Pattern Recognit..

[11]  Andrew Lippman,et al.  Spatio-temporal segmentation based on motion and static segmentation , 1995, Proceedings., International Conference on Image Processing.

[12]  A. Murat Tekalp,et al.  An algorithm for simultaneous motion estimation and scene segmentation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[14]  Andrew Lipprnnni,et al.  SPATIO-TEMPORAL SEGMENTATION BASED ON MOTION AND STATIC SEGMENTATION , 1995 .

[15]  Til Aach,et al.  Statistical model-based change detection in moving video , 1993, Signal Process..

[16]  Josef Kittler,et al.  Combining the Hough Transform and Multiresolution MRF's for the Robust Motion Estimation , 1995, ACCV.

[17]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[18]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  David W. Murray,et al.  Scene Segmentation from Visual Motion Using Global Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Touradj Ebrahimi,et al.  Morphological moving object segmentation and tracking for content-based video coding , 1995 .