Motion field estimation using segmentation and consistency constraint

This paper presents an approach to realistic motion field estimation. With this approach, an image is first segmented into homogeneous regions using a new multiscale gradient algorithm followed by watershed transformation. The multiscale gradient algorithm efficiently solves the oversegmentation problem of watershed transformation, increases segmentation accuracy and reduces the computational cost. The motion field is then estimated using block matching with a consistency constraint. The consistency constraint function is defined by neighbouring motion vectors and the segmentation map. Simulation results show that motion fields generated by block matching with the consistency constraint are very smooth within each object, approaching realistic motion fields, even when a small block size is used.

[1]  Sang Uk Lee,et al.  Video Coding Using Variable Block-Size Segmentation by Motion Vectors , 1994, J. Vis. Commun. Image Represent..

[2]  Eric Dubois,et al.  Motion modeling and estimation for very low bit rate video coding , 1995, Other Conferences.

[3]  Demin Wang,et al.  A multiscale gradient algorithm for image segmentation using watershelds , 1997, Pattern Recognit..

[4]  Frederic Dufaux,et al.  Image sequence coding by multigrid motion estimation and segmentation-based coding of prediction errors , 1993, Other Conferences.

[5]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[6]  Henri Nicolas,et al.  Compact motion representation based on global features for semantic image sequence coding , 1991, Other Conferences.

[7]  Marco Mattavelli,et al.  Overlapped motion compensation for subband coding of video sequences , 1996, Signal Process. Image Commun..

[8]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[9]  Philippe Salembier,et al.  Morphological multiscale segmentation for image coding , 1994, Signal Process..

[10]  Yutaka Yokoyama,et al.  Very low bit rate video coding using arbitrarily shaped region-based motion compensation , 1995, IEEE Trans. Circuits Syst. Video Technol..

[11]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[12]  Sharad Singhal,et al.  Windowed motion compensation , 1991, Other Conferences.

[13]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  JongWon Kim,et al.  Hierarchical variable block size motion estimation technique for motion sequence coding , 1993, Other Conferences.

[15]  Josef Kittler,et al.  Variable block size video coding with motion prediction and motion segmentation , 1995, Electronic Imaging.

[16]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .