Fast and Robust Sprite Generation for MPEG-4 Video Coding

This paper presents a fast and robust sprite generation algorithm for MPEG-4 video coding. Our contributions consist of two aspects. Firstly, a fast and robust Global Motion Estimation (GME) algorithm is proposed here. Spatial and temporal feature point selection schemes are incorporated into the hierarchical GME in order to speed up it. Experimental results demonstrate our method is up to seven times faster than the traditional one in MPEG-4 video verification model, and meanwhile the accuracy is slightly improved. Secondly, a sprite generation scheme with some novel techniques is developed. Rough image segmentation is also introduced for the purpose of image blending in sprite generation. The proposed algorithm can significantly improve the visual quality of the generated sprite image and the reconstructed background object in video coding. Furthermore, the proposed GME and sprite generation algorithms can be used for both frame-based and object-based video coding.

[1]  Frédéric Dufaux,et al.  Efficient, robust, and fast global motion estimation for video coding , 2000, IEEE Trans. Image Process..

[2]  H. Heijmans Morphological image operators , 1994 .

[3]  Mark Schlack,et al.  Digital Equipment Corp. , 1993 .

[4]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Richard Szeliski,et al.  Image mosaicing for tele-reality applications , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[6]  Nikolaos Grammalidis,et al.  Sprite generation and coding of multiview image sequences , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[7]  Aljoscha Smolic,et al.  Long-term global motion estimation and its application for sprite coding, content description, and segmentation , 1999, IEEE Trans. Circuits Syst. Video Technol..