Recent advances in video coding using static background models

Sprite coding, as standardized in MPEG-4 Visual, can result in superior performance compared to common hybrid video codecs both objectively and subjectively. However, state-of-the-art video coding standard H.264/AVC clearly outperforms MPEG-4 Visual sprite coding in broad bit rate ranges. Based on the sprite coding idea, this paper proposes a video coding technique that merges the advantages of H.264/AVC and sprite coding. For that, sophisticated algorithms for global motion estimation, sprite generation and object segmentation — all needed for thorough sprite coding — are incorporated into an H.264/AVC coding environment. The proposed approach outperforms H.264/AVC especially in lower bit rate ranges. Savings up to 21% can be achieved.

[1]  Thomas Wiegand,et al.  Perception-oriented video coding based on texture analysis and synthesis , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[3]  Matthias Kunter,et al.  Advances in sprite based video coding: towards universal usability , 2008 .

[4]  Michael R. Frater,et al.  Motion-based object segmentation using local background sprites , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Frédéric Dufaux,et al.  Efficient, robust, and fast global motion estimation for video coding , 2000, IEEE Trans. Image Process..

[6]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Ds Dirk Farin,et al.  Automatic video segmentation employing object/camera modeling techniques , 2005 .

[9]  Edward J. Delp,et al.  Video coding using motion classification , 2008, 2008 15th IEEE International Conference on Image Processing.

[10]  Michael R. Frater,et al.  Rate-distortion optimization for automatic sprite video coding using H.264/AVC , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[11]  Michael R. Frater,et al.  Windowed Image Registration for Robust Mosaicing of Scenes with Large Background Occlusions , 2006, 2006 International Conference on Image Processing.

[12]  Thomas Sikora,et al.  Trends and Perspectives in Image and Video Coding , 2005, Proceedings of the IEEE.

[13]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, SPIE Optics + Photonics.

[14]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..