Scalable motion vector coding

Modern video coding applications require transmission of video data over variable-bandwidth channels to a variety of terminals with different screen resolutions and available computational power. Scalable video coding is needed to optimally support these applications. Recently proposed wavelet-based video codecs employing spatial domain motion compensated temporal filtering (SDMCTF) provide quality, resolution and frame-rate scalability while delivering compression performance comparable to that of the state-of-the-art non-scalable H.264-codec. These codecs require scalable coding of the motion vectors in order to support a large range of bit-rates with optimal compression efficiency. Scalable motion vector coding algorithms based on the integer wavelet transform followed by embedded coding of the wavelet coefficients were recently proposed. In this paper, a new and fundamentally different scalable motion vector codec (MVC) using median-based motion vector prediction is proposed. Extensive experimental results demonstrate that the proposed MVC systematically outperforms the wavelet-based state-of-the-art solutions. To be able to take advantage of the proposed scalable MVC, a rate allocation mechanism capable of optimally dividing the available rate among texture and motion information is required. Two rate allocation strategies are proposed and compared. The proposed MVC and rate allocation schemes are incorporated into an SDMCTF-based video codec and the benefits of scalable motion vector coding are experimentally demonstrated.

[1]  Feng Wu,et al.  H.26L-based fine granularity scalable video coding , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[2]  David S. Taubman,et al.  Highly scalable video compression with scalable motion coding , 2003, ICIP.

[3]  Peter Schelkens,et al.  Motion vector coding for in-band motion compensated temporal filtering , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[4]  Peter Schelkens,et al.  Response to call for evidence on scalable video coding , 2003 .

[5]  Mihaela van der Schaar,et al.  Adaptive motion-compensation fine-granular-scalability (AMC-FGS) for wireless video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[6]  Peter Schelkens,et al.  Scalable motion vector coding , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[7]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[8]  J. Cornelis,et al.  Wavelet coding of volumetric medical datasets , 2003, Proceedings. International Conference on Image Processing.

[9]  Markus Flierl,et al.  Rate-constrained multihypothesis prediction for motion-compensated video compression , 2002, IEEE Trans. Circuits Syst. Video Technol..

[10]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[11]  John W. Woods,et al.  Motion-compensated 3-D subband coding of video , 1999, IEEE Trans. Image Process..

[12]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[13]  Feng Wu,et al.  Advanced motion threading for 3D wavelet video coding , 2004, Signal Process. Image Commun..

[14]  John W. Woods,et al.  Bidirectional MC-EZBC with lifting implementation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Christophe Tillier,et al.  Motion compensation and scalability in lifting-based video coding , 2004, Signal Process. Image Commun..

[16]  Joint Video Team Draft ITU-T Recommendation and Final draft international standard of joint video specification , 2003 .