Rate-distortion optimized motion estimation for error resilient video coding

Rate-distortion optimized motion compensation was originally proposed to improve the source coding efficiency of low bit-rate video coding. This paper investigates the potential benefits of extensions to explicitly handle transmission over lossy networks. The important impact of appropriate motion compensation on error resilience is identified and exploited to enhance performance. The expected end-to-end distortion, rather than the source coding distortion, is employed in the rate-distortion optimization criterion. The accuracy of the distortion estimate is crucial when optimizing over the motion vectors (as compared to the less sensitive inter/intra mode decision), and is ensured here by adopting the recursive optimal per-pixel estimate (ROPE) method. The main objective is to assess the gains achievable by such source-channel motion compensation, and this is given priority over complexity considerations. Significant performance gains in simulation demonstrate the potential of rate-distortion optimized motion compensation to improve the error resilience of video coding.

[1]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[2]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[3]  Thomas Wiegand,et al.  Error-resilient video transmission using long-term memory motion-compensated prediction , 2000, IEEE Journal on Selected Areas in Communications.

[4]  Wilson C. Chung,et al.  An efficient motion estimation technique based on a rate-distortion criterion , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[5]  Madhukar Budagavi,et al.  Multiframe video coding for improved performance over wireless channels , 2001, IEEE Trans. Image Process..

[6]  Faouzi Kossentini,et al.  Optimal intra coding of blocks for robust video communication over the Internet , 1999, Signal Process. Image Commun..

[7]  Bernd Girod,et al.  Rate-constrained motion estimation , 1994, Other Conferences.

[8]  Aggelos K. Katsaggelos,et al.  A Theory for the Optimal Bit Allocation Between Displacement Vector Field and Displaced Frame Difference , 1997, IEEE J. Sel. Areas Commun..

[9]  A. N. Willson,et al.  Rate-distortion optimal motion estimation algorithms for motion-compensated transform video coding , 1998, IEEE Trans. Circuits Syst. Video Technol..