Video compression for lossy packet networks with mode switching and a dual-frame buffer

Video codecs that use motion compensation benefit greatly from the development of algorithms for near-optimal intra/inter mode switching within a rate-distortion framework. A separate development has involved the use of multiple-frame prediction, in which more than one past reference frame is available for motion estimation. In this paper, we show that using a dual-frame buffer (one short-term frame and one long-term frame available for prediction) together with intra/inter mode switching improves the compression performance of the coder. We improve the mode-switching algorithm with the use of half-pel motion vectors. In addition, we investigate the effect of feedback in making more informed and effective mode-switching decisions. Feedback information is used to limit drift errors due to packet losses by synchronizing the long-term frame buffers of both the encoder and the decoder.

[1]  Itu-T.  Video coding for low bitrate communication , 1996 .

[2]  Pamela Cosman,et al.  Comparison of error concealment strategies for MPEG video , 1999, WCNC. 1999 IEEE Wireless Communications and Networking Conference (Cat. No.99TH8466).

[3]  Aggelos K. Katsaggelos,et al.  Fast and efficient mode and quantizer selection in the rate distortion sense for H.263 , 1996, Other Conferences.

[4]  Faouzi Kossentini,et al.  Optimal mode selection and synchronization for robust video communications over error-prone networks , 2000, IEEE Journal on Selected Areas in Communications.

[5]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[6]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[7]  Athanasios Leontaris,et al.  Video compression with intra/inter mode switching and a dual frame buffer , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[8]  Madhukar Budagavi,et al.  Multiframe video coding for improved performance over wireless channels , 2001, IEEE Trans. Image Process..

[9]  Faouzi Kossentini,et al.  Optimal intra coding of blocks for robust video communication over the Internet , 1999, Signal Process. Image Commun..

[10]  Nuno Vasconcelos,et al.  Library-based image coding , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Ness B. Shroff,et al.  Error concealment in MPEG video streams over ATM networks , 2000, IEEE Journal on Selected Areas in Communications.

[12]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[13]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[14]  Sally Floyd,et al.  Promoting the use of end-to-end congestion control in the Internet , 1999, TNET.

[15]  Thomas Wiegand,et al.  Optimized transmission of H.26L/JVT coded video over packet-lossy networks , 2002, Proceedings. International Conference on Image Processing.

[16]  Sang Uk Lee,et al.  Robust transmission of video sequence using double-vector motion compensation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[17]  Bo Li,et al.  An end-to-end approach for optimal mode selection in Internet video communication: theory and application , 2000, IEEE Journal on Selected Areas in Communications.

[18]  Tokumichi Murakami,et al.  Very low bit-rate video coding with block partitioning and adaptive selection of two time-differential frame memories , 1997, IEEE Trans. Circuits Syst. Video Technol..

[19]  Rui Zhang,et al.  Advances in channel-adaptive video streaming , 2002, Wirel. Commun. Mob. Comput..

[20]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[21]  Thomas Wiegand,et al.  Long-term memory motion-compensated prediction for robust video transmission , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[22]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[23]  Jinho Choi,et al.  A stable feedback control of the buffer state using the controlled Lagrange multiplier method , 1994, IEEE Trans. Image Process..

[24]  Henning Schulzrinne,et al.  Real Time Streaming Protocol (RTSP) , 1998, RFC.

[25]  Bernd Girod,et al.  Advances in channel-adaptive video streaming , 2002, Proceedings. International Conference on Image Processing.

[26]  Faouzi Kossentini,et al.  H.263+: video coding at low bit rates , 1998, IEEE Trans. Circuits Syst. Video Technol..

[27]  Thomas Wiegand,et al.  Error-resilient video transmission using long-term memory motion-compensated prediction , 2000, IEEE Journal on Selected Areas in Communications.

[28]  Thomas Wiegand,et al.  Long-term memory motion-compensated prediction , 1999, IEEE Trans. Circuits Syst. Video Technol..

[29]  M. Gothe,et al.  Improving motion compensation using multiple temporal frames , 1993, Proceedings of IEEE Pacific Rim Conference on Communications Computers and Signal Processing.