Error-resilient video coding with end-to-end rate-distortion optimized at macroblock level

Intra macroblock refreshment is an effective approach for error-resilient video coding. In this paper, in addition to intra coding, we propose to add two macroblock coding modes to enhance the transmission robustness of the coded bitstream, which are inter coding with redundant macroblock and intra coding with redundant macroblock. The selection of coding modes and the parameters for coding the redundant version of the macroblock are determined by the rate-distortion optimization. It is worth mentioning that the end-to-end distortion is employed in the optimization procedure, which considers the channel conditions. Extensive simulation results show that the proposed approach outperforms other error-resilient approaches significantly; for some video sequences, the average PSNR can be up to 4 dB higher than that of the Optimal Intra Refreshment approach.

[1]  Hua Yang,et al.  Advances in Recursive Per-Pixel End-to-End Distortion Estimation for Robust Video Coding in H.264/AVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  H. Schulzrinne,et al.  A Transport Protocol for Real-time Applications , 2010 .

[3]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Wen Gao,et al.  Joint Source-Channel Rate-Distortion Optimization for H.264 Video Coding Over Error-Prone Networks , 2007, IEEE Transactions on Multimedia.

[5]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Yao Wang,et al.  Error-resilient video coding using multiple description motion compensation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Bernd Girod,et al.  Analysis of Packet Loss for Compressed Video: Effect of Burst Losses and Correlation Between Error Frames , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Thomas Wiegand,et al.  Rate-Distortion Optimization for JVT/H.26L Video Coding in Packet Loss Environment , 2002 .

[10]  A. Zoubir,et al.  EURASIP Journal on Advances in Signal Processing , 2011 .

[11]  Pascal Frossard,et al.  Multiple Description Video Coding With H.264/AVC Redundant Pictures , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Gabriella Olmo,et al.  Redundant Slice Optimal Allocation for H.264 Multiple Description Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[14]  Yao Zhao,et al.  Multiple Description Coding for H.264/AVC With Redundancy Allocation at Macro Block Level , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[16]  Jerry D. Gibson,et al.  Enhanced error resilience of video communications for burst losses using an extended ROPE algorithm , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[18]  Qin-Fan Zhu,et al.  Joint source coding, transport processing, and error concealment for H.323-based packet video , 1998, Electronic Imaging.

[19]  Hayder Radha,et al.  End-to-end Internet video traffic dynamics: statistical study and analysis , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[20]  Faouzi Kossentini,et al.  Optimal intra coding of blocks for robust video communication over the Internet , 1999, Signal Process. Image Commun..

[21]  Guizhong Liu,et al.  Compressed-Domain-Based Transmission Distortion Modeling for Precoded H.264/AVC Video , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Wanyi Gu,et al.  Modeling and Analysis of Distortion Caused by Markov-Model Burst Packet Losses in Video Transmission , 2009, IEEE Transactions on Circuits and Systems for Video Technology.