Error Resilient Video Coding Using B Pictures in H.264

Since the quality of compressed video is vulnerable to errors, video transmission over unreliable Internet is very challenging today. Multi-hypothesis motion-compensated prediction (MHMCP) has been shown to have error resilience capability for video transmission, where each macroblock is predicted by a linear combination of multiple signals (hypotheses). B picture prediction is a special case of MHMCP. In H.264/AVC, the prediction of B pictures is generalized such that both of the two predictions can be selected from the past pictures or from the subsequent pictures. The multiple reference picture framework in H.264/AVC also allows previously decoded B pictures to be used as references for B picture coding. In this paper, we will discuss the error resilience characteristics of the generalized B pictures in H.264/AVC. Three prediction patterns of B pictures are analyzed in terms of their error-suppressing abilities. Both theoretical models (picture level error propagation) and simulation results are given for the comparison.

[1]  Mohammed Ghanbari,et al.  Unequally Error Protected Data Partitioned Video with Combined Hierarchical Modulation and Channel Coding , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[2]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Madhukar Budagavi,et al.  Multiframe video coding for improved performance over wireless channels , 2001, IEEE Trans. Image Process..

[4]  Aggelos K. Katsaggelos,et al.  Review of Error Resilient Coding Techniques for Real-Time Video Communications , 2000 .

[5]  Chia-Wen Lin,et al.  H. 264 Error Resilience Coding Based on Multihypothesis Motion Compensated Prediction , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  John G. Apostolopoulos,et al.  Reliable video communication over lossy packet networks using multiple state encoding and path diversity , 2000, IS&T/SPIE Electronic Imaging.

[7]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[8]  Bernd Girod,et al.  Robust Low-Delay Video Transmission using H.264/AVC Redundant Slices and Flexible Macroblock Ordering , 2007, 2007 IEEE International Conference on Image Processing.

[9]  Markus Flierl,et al.  Generalized B pictures and the draft H.264/AVC video-compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[10]  E. Akyol,et al.  A Flexible Multiple Description Coding Framework for Adaptive Peer-to-Peer Video Streaming , 2007, IEEE Journal of Selected Topics in Signal Processing.

[11]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Chang-Su Kim,et al.  Robust MMSE video decoding: theory and practical implementations , 2005 .

[13]  Iain E. G. Richardson,et al.  Video Coding Standards: JPEG and MPEG , 2002 .

[14]  M. Reha Civanlar,et al.  Packet loss resilience of MPEG-2 scalable video coding algorithms , 1996, IEEE Trans. Circuits Syst. Video Technol..

[15]  Yao Wang,et al.  Modeling of transmission-loss-induced distortion in decoded video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Markus Flierl,et al.  Rate-Constrained Multi-Hypothesis Motion-Compensated Prediction for Video Coding , 2000, ICIP.

[17]  Peter Schelkens,et al.  Optimal Joint Source-Channel Coding using Unequal Error Protection for the Scalable Extension of H.264/MPEG-4 AVC , 2007, 2007 IEEE International Conference on Image Processing.

[18]  Chia-Wen Lin,et al.  H.264 Error Resilience Coding Based on Multi-hypothesis Motion Compensated Prediction and Adaptive Intra-refresh , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[19]  Miska M. Hannuksela,et al.  Isolated regions in video coding , 2004, IEEE Transactions on Multimedia.

[20]  Peter Schelkens,et al.  Embedded Multiple Description Coding of Video , 2006, IEEE Transactions on Image Processing.

[21]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[22]  Yao Wang,et al.  Error resilience property of multihypothesis motion-compensated prediction , 2002, Proceedings. International Conference on Image Processing.

[23]  Athanasios Leontaris,et al.  Video compression for lossy packet networks with mode switching and a dual-frame buffer , 2004, IEEE Transactions on Image Processing.

[24]  Wen-Liang Hwang,et al.  Efficient post-compression error-resilient 3D-scalable video transmission for packet erasure channels , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[25]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[26]  Zhihai He,et al.  Wireless Video , 2008, Encyclopedia of Multimedia.

[27]  Thomas Wiegand,et al.  Long-term memory motion-compensated prediction , 1999, IEEE Trans. Circuits Syst. Video Technol..

[28]  Yi Guo,et al.  Error Resilient Mode Decision in Scalable Video Coding , 2006, 2006 International Conference on Image Processing.

[29]  Ming-Ting Sun,et al.  Compressed Video Over Networks , 2000 .

[30]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[31]  Bernd Girod,et al.  Efficiency analysis of multihypothesis motion-compensated prediction for video coding , 2000, IEEE Trans. Image Process..

[32]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[33]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[34]  Bernd Girod,et al.  Analysis of error propagation in hybrid video coding with application to error resilience , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).