Dynamic Sub-GOP Forward Error Correction Code for Real-Time Video Applications

Reed-Solomon erasure codes are commonly studied as a method to protect the video streams when transmitted over unreliable networks. As a block-based error correcting code, on one hand, enlarging the block size can enhance the performance of the Reed-Solomon codes; on the other hand, large block size leads to long delay which is not tolerable for real-time video applications. In this paper a novel Dynamic Sub-GOP FEC (DSGF) approach is proposed to improve the performance of Reed-Solomon codes for video applications. With the proposed approach, the Sub-GOP, which contains more than one video frame, is dynamically tuned and used as the RS coding block, yet no delay is introduced. For a fixed number of extra introduced packets, for protection, the length of the Sub-GOP and the redundancy devoted to each Sub-GOP becomes a constrained optimization problem. To solve this problem, a fast greedy algorithm is proposed. Experimental results show that the proposed ap proach outperforms other real-time error resilient video coding technologies.

[1]  Michael G. Strintzis,et al.  Robust Transmission of H.264/AVC Video using Adaptive Slice Grouping and Unequal Error Protection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[2]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[3]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Wen Gao,et al.  Joint Source-Channel Rate-Distortion Optimization for H.264 Video Coding Over Error-Prone Networks , 2007, IEEE Transactions on Multimedia.

[6]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Hayder Radha,et al.  Delay Constraint Error Control Protocol for Real-Time Video Communication , 2009, IEEE Transactions on Multimedia.

[8]  Hayder Radha,et al.  End-to-end Internet video traffic dynamics: statistical study and analysis , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[9]  Zhengguo Li,et al.  An unequal packet loss resilience scheme for video over the Internet , 2005, IEEE Transactions on Multimedia.

[10]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[11]  Shivendra S. Panwar,et al.  A reference picture selection scheme for video transmission over ad-hoc networks using multiple paths , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[12]  Yao Zhao,et al.  Real-time forward error correction for video transmission , 2011, 2011 Visual Communications and Image Processing (VCIP).

[13]  Gabriella Olmo,et al.  Slice Sorting for Unequal Loss Protection of Video Streams , 2008, IEEE Signal Processing Letters.

[14]  Jae S. Lim,et al.  End-to-End Rate-Distortion Optimized MD Mode Selection for Multiple Description Video Coding , 2006, EURASIP J. Adv. Signal Process..

[15]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[16]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[17]  Pascal Frossard,et al.  Multiple Description Video Coding With H.264/AVC Redundant Pictures , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[19]  Bernd Girod,et al.  Feedback-based error control for mobile video transmission , 1999, Proc. IEEE.

[20]  Bernd Girod,et al.  Analysis of error propagation in hybrid video coding with application to error resilience , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[21]  Gabriella Olmo,et al.  Redundant Slice Optimal Allocation for H.264 Multiple Description Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Pascal Frossard FEC performance in multimedia streaming , 2001, IEEE Communications Letters.