Dynamic redundancy allocation for video streaming using Sub-GOP based FEC code

Reed-Solomon erasure code is one of the most studied protection methods for video streaming over unreliable networks. As a block-based error correcting code, large block size and increased number of parity packets will enhance its protection performance. However, for video applications this enhancement is sacrificed by the error propagation and the increased bitrate. So, to tackle this paradox, we propose a rate-distortion optimized redundancy allocation scheme, which takes into consideration the distortion caused by losing each slice and the propagated error. Different from other approaches, the amount of introduced redundancy and the way it is introduced are automatically selected without human interventions based on the network condition and video characteristics. The redundancy allocation problem is formulated as a constraint optimization problem, which allows to have more flexibility in setting the block-wise redundancy. The proposed scheme is implemented in JM14.0 for H.264, and it achieves an average gain of 1dB over the state-of-the-art approach.

[1]  Michael G. Strintzis,et al.  Robust Transmission of H.264/AVC Video using Adaptive Slice Grouping and Unequal Error Protection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[2]  Pascal Frossard,et al.  Multiple Description Video Coding With H.264/AVC Redundant Pictures , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Wen Gao,et al.  Joint Source-Channel Rate-Distortion Optimization for H.264 Video Coding Over Error-Prone Networks , 2007, IEEE Transactions on Multimedia.

[4]  Tarik Taleb,et al.  Forward error correction strategies for media streaming over wireless networks , 2008, IEEE Communications Magazine.

[5]  Gabriella Olmo,et al.  Redundant Slice Optimal Allocation for H.264 Multiple Description Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Zhengguo Li,et al.  An unequal packet loss resilience scheme for video over the Internet , 2005, IEEE Transactions on Multimedia.

[7]  Yao Zhao,et al.  Dynamic Sub-GOP Forward Error Correction Code for Real-Time Video Applications , 2012, IEEE Transactions on Multimedia.

[8]  Bernd Girod,et al.  Analysis of error propagation in hybrid video coding with application to error resilience , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[9]  Hayder Radha,et al.  Delay Constraint Error Control Protocol for Real-Time Video Communication , 2009, IEEE Transactions on Multimedia.

[10]  Xingjun Zhang,et al.  Robust H.264/AVC Video Transmission using Data Partitioning and Unequal Loss Protection , 2010, 2010 10th IEEE International Conference on Computer and Information Technology.

[11]  Shivendra S. Panwar,et al.  A reference picture selection scheme for video transmission over ad-hoc networks using multiple paths , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[12]  Gabriella Olmo,et al.  Slice Sorting for Unequal Loss Protection of Video Streams , 2008, IEEE Signal Processing Letters.