Real-Time Video Streaming Using Randomized Expanding Reed–Solomon Code

Forward error correction (FEC) codes are widely studied to protect streamed video over unreliable networks. Typically, enlarging the FEC coding block size can improve the error correction performance. For video streaming applications, this could be implemented by grouping more than one video frame into one FEC coding block. However, in this case, it leads to decoding delay, which is not tolerable for real-time video streaming applications. In this paper, to solve this dilemma, a real-time video streaming scheme using randomized expanding Reed-Solomon (RS) code is proposed. In this scheme, the RS coding block includes not only the video packets of the current frame, but could also include all the video packets of previous frames in the current group of pictures. At the decoding side, the parity-check equations of the current frame are jointly solved with all the parity-check equations of the previous frames. Since video packets of the following frames are not encompassed in the RS coding block, no delay will be caused for waiting for the video or parity packets of the following frames both at encoding and decoding sides. Experimental results show that the proposed scheme outperforms other real-time error resilient video streaming approaches significantly, specifically, for the Foreman sequence, the proposed scheme could provide 1.5 dB average gain over the state-of-the-art approach for 10% i.i.d. packet loss rate, whereas for the burst loss case, the average gain is more than 3 dB.MATLAB code of this paper is available for download at http://www.mmtlab.com.

[1]  Yao Zhao,et al.  Real-time forward error correction for video transmission , 2011, 2011 Visual Communications and Image Processing (VCIP).

[2]  Ebroul Izquierdo,et al.  Rate-Distortion Optimized Motion-Compensated Prediction for Packet Loss Resilient Video Coding , 2007, IEEE Transactions on Image Processing.

[3]  Klaus Diepold,et al.  Complexity Constrained Robust Video Transmission for Hand-Held Devices , 2007, 2007 IEEE International Conference on Image Processing.

[4]  Jérôme Lacan,et al.  Dependency-aware unequal erasure protection codes , 2006 .

[5]  Hayder Radha,et al.  Delay Constraint Error Control Protocol for Real-Time Video Communication , 2009, IEEE Transactions on Multimedia.

[6]  Jae S. Lim,et al.  End-to-End Rate-Distortion Optimized MD Mode Selection for Multiple Description Video Coding , 2006, EURASIP J. Adv. Signal Process..

[7]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[8]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Injong Rhee,et al.  Error recovery for interactive video transmission over the Internet , 2000, IEEE Journal on Selected Areas in Communications.

[10]  Wen Gao,et al.  Joint Source-Channel Rate-Distortion Optimization for H.264 Video Coding Over Error-Prone Networks , 2007, IEEE Transactions on Multimedia.

[11]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Hua Yang,et al.  Optimizing Motion Compensated Prediction for Error Resilient Video Coding , 2010, IEEE Transactions on Image Processing.

[13]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[14]  Sergios Theodoridis,et al.  A Novel Efficient Cluster-Based MLSE Equalizer for Satellite Communication Channels with-QAM Signaling , 2006, EURASIP J. Adv. Signal Process..

[15]  Laurence B. Milstein,et al.  Channel Coding Optimization Based on Slice Visibility for Transmission of Compressed Video over OFDM Channels , 2012, IEEE Journal on Selected Areas in Communications.

[16]  Hayder Radha,et al.  End-to-end Internet video traffic dynamics: statistical study and analysis , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[17]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[18]  Yao Zhao,et al.  Dynamic Sub-GOP Forward Error Correction Code for Real-Time Video Applications , 2012, IEEE Transactions on Multimedia.

[19]  Yao Zhao,et al.  Error-resilient video coding with end-to-end rate-distortion optimized at macroblock level , 2011, EURASIP J. Adv. Signal Process..

[20]  Mohammed Ghanbari Postprocessing of late cells for packet video , 1996, IEEE Trans. Circuits Syst. Video Technol..

[21]  Shivendra S. Panwar,et al.  A reference picture selection scheme for video transmission over ad-hoc networks using multiple paths , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[22]  Thomas Stockhammer,et al.  Raptor Forward Error Correction Scheme for Object Delivery , 2007, RFC.

[23]  Zhengguo Li,et al.  An unequal packet loss resilience scheme for video over the Internet , 2005, IEEE Transactions on Multimedia.

[24]  Gabriella Olmo,et al.  Redundant Slice Optimal Allocation for H.264 Multiple Description Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Michael Welzl,et al.  Optimizing Selective ARQ for H.264 Live Streaming: A Novel Method for Predicting Loss-Impact in Real Time , 2012, IEEE Transactions on Multimedia.

[26]  Pierpaolo Baccichet,et al.  Systematic Lossy Error Protection based on H.264/AVC redundant slices and flexible macroblock ordering , 2006 .

[27]  Enrico Magli,et al.  Sliding-Window Raptor Codes for Efficient Scalable Wireless Video Broadcasting With Unequal Loss Protection , 2010, IEEE Transactions on Image Processing.

[28]  Mihaela van der Schaar,et al.  A Low-Complexity Analytical Modeling for Cross-Layer Adaptive Error Protection in Video Over WLAN , 2010, IEEE Transactions on Multimedia.

[29]  A. Murat Tekalp,et al.  Stochastic frame buffers for rate distortion optimized loss resilient video communications , 2005, IEEE International Conference on Image Processing 2005.

[30]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Zixiang Xiong,et al.  Scalable Video Multicast Using Expanding Window Fountain Codes , 2009, IEEE Transactions on Multimedia.

[32]  Gabriella Olmo,et al.  Slice Sorting for Unequal Loss Protection of Video Streams , 2008, IEEE Signal Processing Letters.

[33]  Michael G. Strintzis,et al.  Robust Transmission of H.264/AVC Video using Adaptive Slice Grouping and Unequal Error Protection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[34]  Thomas Wiegand,et al.  Layer-Aware Forward Error Correction for Mobile Broadcast of Layered Media , 2011, IEEE Transactions on Multimedia.

[35]  Pascal Frossard,et al.  Multiple Description Video Coding With H.264/AVC Redundant Pictures , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[37]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[38]  Joseph P. Brennan,et al.  Remarks on the probability the determinant of an n × n-matrix over a finite field vanishes , 1987, Discret. Math..