Temporal dispersal of multiple representations for error-resilient video streaming

Video streaming over wireless and cellular networks is severely hampered by the presence of burst errors and signal loss intervals. In this paper, we propose a scheme for error-resilient video streaming known as Multiple Representation Coding (MRC). In the MRC scheme, multiple independently decodable representations are generated from the source video. These multiple representations are then temporally dispersed and transmitted as a single video stream using a novel GOP interleaving scheme (GOP: Group of Pictures). By temporally dispersing the multiple representations, the GOP-interleaver ensures that spatio-temporally co-located segments of the video sequence corresponding to different representations are not impaired by the same burst loss, even when transmitted over a single channel. Simulation results demonstrate that in contrast to conventional full-size encoding and transmission of the video sequence, the MRC scheme can facilitate a graceful recovery from impairments introduced by burst and signal losses over the network.

[1]  Albert Wang,et al.  FEC and pseudo-ARQ for receiver-driven layered multicast of audio and video , 2000, Proceedings DCC 2000. Data Compression Conference.

[2]  John G. Apostolopoulos,et al.  Reliable video communication over lossy packet networks using multiple state encoding and path diversity , 2000, IS&T/SPIE Electronic Imaging.

[3]  Shivendra S. Panwar,et al.  Video transport over ad hoc networks: multistream coding with multipath transport , 2003, IEEE J. Sel. Areas Commun..

[4]  Mathias Johanson,et al.  Adaptive Forward Error Correction for Real-time Internet Video , 2003 .

[5]  Roberto Rinaldo,et al.  Polyphase spatial subsampling multiple description coding of video streams with H264 , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  Yao Wang,et al.  Multiple Description Coding for Video Delivery , 2005, Proceedings of the IEEE.

[7]  Arturo A. Rodriguez,et al.  Adaptive GOP-length Multiple Representation Coding for error-resilient video delivery , 2012 .

[8]  Sethuraman Panchanathan,et al.  Error resiliency schemes in H.264/AVC standard , 2006, J. Vis. Commun. Image Represent..

[9]  Andrew S. Glassner,et al.  Graphics Gems , 1990 .

[10]  Bernd Girod,et al.  Analysis of packet loss for compressed video: does burst-length matter? , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[11]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..