Rate-distortion optimized layered stereoscopic video streaming with raptor codes

A near optimal streaming system for stereoscopic video is proposed. Initially, the stereoscopic video is separated into three layers and the approximate analytical model of the Rate-Distortion (RD) curve of each layer is calculated from sufficient number of rate and distortion samples. The analytical modeling includes the interdependency of the defined layers. Then, the analytical models are used to derive the optimal source encoding rates for a given channel bandwidth. The distortion in the quality of the stereoscopic video that is caused by losing a NAL unit from the defined layers is estimated to minimize the average distortion of a single NAL unit loss. The minimization is performed over protection rates allocated to each layer. Raptor codes are utilized as the error protection scheme due to their novelty and suitability in video transmission. The layers are protected unequally using Raptor codes according to the parity ratios allocated to the layers. Comparison of the defined scheme with two other protection allocation schemes is provided via simulations to observe the quality of stereoscopic video.

[1]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[2]  Bernd Girod,et al.  Packet-loss-resilient Internet video streaming , 1998, Electronic Imaging.

[3]  Gozde Bozdagi Akar,et al.  A Multi-View Video Codec Based on H.264 , 2006, 2006 International Conference on Image Processing.

[4]  Wen Xu,et al.  Raptor codes for reliable download delivery in wireless broadcast systems , 2006, CCNC 2006. 2006 3rd IEEE Consumer Communications and Networking Conference, 2006..

[5]  Thomas Stockhammer,et al.  Reliable Multimedia Download Delivery in Cellular Broadcast Networks , 2007, IEEE Transactions on Broadcasting.

[6]  Alan F. Lippman,et al.  Video coding for streaming media delivery on the Internet , 2001, IEEE Trans. Circuits Syst. Video Technol..

[7]  James W. Modestino,et al.  H.263+ packet video over wireless IP networks using rate-compatible punctured turbo (RCPT) codes with joint source-channel coding , 2002, Proceedings. International Conference on Image Processing.

[8]  P. Maymounkov Online codes , 2002 .

[9]  Michael Luby,et al.  LT codes , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[10]  Michael Luby,et al.  A digital fountain approach to reliable distribution of bulk data , 1998, SIGCOMM '98.

[11]  Zixiang Xiong,et al.  Error-Resilient Unequal Error Protection of Fine Granularity Scalable Video Bitstreams , 2006, EURASIP J. Adv. Signal Process..

[12]  Pascal Frossard,et al.  Streaming of Scalable Video from Multiple Servers using Rateless Codes , 2006, 2006 IEEE International Conference on Multimedia and Expo.