Multiple Description Coding for Stereoscopic Videos With Stagger Frame Order

Due to the prediction structures employed in video coding, the loss of one packet will affect many following frames. In this paper, a multiple description coding scheme with stagger frame order is proposed for stereoscopic 3-D videos. First, the reference and auxiliary views in stereoscopic sequences will be asymmetrically encoded into one description, whereas the other description will be formed in the same way with one dumb frame delay. Because of the stagger frame order, the coarsely encoded B frames will be inserted into different positions of the two descriptions. If a certain frame encoded with I/P mode is lost, then its corresponding B-frame version will be employed to compensate for the loss. In each description, the quantization steps of B frames are tuned based on a closed-form solution that considers the video contents, network status, frame positions in the group of picture, and the layer of the views. For further improvement, a fusing scheme is provided. The experimental results demonstrate that the proposed scheme outperforms state-of-the-art schemes. Specifically, up to 1.3-dB gain is achieved in the case of packet loss, and 2-dB gain is obtained for the side/central performance.

[1]  Zhi Liu,et al.  Selective Disparity Estimation and Variable Size Motion Estimation Based on Motion Homogeneity for Multi-View Coding , 2009, IEEE Transactions on Broadcasting.

[2]  Gozde Bozdagi Akar,et al.  Rate-Distortion Optimization for Stereoscopic Video Streaming with Unequal Error Protection , 2009, EURASIP J. Adv. Signal Process..

[3]  Canhui Cai,et al.  Mode Duplication Based Multiview Multiple Description Video Coding , 2013, 2013 Data Compression Conference.

[4]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[5]  Abbes Amira,et al.  Efficient transmission of multiview video over unreliable channels , 2013, 2013 IEEE International Conference on Image Processing.

[6]  Pedro Assuncao,et al.  Asymmetric 3D video coding using regions of perceptual relevance , 2012, 2012 International Conference on 3D Imaging (IC3D).

[7]  A. Murat Tekalp,et al.  Evaluation of Asymmetric Stereo Video Coding and Rate Scaling for Adaptive 3D Video Streaming , 2011, IEEE Transactions on Broadcasting.

[8]  Tao Chen,et al.  3D-TV Content Storage and Transmission , 2011, IEEE Transactions on Broadcasting.

[9]  Weisi Lin,et al.  Saliency detection for stereoscopic images , 2013, 2013 Visual Communications and Image Processing (VCIP).

[10]  Jaakko Astola,et al.  Schemes for Multiple Description Coding of Stereoscopic Video , 2006, MRCS.

[11]  Ahmet M. Kondoz,et al.  Multiple description video coding for stereoscopic 3D , 2009, IEEE Transactions on Consumer Electronics.

[12]  Yao Zhao,et al.  A Real-Time Error Resilient Video Streaming Scheme Exploiting the Late- and Early-Arrival Packets , 2013, IEEE Transactions on Broadcasting.

[13]  A. Murat Tekalp,et al.  Quality assessment of asymmetric stereo video coding , 2010, 2010 IEEE International Conference on Image Processing.

[14]  Narciso García,et al.  Subjective evaluation of transmission errors in IPTV and 3DTV , 2011, 2011 Visual Communications and Image Processing (VCIP).

[15]  Yao Wang,et al.  Multiple Description Coding for Video Delivery , 2005, Proceedings of the IEEE.

[16]  Miska M. Hannuksela,et al.  Subjective study on compressed asymmetric stereoscopic video , 2010, 2010 IEEE International Conference on Image Processing.

[17]  Yao Zhao,et al.  Two-Stage Diversity-Based Multiple Description Image Coding , 2008, IEEE Signal Processing Letters.

[18]  Yao Zhao,et al.  Real-Time Video Streaming Using Randomized Expanding Reed–Solomon Code , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Abdelrahman Abdelazim,et al.  Fast prediction algorithm for multiview video coding , 2013 .

[20]  Vanessa Testoni,et al.  Joint source-channel coding of 3D video using multiview coding , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  A.S. Tan,et al.  Error Resilient Layered Stereoscopic Video Streaming , 2007, 2007 3DTV Conference.

[22]  A. Serdar Tan,et al.  Rate-distortion optimized layered stereoscopic video streaming with raptor codes , 2007, Packet Video 2007.

[23]  Gabriella Olmo,et al.  Redundant Slice Optimal Allocation for H.264 Multiple Description Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.