Joint source and channel coding for H.264 compliant stereoscopic video transmission

Stereoscopic video coding research has received considerable interest over the past decade as many 3D displays have been developed. Unfortunately, the vast amount of multimedia content needed to transmit or store a stereo image pair or video sequence has hindered its use in commercial applications. As H.264 offers significantly enhanced compression and a "network-friendly" feature, we have used a H.264 compliant stereoscopic video codec to compress stereo video. The data partitioning (DP) mode in NAL unit of the H.264 codec is exploited for the use of joint source and channel coding (JSCC) taking channel qualities and reliabilities into account. In this paper, we propose a framework of using unequal error protection (UEP) based JSCC scheme on the H.264 compliant stereoscopic video transmission for additive white Gaussian noise (AWGN) channel. Different levels of error protection are assigned to different partitions based on their decoding importance. Performance comparisons are made against equal error protection (EEP) schemes. Results from the simulation show that using UEP schemes, the overall quality of the decoded main and auxiliary video sequence were clearly improved in comparison with the EEP scheme at good SNR but EEP schemes outperformed UEP schemes at low SNR values

[1]  Avishai Henik,et al.  On stereo image coding , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[2]  Barry G. Haskell,et al.  Stereoscopic video compression using temporal scalability , 1995, Other Conferences.

[3]  Mathias Johanson.  Stereoscopic video transmission over the Internet , 2001, Proceedings. The Second IEEE Workshop on Internet Applications. WIAPP 2001.

[4]  Gary J. Sullivan,et al.  USING THE DRAFT H.26L VIDEO CODING STANDARD FOR MOBILE APPLICATIONS , 2001 .

[5]  Nan Jiang,et al.  Real-time transmission of stereo images over the access grid , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[6]  M. Lukacs,et al.  Predictive coding of multi-viewpoint image sets , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Warnakulasuriya Anil Chandana Fernando,et al.  A zerotree stereo video encoder , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[8]  William E. Ryan,et al.  Punctured turbo-codes for BPSK/QPSK channels , 1999, IEEE Trans. Commun..

[9]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[10]  James L Massey.  Joint Source and Channel Coding , 1977 .