Packetization strategies for MVD-based 3D video transmission

In multi-view video plus depth (MVD) format, virtual views are synthesized by the compressed texture videos and their associated depth through depth-image-based rendering. In this paper, we consider the setup where both the encoded texture and depth bitstreams experience packet losses during transmission. Different packetization strategies are investigated and a novel strategy is developed to improve error resilience of MVD-based video transmission, where texture data and its corresponding depth are put into the same packet. The size of texture plus associated depth data included in each packet needs to be less than the Maximum Transfer Unit (MTU). Experimental results demonstrate that our proposed packetization scheme yields a significant improvement in terms of both texture views and synthesized virtual views quality when fit in H.264/AVC.

[1]  Yiwei Thomas Hou,et al.  MPEG4 compressed video over the Internet , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[2]  Dong Zhang,et al.  View Synthesis Distortion Estimation With a Graphical Model and Recursive Calculation of Probability Distribution , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Wei Xiang,et al.  Rate-Distortion Optimized Mode Switching for Error-Resilient Multi-View Video Plus Depth Based 3-D Video Coding , 2014, IEEE Transactions on Multimedia.

[4]  Bruno Macchiavello,et al.  Loss-Resilient Coding of Texture and Depth for Free-Viewpoint Video Conferencing , 2013, IEEE Transactions on Multimedia.

[5]  Chang-Su Kim,et al.  Frame loss concealment for stereoscopic video plus depth sequences , 2011, IEEE Transactions on Consumer Electronics.

[6]  Thomas Maugey,et al.  Temporal and Inter-View Consistent Error Concealment Technique for Multiview Plus Depth Video , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Dong Tian,et al.  View synthesis techniques for 3D video , 2009, Optical Engineering + Applications.