Frame concealment algorithm for stereoscopic video using motion vector sharing

Stereoscopic video is one of the simplest forms of multi view video, which can be easily adapted for communication applications. Much current research is based on colour and depth map stereoscopic video, due to its reduced bandwidth requirements and backward compatibility. Existing immersive media research is more focused on application processing than aspects related to transfer of immersive content over communication channels. As video over packet networks is affected by missing frames, caused by packet loss, this paper proposes a frame concealment method for colour and depth map based stereoscopic video. The proposed method exploits the motion correlation of colour and depth map image sequences. The colour motion information is reused for prediction during depth map coding. The redundant motion information is then used to conceal transmission errors at the decoder. The experimental results show that the proposed frame concealment scheme performs better than applying error concealment for colour and depth map video separately in a range of packet error conditions.

[1]  Thomas Sikora,et al.  Robust concealment for erroneous block bursts in stereoscopic images , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[2]  Ahmet M. Kondoz,et al.  Stereoscopic TV over IP , 2007 .

[3]  Ahmet M. Kondoz,et al.  Comparison of stereo video coding support in MPEG-4 MAC, H.264/AVC and H.264/SVC , 2007 .

[4]  Thomas Sikora,et al.  A gradient based approach for stereoscopic error concealment , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[5]  A. Murat Tekalp,et al.  Transport Methods in 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Erika Müller,et al.  Sharing of motion vectors in 3D video coding , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[7]  Thomas Sikora,et al.  A HYBRID APPROACH FOR ERROR CONCEALMENT IN STEREOSCOPIC IMAGES , 2004 .

[8]  C. Fehn A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR ) , 2003 .

[9]  Yo-Sung Ho,et al.  H.264-Based Depth Map Sequence Coding Using Motion Information of Corresponding Texture Video , 2006, PSIVT.

[10]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[12]  C. Fehn,et al.  Interactive 3-DTV-Concepts and Key Technologies , 2006 .