Warping-driven mode selection for depth error concealment

This paper deals with the recovery of corrupted depth maps in loss-prone networks. Different from color maps, depth maps are not directly used for display but served for view synthesis process. Therefore, the conventional concealment methods which focus on reducing the distortion of reconstructed color maps, are not suitable for the corrupted depth maps. In this paper, a novel mode selection method for depth error concealment is proposed to efficiently reconstruct the lost depth blocks. To this end, three modes, i.e., INTRA, INTER, and MV sharing, are applied as candidate modes to achieve the concealed depth blocks. In order to provide acceptable synthesized views, the optimal mode selection is based on a new distortion function, in which warping process is taken into account. Experimental results show that the proposed method outperforms the conventional schemes up to 0.65 dB on the synthesized views, at block loss rate up to 20%. Most important of all, the subjective quality of synthesized views are much better due to the consideration of warping process in the mode selection.

[1]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[2]  Ahmet M. Kondoz,et al.  Frame concealment algorithm for stereoscopic video using motion vector sharing , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[3]  Bo Yan,et al.  Efficient Frame Concealment for Depth Image-Based 3-D Video Transmission , 2012, IEEE Transactions on Multimedia.

[4]  Sylvain Marcelino,et al.  Lost block reconstruction in depth maps using color image contours , 2012, 2012 Picture Coding Symposium.

[5]  Bo Yan A Novel H.264 Based Motion Vector Recovery Method for 3D Video Transmission , 2007, IEEE Transactions on Consumer Electronics.

[6]  Nanning Zheng,et al.  Depth-Assisted Temporal Error Concealment for Intra Frame Slices in 3-D Video , 2014, IEEE Transactions on Broadcasting.

[7]  Jin Wang,et al.  Depth Image-Based Temporal Error Concealment for 3-D Video Transmission , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Miska M. Hannuksela,et al.  The error concealment feature in the H.26L test model , 2002, Proceedings. International Conference on Image Processing.

[9]  Ying Chen,et al.  The Emerging MVC Standard for 3D Video Services , 2008, EURASIP J. Adv. Signal Process..

[10]  Sylvain Marcelino,et al.  Error recovery of image-based depth maps using Bézier curve fitting , 2011, 2011 18th IEEE International Conference on Image Processing.

[11]  Luc Van Gool,et al.  Advanced three-dimensional television system technologies , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[12]  James Nightingale,et al.  HEVStream: a framework for streaming and evaluation of high efficiency video coding (HEVC) content in loss-prone networks , 2012, IEEE Transactions on Consumer Electronics.

[13]  Pamela C. Cosman,et al.  Packet Loss Visibility of View+Depth Compressed Stereo 3D Video , 2013, 2013 20th International Packet Video Workshop.

[14]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.