Improved reconstruction of downsampled MV-HEVC depth video

The multiview video-plus-depth format provides a promising solution for the transmission of three-dimensional video. This format can be transmitted using the multiview high efficiency video coding (MV-HEVC) standard, where the texture and the depth videos are encoded and transmitted separately. The depth maps have large homogeneous areas making their downsampling before transmission and their upsampling at the receiver an attractive option to reduce bandwidth requirements. However, this process results in distortions of the sharp edges also characteristic of depth maps, causing artefacts in the synthesized views. This work exploits the edges found in the corresponding texture view and uses a novel edge detection and depth map painting algorithm to improve the reconstruction of the edges in the upsampled depth maps. Test results show that this solution can improve the quality of depth maps by up to 2.35dB compared to other methods found in literature.

[1]  Heiko Schwarz,et al.  Extension of High Efficiency Video Coding (HEVC) for multiview video and depth data , 2012, 2012 19th IEEE International Conference on Image Processing.

[2]  Guangxue Yue,et al.  The Study on An Application of Otsu Method in Canny Operator , 2009 .

[3]  Ardeshir Goshtasby,et al.  On the Canny edge detector , 2001, Pattern Recognit..

[4]  Jiangbin Zheng,et al.  Edge-Guided Depth Map Resampling for HEVC 3D Video Coding , 2013, 2013 International Conference on Virtual Reality and Visualization.

[5]  T. Fujii,et al.  Color based depth up-sampling for depth compression , 2010, 28th Picture Coding Symposium.

[6]  Yo-Sung Ho,et al.  Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video , 2009, IEEE Signal Processing Letters.

[7]  Sérgio M. M. de Faria,et al.  A novel trilateral filter technique for depth map processing in 3D video coding , 2014, 2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[8]  Yao Wang,et al.  Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model , 2014, IEEE Transactions on Image Processing.

[9]  Sebastian Schwarz,et al.  Adaptive depth filtering for HEVC 3D video coding , 2012, 2012 Picture Coding Symposium.

[10]  Dong Tian,et al.  Depth map up-sampling based on edge layers , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[11]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.