Improving the coding performance of 3D video using guided depth filtering

Autostereoscopic displays visualize a 3D scene based on encoded texture and depth information, which often lack the quality of good depth maps. Therefore, display manufacturers introduce different filtering techniques to improve the subjective quality of the reconstructed 3D image. This paper investigates the coding performance when applying depth filtering in a pre-processing step. As an example, guided depth filtering is used at the encoder side, which results in a 1.7% coding gain for 3D-HEVC and 8.0% for Multiview HEVC. However, applying additional filtering at the decoder side might deteriorate the subjective quality. Therefore, adaptively filtering based on the applied pre-processor filter is suggested, which can be done using a supplemental enhancement information message. For natural content, a gain of 5.7% and 9.3% is reported using this approach.

[1]  Yo-Sung Ho,et al.  3D scene capturing using stereoscopic cameras and a time-of-flight camera , 2011, IEEE Transactions on Consumer Electronics.

[2]  Rik Van de Walle,et al.  Guided depth filtering to improve the quality of experience for autostereoscopic displays , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[3]  Sung-Jea Ko,et al.  Depth Map Based Image Enhancement Using Color Stereopsis , 2012, IEEE Signal Processing Letters.

[4]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[5]  Seung-Won Jung,et al.  Enhancement of Image and Depth Map Using Adaptive Joint Trilateral Filter , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Yo-Sung Ho,et al.  Generation of high-quality depth maps using hybrid camera system for 3-D video , 2011, J. Vis. Commun. Image Represent..

[7]  Toshiaki Fujii,et al.  Multiview Video Coding Using View Interpolation and Color Correction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.