Depth Map Coding for 3DTV Applications

The communication of multi-view videos requires the transmission and storage of huge amounts of data. To reduce this storage and bandwidth requirements, a reduced set of videos together with the depth information can be used. The 3D geometry information in the depth maps is used in conjunction with the texture information to generate any intermediate view between two received video streams. Unlike texture information, depth data is characterized by large homogeneous areas and sharp edges, where the latter define object boundaries. These different features imply that encoding of depth maps with the standard texture encoder might not be optimal and thus different methods can be used to improve the coding efficiency of depth maps. This chapter presents coding algorithms used for the compression of depth maps in 3DTV applications.

[1]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[2]  Detlev Marpe,et al.  Depth Intra Coding for 3D Video Based on Geometric Primitives , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Sebastian Schwarz,et al.  Adaptive depth filtering for HEVC 3D video coding , 2012, 2012 Picture Coding Symposium.

[4]  Eduardo A. B. da Silva,et al.  Predictive depth map coding for efficient virtual view synthesis , 2013, 2013 IEEE International Conference on Image Processing.

[5]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[6]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[7]  Detlev Marpe,et al.  3D video: Depth coding based on inter-component prediction of block partitions , 2012, 2012 Picture Coding Symposium.

[8]  Sérgio M. M. de Faria,et al.  A novel trilateral filter technique for depth map processing in 3D video coding , 2014, 2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[9]  Klaus Diepold,et al.  Fast Depth Map Compression and Meshing with Compressed Tritree , 2009, ACCV.

[10]  Li Yu,et al.  A Joint Texture/Depth Edge-Directed Up-sampling Algorithm for Depth Map Coding , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[11]  Chun-Su Park,et al.  Edge-Based Intramode Selection for Depth-Map Coding in 3D-HEVC , 2015, IEEE Transactions on Image Processing.

[12]  Jiangbin Zheng,et al.  Edge-Guided Depth Map Resampling for HEVC 3D Video Coding , 2013, 2013 International Conference on Virtual Reality and Visualization.

[13]  Yo-Sung Ho,et al.  View Synthesis using Depth Map for 3D Video , 2009 .

[14]  Toshiaki Fujii,et al.  Free-Viewpoint TV , 2011, IEEE Signal Processing Magazine.

[15]  Eduardo A. B. da Silva,et al.  Multiscale recurrent pattern matching approach for depth map coding , 2010, 28th Picture Coding Symposium.

[16]  Jianjun Lei,et al.  Depth Sensation Enhancement for Multiple Virtual View Rendering , 2015, IEEE Transactions on Multimedia.

[17]  Krzysztof Wegner,et al.  Intra Predictive Depth Map Coding Using Flexible Block Partitioning , 2015, IEEE Transactions on Image Processing.

[18]  Eduardo A. B. da Silva,et al.  Efficient depth map coding using linear residue approximation and a flexible prediction framework , 2012, 2012 19th IEEE International Conference on Image Processing.

[19]  Aljoscha Smolic,et al.  Reliability-based generation and view synthesis in layered depth video , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[20]  Jianhua Zheng,et al.  Fast bi-partition mode selection for 3D HEVC depth intra coding , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[21]  F. Jager.  Simplified depth map intra coding with an optional depth lookup table , 2012, 2012 International Conference on 3D Imaging (IC3D).

[22]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[23]  Heiko Schwarz,et al.  Extension of High Efficiency Video Coding (HEVC) for multiview video and depth data , 2012, 2012 19th IEEE International Conference on Image Processing.

[24]  Carl J. Debono,et al.  Depth-based image processing for 3d video rendering applications , 2014, IWSSIP 2014 Proceedings.

[25]  Eduardo A. B. da Silva,et al.  Multiscale recurrent pattern image coding with a flexible partition scheme , 2008, 2008 15th IEEE International Conference on Image Processing.

[26]  Dong Tian,et al.  Depth map up-sampling based on edge layers , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[27]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Hai Tao,et al.  Compression and transmission of depth maps for image-based rendering , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[29]  Koichi Harada,et al.  View synthesis with depth information based on graph cuts for FTV , 2013, The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision.

[30]  Carl J. Debono,et al.  A fast inter-component depth modeling technique for 3D high effiency video coding , 2015, 2015 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[31]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[32]  Thomas Wiegand,et al.  3D video coding with depth modeling modes and view synthesis optimization , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[33]  Ju Liu,et al.  DIBR based view synthesis for free-viewpoint television , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[34]  Nuno M. M. Rodrigues,et al.  Compressing depth maps using multiscale recurrent pattern image coding , 2010 .

[35]  Yo-Sung Ho,et al.  Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video , 2009, IEEE Signal Processing Letters.

[36]  Mathias Wien,et al.  High Efficiency Video Coding: Coding Tools and Specification , 2014 .

[37]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..

[38]  T. Fujii,et al.  Color based depth up-sampling for depth compression , 2010, 28th Picture Coding Symposium.

[39]  Oscar C. Au,et al.  Multiresolution Graph Fourier Transform for Compression of Piecewise Smooth Images , 2015, IEEE Transactions on Image Processing.

[40]  Chun-Su Park.  Efficient intra-mode decision algorithm skipping unnecessary depth-modelling modes in 3D-HEVC , 2015 .

[41]  Yo-Sung Ho,et al.  Virtual view synthesis method and self‐evaluation metrics for free viewpoint television and 3D video , 2010, Int. J. Imaging Syst. Technol..

[42]  Antonio Ortega,et al.  Edge-preserving intra depth coding based on context-coding and H.264/AVC , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[43]  Feng Yan,et al.  Stereoacuity-guided depth image based rendering , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[44]  Peter H. N. de With,et al.  Quality improving techniques in DIBR for free-viewpoint video , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[45]  Jaejoon Lee,et al.  Edge-aware intra prediction for depth-map coding , 2010, 2010 IEEE International Conference on Image Processing.

[46]  Itu-T and Iso Iec Jtc.  Advanced video coding for generic audiovisual services , 2010 .

[47]  Toshiaki Fujii,et al.  View Generation with 3D Warping Using Depth Information for FTV , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[48]  Yo-Sung Ho,et al.  Simplified inter-component depth modeling in 3D-HEVC , 2013, IVMSP 2013.

[49]  Byung Tae Oh,et al.  Plane segmentation based intra prediction for depth map coding , 2012, 2012 Picture Coding Symposium.

[50]  Jianhua Zheng,et al.  Fast Depth Modeling Mode selection for 3D HEVC depth intra coding , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[51]  Mengmeng Zhang,et al.  A fast depth-map wedgelet partitioning scheme for intra prediction in 3D video coding , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[52]  Baoxin Li,et al.  Virtual View Specification and Synthesis for Free Viewpoint Television , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[53]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.