Simplified search algorithm for explicit wedgelet signalization mode in 3D-HEVC

As the latest 3D video coding standard, 3D High Efficiency Video Coding (3D-HEVC) achieves efficient coding. Depth coding plays an important role in 3D-HEVC. For better prediction of edges in depth maps, new depth intra modes were proposed, such as Depth Modeling Modes (DMMs). DMM Mode 1, namely explicit wedgelet signalization mode, can improve the performance of synthesized views, but leads to unaffordable encoding computation complexity. In this paper, a simplified search algorithm for explicit wedgelet signalization mode is proposed to predigest the complex search process. First, the proposed algorithm only searches the partition patterns in a limited set based on edge detection in the coarse search stage, since the separation line in the best matching pattern should be similar to the edge in an actual depth prediction unit (PU). Then, a wide range of refinement is implemented to guarantee the coding performance. In fact, up to 24 refinements are tested to provide accurate prediction in the refinement process. Experimental results show that considerable encoding time saving is achieved with negligible performance loss. For all intra test cases, the proposed algorithm achieves an average encoding time saving of 75% for DMM Mode 1 with negligible bitrate increase on synthesized views, compared with the default coarse-refinement algorithm in HTM.

[1]  Jianjun Lei,et al.  Fast Mode Decision Based on Grayscale Similarity and Inter-View Correlation for Depth Map Coding in 3D-HEVC , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  A. Murat Tekalp,et al.  Transport Methods in 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Masayuki Tanimoto,et al.  3D-TV System with Depth-Image-Based Rendering , 2012 .

[4]  Wenjun Zhang,et al.  No-reference image quality assessment metric by combining free energy theory and structural degradation model , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Thomas Wiegand,et al.  3D video coding with depth modeling modes and view synthesis optimization , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[6]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[7]  Jianhua Zheng,et al.  Fast Depth Modeling Mode selection for 3D HEVC depth intra coding , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[8]  Mengmeng Zhang,et al.  A fast depth-map wedgelet partitioning scheme for intra prediction in 3D video coding , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[9]  Béatrice Pesquet-Popescu,et al.  Initialization, Limitation, and Predictive Coding of the Depth and Texture Quadtree in 3D-HEVC , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Jianjun Lei,et al.  Fast Mode Decision Using Inter-View and Inter-Component Correlations for Multiview Depth Video Coding , 2015, IEEE Transactions on Industrial Informatics.

[11]  Jianjun Lei,et al.  Early MERGE Mode Decision Based on Motion Estimation and Hierarchical Depth Correlation for HEVC , 2014, IEEE Transactions on Broadcasting.

[12]  Zhi Liu,et al.  Low Complexity Depth Coding Assisted by Coding Information From Color Video , 2014, IEEE Transactions on Broadcasting.

[13]  Yui-Lam Chan,et al.  Fast wedgelet pattern decision for DMM in 3D-HEVC , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[14]  Bogdan Ionescu,et al.  Multiview Plus Depth Video Coding With Temporal Prediction View Synthesis , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[16]  Heiko Schwarz,et al.  3D video coding using the synthesized view distortion change , 2012, 2012 Picture Coding Symposium.

[17]  Yongdong Zhang,et al.  Gradient based fast mode decision algorithm for intra prediction in HEVC , 2011, 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet).

[18]  Jianjun Lei,et al.  Fast Intra Prediction Based on Content Property Analysis for Low Complexity HEVC-Based Screen Content Coding , 2017, IEEE Transactions on Broadcasting.