Fast CU size and mode decision algorithm for 3D-HEVC intercoding

The 3D High Efficiency Video Coding (3D-HEVC) is an extension of the last 2D video coding generation (HEVC) using the Multi-view Video plus Depth map (MVD) format. In inter-coding process, the 3D-HEVC uses multiples inter prediction modes for each Coding Unit (CU) size. These prediction modes are performed to use all the possible CU sizes to select the one with the least Rate Distortion (RD) cost as the best prediction mode using Lagrange multiplier. It achieved high coding efficiency but it consumes an extremely time coding which limits 3D-HEVC from real-time applications. In this paper, a fast inter prediction mode and CU size decision algorithm is proposed to reduce the complexity of 3D-HEVC inter-coding. This algorithm is based on the homogeneity of CU using structure tensor. An experimental analysis is first performed to study the correlation of the CU complexity with depth levels and prediction modes, then the structure tensor of each CU is extracted to characterize the CU homogeneity, which has strong relationship with coding levels and inter prediction modes. Finally, a fast algorithm is adopted to accomplish an early termination of CU split and skip unnecessary prediction modes. The experimental results demonstrate that the proposed fast algorithm can provide a considerable encoding time-saving with negligible rate-distortion performance loss compared to the original 3D-HEVC encoder.

[1]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[2]  Luciano Volcan Agostini,et al.  Fast intra prediction algorithm based on texture analysis for 3D-HEVC encoders , 2015, Journal of Real-Time Image Processing.

[3]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[4]  Hamza Hamout,et al.  Fast 3D-HEVC PU size decision algorithm for depth map intra-video coding , 2020, Journal of Real-Time Image Processing.

[5]  Hamza Hamout,et al.  An efficient edge detection algorithm for fast intra-coding for 3D video extension of HEVC , 2017, Journal of Real-Time Image Processing.

[6]  Yan Zhang,et al.  Fast inter-prediction mode decision algorithm for HEVC , 2015, ICSON.

[7]  Jianjun Lei,et al.  Fast Mode Decision Based on Grayscale Similarity and Inter-View Correlation for Depth Map Coding in 3D-HEVC , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Farzad Zargari,et al.  Fast CU size and prediction mode decision method for HEVC encoder based on spatial features , 2016, Signal Image Video Process..

[9]  Jie Liao,et al.  Fast 3D-HEVC inter mode decision algorithm based on the texture correlation of viewpoints , 2018, Multimedia Tools and Applications.

[10]  Yue Li,et al.  Hybrid stopping model-based fast PU and CU decision for 3D-HEVC texture coding , 2019, Journal of Real-Time Image Processing.

[11]  Wen Gao,et al.  Fast encoder decision for texture coding in 3D-HEVC , 2014, Signal Process. Image Commun..

[12]  Yong Gan,et al.  Fast depth map mode decision based on depth-texture correlation and edge classification for 3D-HEVC , 2017, J. Vis. Commun. Image Represent..

[13]  Xinpeng Zhang,et al.  An Effective CU Size Decision Method for HEVC Encoders , 2013, IEEE Transactions on Multimedia.

[14]  Ying Chen,et al.  Overview of the Multiview and 3D Extensions of High Efficiency Video Coding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Yong Gan,et al.  Low complexity depth mode decision for HEVC-based 3D video coding , 2016 .

[16]  Xia Hou,et al.  Texture segmentation using image decomposition and local self-similarity of different features , 2014, Multimedia Tools and Applications.

[17]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[18]  Yu-Wen Huang,et al.  Advanced texture and depth coding in 3D-HEVC , 2018, J. Vis. Commun. Image Represent..

[19]  Yong Gan,et al.  Fast mode decision algorithm for 3D-HEVC encoding optimization based on depth information , 2015, Digit. Signal Process..

[20]  Yue Li,et al.  Probability Model-Based Early Merge Mode Decision for Dependent Views Coding in 3D-HEVC , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[21]  Chih-Wei Chen,et al.  Efficient inter-prediction depth coding algorithm based on depth map segmentation for 3D-HEVC , 2018, Multimedia Tools and Applications.

[22]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[23]  Debasis Chaudhuri,et al.  A new image segmentation technique using bi-entropy function minimization , 2017, Multimedia Tools and Applications.

[24]  Yong Gan,et al.  Adaptive early termination mode decision for 3D-HEVC using inter-view and spatio-temporal correlations , 2016 .

[25]  Zeyun Yu,et al.  Structure Tensor Based Image Interpolation Method , 2014, ArXiv.

[26]  Chun-Su Park,et al.  Edge-Based Intramode Selection for Depth-Map Coding in 3D-HEVC , 2015, IEEE Transactions on Image Processing.

[27]  Maria Petrou,et al.  The Use of Structure Tensors in the Analysis of Seismic Data , 2005 .

[28]  Tsung-Han Tsai,et al.  Fast mode decision method based on edge feature for HEVC inter-prediction , 2018, IET Image Process..

[29]  Lei Huang,et al.  User Behavior Analysis and Video Popularity Prediction on a Large-Scale VoD System , 2018, ACM Trans. Multim. Comput. Commun. Appl..