A Fast and Efficient 3D-HEVC Method for Complexity Reduction Based on the Correlations of Inter-View, Spatio-Temporal, and Texture-Depth

3D High Efficiency Video Coding (3D-HEVC) is the latest High Efficiency Video Coding (HEVC) standard development to improve the compression performance of multi-view video plus depth (MVD) format. It adopts several additional coding tools for better representation of the dependent texture and depth data. These tools achieve high compression efficiency, but require high computational complexity. In this paper, we introduce a fast 3D-HEVC method for the complexity reduction of MVD. A simulation analysis is performed to study the coding information correlations of inter-view, spatio-temporal and texture-depth. The proposed fast algorithm decides to skip some treeblocks of texture and depth map at the early stage without a normal coding process, which includes fast depth level, early SKIP/Merge mode, adaptive early termination, based on the correlations of inter-view, spatio-temporal, and texture-depth. Experimental results show that the proposed fast scheme can save 70.2% encoding runtime of 3D-HEVC, with negligible loss of rate-distortion (RD) performance.

[1]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[2]  Gustavo Sanchez,et al.  Fast 3D-HEVC Depth Map Encoding Using Machine Learning , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Hongliang Li,et al.  A Fast HEVC Inter CU Selection Method Based on Pyramid Motion Divergence , 2014, IEEE Transactions on Multimedia.

[4]  Tao Yan,et al.  Fast Mode Decision Based on Gradient Information in 3D-HEVC , 2019, IEEE Access.

[5]  Yong Gan,et al.  A fast and efficient coding unit size decision algorithm based on temporal and spatial correlation , 2015 .

[6]  Yong Gan,et al.  Fast mode decision algorithm for 3D-HEVC encoding optimization based on depth information , 2015, Digit. Signal Process..

[7]  Panos Nasiopoulos,et al.  Online-Learning-Based Complexity Reduction Scheme for 3D-HEVC , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Guilherme Corrêa,et al.  Complexity control of high efficiency video encoders for power-constrained devices , 2011, IEEE Transactions on Consumer Electronics.

[9]  Yong Gan,et al.  Efficient multiview video plus depth coding for 3D-HEVC based on complexity classification of the treeblock , 2017, Journal of Real-Time Image Processing.

[10]  Zhi Liu,et al.  Adaptive Inter-Mode Decision for HEVC Jointly Utilizing Inter-Level and Spatiotemporal Correlations , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Zhi Liu,et al.  Effective CU Size Decision for HEVC Intracoding , 2014, IEEE Transactions on Image Processing.

[12]  Fan Zhou,et al.  Spatio-temporal correlation-based fast coding unit depth decision for high efficiency video coding , 2013, J. Electronic Imaging.

[13]  Xinpeng Zhang,et al.  Fast TU size decision algorithm for HEVC encoders using Bayesian theorem detection , 2015, Signal Process. Image Commun..

[14]  Jianjun Lei,et al.  Fast Mode Decision Based on Grayscale Similarity and Inter-View Correlation for Depth Map Coding in 3D-HEVC , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Luciano Volcan Agostini,et al.  Fast HEVC intra prediction mode decision based on EDGE direction information , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[16]  Chun-Su Park,et al.  Edge-Based Intramode Selection for Depth-Map Coding in 3D-HEVC , 2015, IEEE Transactions on Image Processing.

[17]  Ping An,et al.  Fast CU size decision and mode decision algorithm for HEVC intra coding , 2013, IEEE Transactions on Consumer Electronics.

[18]  Mei Yu,et al.  Statistical Early Termination Model for Fast Mode Decision and Reference Frame Selection in Multiview Video Coding , 2012, IEEE Transactions on Broadcasting.

[19]  Ying Chen,et al.  Next-Generation 3D Formats with Depth Map Support , 2014, IEEE MultiMedia.

[20]  Qianqian Hu,et al.  A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[21]  Munchurl Kim,et al.  Fast CU Splitting and Pruning for Suboptimal CU Partitioning in HEVC Intra Coding , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Hamza Hamout,et al.  Fast Depth Map Intra Coding for 3D Video Compression-Based Tensor Feature Extraction and Data Analysis , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Peng Chen,et al.  Fast macroblock encoding algorithm based on rate-distortion activity for multiview video coding , 2014, Signal Process. Image Commun..

[24]  Yan Zhang,et al.  Low complexity multiview video plus depth coding , 2011, IEEE Transactions on Consumer Electronics.

[25]  Chia-Hung Yeh,et al.  Fast Mode Decision Algorithm Through Inter-View Rate-Distortion Prediction for Multiview Video Coding System , 2014, IEEE Transactions on Industrial Informatics.

[26]  Zhou Wang,et al.  Multiview Coding Mode Decision With Hybrid Optimal Stopping Model , 2013, IEEE Transactions on Image Processing.

[27]  Hyuk-Jae Lee,et al.  A Novel Algorithm for Zero Block Detection in High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[28]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[29]  Zhi Liu,et al.  Context-adaptive based CU processing for 3D-HEVC , 2017, PloS one.

[30]  Ying Chen,et al.  Overview of the Multiview and 3D Extensions of High Efficiency Video Coding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Jianjun Lei,et al.  Fast Mode Decision Using Inter-View and Inter-Component Correlations for Multiview Depth Video Coding , 2015, IEEE Transactions on Industrial Informatics.

[32]  Tao Yan,et al.  View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Wen Gao,et al.  Fast encoder decision for texture coding in 3D-HEVC , 2014, Signal Process. Image Commun..

[34]  Yong Gan,et al.  Fast depth map mode decision based on depth-texture correlation and edge classification for 3D-HEVC , 2017, J. Vis. Commun. Image Represent..

[35]  Xu Jian,et al.  Fast Mode Decision Algorithm for Intra Prediction in HEVC , 2014, 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC).

[36]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[37]  Yong Gan,et al.  Adaptive early termination mode decision for 3D-HEVC using inter-view and spatio-temporal correlations , 2016 .

[38]  Yui-Lam Chan,et al.  Quadtree decision for depth intra coding in 3D-HEVC by good feature , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Xinpeng Zhang,et al.  An Effective CU Size Decision Method for HEVC Encoders , 2013, IEEE Transactions on Multimedia.

[40]  Zhou Wang,et al.  Flexible Mode Selection and Complexity Allocation in High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.