Fast intra mode decision for depth coding in 3D-HEVC

The emergent 3D High Efficiency Video Coding (3D-HEVC) is an extension of the High Efficiency Video Coding (HEVC) standard for the compression of the multi-view texture videos plus depth maps format. Since depth maps have different statistical properties compared to texture video, various new intra tools have been added to 3D-HEVC depth coding. In current 3D-HEVC, new intra tools are utilized together with the conventional HEVC intra prediction modes for depth coding. This technique achieves the highest possible coding efficiency, but leads to an extremely high computational complexity which limits 3D-HEVC from practical applications. In this paper, we propose a fast intra mode decision algorithm for depth coding in 3D-HEVC. The basic idea of the proposed algorithm is to utilize the depth map characteristics to predict the current depth prediction mode and skip some specific depth intra modes rarely used in 3D-HEVC depth coding. Based on this analysis, two fast intra mode decision strategies are proposed including reduction of the number of conventional intra prediction modes, and simplification of depth modeling modes (DMMs). Experimental results demonstrate that the proposed algorithm can save 30 % coding runtime on average while maintaining almost the same rate-distortion (RD) performance as the original 3D-HEVC encoder.

[1]  Zhi Liu,et al.  Inter mode selection for depth map coding in 3D video , 2012, IEEE Transactions on Consumer Electronics.

[2]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[3]  Satoshi Goto,et al.  Difference detection based early mode termination for depth map coding in MVC , 2010, 28th Picture Coding Symposium.

[4]  Jianhua Zheng,et al.  Fast bi-partition mode selection for 3D HEVC depth intra coding , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Liquan Shen,et al.  Efficient depth coding in 3D video to minimize coding bitrate and complexity , 2013, Multimedia Tools and Applications.

[6]  Jin Young Lee,et al.  A Fast and Efficient Multi-View Depth Image Coding Method Based on Temporal and Inter-View Correlations of Texture Images , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Qiuwen Zhang,et al.  Effective early termination algorithm for depth map intra coding in 3D-HEVC , 2014 .

[8]  Zhi Liu,et al.  Low Complexity Depth Coding Assisted by Coding Information From Color Video , 2014, IEEE Transactions on Broadcasting.

[9]  Wenjun Zhang,et al.  No-reference image quality assessment metric by combining free energy theory and structural degradation model , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[10]  Yan Zhang,et al.  Low complexity multiview video plus depth coding , 2011, IEEE Transactions on Consumer Electronics.

[11]  Jianjun Lei,et al.  Fast Mode Decision Using Inter-View and Inter-Component Correlations for Multiview Depth Video Coding , 2015, IEEE Transactions on Industrial Informatics.

[12]  Ying Chen,et al.  Overview of the MVC + D 3D video coding standard , 2014, J. Vis. Commun. Image Represent..

[13]  Chun-Su Park,et al.  Edge-Based Intramode Selection for Depth-Map Coding in 3D-HEVC , 2015, IEEE Transactions on Image Processing.

[14]  Yong Gan,et al.  Early SKIP mode decision for three-dimensional high efficiency video coding using spatial and interview correlations , 2014, J. Electronic Imaging.

[15]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[16]  Kemal Ugur,et al.  Intra Coding of the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[18]  Qianqian Hu,et al.  A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[19]  Huanqiang Zeng,et al.  Efficient two-stage early SKIP mode termination for depth video coding , 2014, Comput. Electr. Eng..

[20]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Ying Chen,et al.  Next-Generation 3D Formats with Depth Map Support , 2014, IEEE MultiMedia.

[22]  Jianhua Zheng,et al.  Fast Depth Modeling Mode selection for 3D HEVC depth intra coding , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[23]  Mengmeng Zhang,et al.  A fast depth-map wedgelet partitioning scheme for intra prediction in 3D video coding , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[24]  Shuai Li,et al.  Depth Coding Based on Depth-Texture Motion and Structure Similarities , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[26]  Jianjun Lei,et al.  Early MERGE Mode Decision Based on Motion Estimation and Hierarchical Depth Correlation for HEVC , 2014, IEEE Transactions on Broadcasting.

[27]  Bruno Zatt,et al.  A complexity reduction algorithm for depth maps intra prediction on the 3D-HEVC , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[28]  Yo-Sung Ho,et al.  Fast Mode Decision Algorithm for Depth Coding in 3D Video Systems Using H.264/AVC , 2011, PSIVT.

[29]  Narciso García,et al.  Low Complexity Mode Decision and Motion Estimation for H.264/AVC Based Depth Maps Encoding in Free Viewpoint Video , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Yo-Sung Ho,et al.  Simplified inter-component depth modeling in 3D-HEVC , 2013, IVMSP 2013.

[31]  Bruno Zatt,et al.  Complexity reduction for 3D-HEVC depth maps intra-frame prediction using simplified edge detector algorithm , 2014, 2014 IEEE International Conference on Image Processing (ICIP).