Adaptive early termination mode decision for 3D-HEVC using inter-view and spatio-temporal correlations

Abstract 3D extension of high efficiency video coding (3D-HEVC) supports the coding of multi-view video and depth map. It adds new coding tools to the high efficiency video coding (HEVC) design, which improve the HEVC compression capabilities for 3D video. These coding tools achieve high coding efficiency, but it brings relatively high computational complexity which limits 3D-HEVC from practical applications. In this paper, we propose an adaptive early termination mode decision algorithm to reduce 3D-HEVC computational complexity. An experimental analysis is performed to study inter-view and spatio-temporal correlations in the coding information. Based on the analysis results, we can determine to skip some specific prediction mode at the early termination stage without a normal 3D-HEVC encoding process. The proposed algorithm uses the correlation between inter-view and spatio-temporal blocks. Experimental results demonstrate that the proposed algorithm can significantly reduce computational complexity of 3D-HEVC encoding while maintaining almost the same rate-distortion (RD) performance.

[1]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[2]  Ping An,et al.  Fast CU size decision and mode decision algorithm for HEVC intra coding , 2013, IEEE Transactions on Consumer Electronics.

[3]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[4]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[5]  Zhipin Deng,et al.  Fast Motion and Disparity Estimation With Adaptive Search Range Adjustment in Stereoscopic Video Coding , 2012, IEEE Transactions on Broadcasting.

[6]  Munchurl Kim,et al.  Fast CU Splitting and Pruning for Suboptimal CU Partitioning in HEVC Intra Coding , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[8]  Sam Kwong,et al.  An Efficient Mode Decision Algorithm for H.264/AVC Encoding Optimization , 2007, IEEE Transactions on Multimedia.

[9]  Si-Woong Lee,et al.  Adaptive search range motion estimation using neighboring motion vector differences , 2011, IEEE Transactions on Consumer Electronics.

[10]  Chong-Min Kyung,et al.  A Dynamic Search Range Algorithm for Stabilized Reduction of Memory Traffic in Video Encoder , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[12]  Wen Gao,et al.  Fast encoder decision for texture coding in 3D-HEVC , 2014, Signal Process. Image Commun..

[13]  Kiho Choi,et al.  Adaptive search range adjustment scheme for fast motion estimation in AVC/H.264 , 2011 .

[14]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[15]  Wen Gao,et al.  Low Complexity Adaptive View Synthesis Optimization in HEVC Based 3D Video Coding , 2014, IEEE Transactions on Multimedia.

[16]  Kai-Kuang Ma,et al.  Fast Mode Decision for Multiview Video Coding Using Mode Correlation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Graham R. Martin,et al.  Fast Inter-Mode Selection in the H.264/AVC Standard Using a Hierarchical Decision Process , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Ying Chen,et al.  Advanced residual prediction enhancement for 3D-HEVC , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[19]  Victor C. M. Leung,et al.  A content adaptive complexity reduction scheme for HEVC-based 3D video coding , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[20]  Oguzhan Urhan Constrained one-bit transform based fast block motion estimation using adaptive search range , 2010, IEEE Transactions on Consumer Electronics.

[21]  Zhou Wang,et al.  Flexible Mode Selection and Complexity Allocation in High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[22]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[23]  Hyuk-Jae Lee,et al.  A Novel Algorithm for Zero Block Detection in High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[24]  Xinpeng Zhang,et al.  An Effective CU Size Decision Method for HEVC Encoders , 2013, IEEE Transactions on Multimedia.

[25]  Qiuwen Zhang,et al.  Fast Mode Decision for 3D-HEVC Depth Intracoding , 2014, TheScientificWorldJournal.

[26]  Béatrice Pesquet-Popescu,et al.  Modification of the merge candidate list for dependent views in 3D-HEVC , 2013, 2013 IEEE International Conference on Image Processing.

[27]  C.-C. Jay Kuo,et al.  Adaptive Motion Search Range Prediction for Video Encoding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Ying Chen,et al.  Inter-view motion prediction in 3D-HEVC , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[29]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..

[30]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[31]  Hongliang Li,et al.  A Fast HEVC Inter CU Selection Method Based on Pyramid Motion Divergence , 2014, IEEE Transactions on Multimedia.

[32]  Tao Yan,et al.  View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Detlev Marpe,et al.  Depth Intra Coding for 3D Video Based on Geometric Primitives , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[35]  Yan Zhang,et al.  Low complexity multiview video plus depth coding , 2011, IEEE Transactions on Consumer Electronics.

[36]  G. Xiao,et al.  Erratum to “Characterization of Human Colorectal Cancer MDR1/P-gp Fab Antibody” , 2014, The Scientific World Journal.

[37]  Yinyi Lin,et al.  Zero-Block Mode Decision Algorithm for H.264/AVC , 2009, IEEE Transactions on Image Processing.

[38]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.