Early merge mode decision for texture coding in 3D-HEVC

An early merge mode decision method for texture coding in 3D-HEVC is proposed.Inter-view correlation of coding modes is studied for B frame.Hierarchical depth correlation of coding modes is studied for P frame.Two combinations of conditions to early determine merge mode are derived. As the upcoming 3D video coding standard, high efficiency video coding (HEVC) based 3D video coding (3D-HEVC) has been drafted. In 3D-HEVC, the computational complexity of mode decision process is significantly high due to exhaustive modes' checks for coding units (CU) derived from recursive quad-tree partitioning. In this paper, we propose an early merge mode decision method for complexity reduction of dependent texture views. First, inter-view correlation and hierarchical depth correlation of coding modes are separately analyzed for B frame and P frame. Then, conditions to early determine merge mode coded CUs are derived based on the correlations. All of the early determined CUs only check merge modes in the mode decision process, which brings considerable complexity reduction. Experimental results demonstrate that the proposed method can achieve average 20.4% of encoding time saving for dependent texture views with negligible rate distortion performance loss.

[1]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Kuei-Ting Kuo,et al.  Faster mode determination algorithm using mode correlation for multi-view video coding , 2014, IET Signal Process..

[3]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[4]  Zhi Liu,et al.  Low-Complexity Mode Decision for MVC , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Chia-Hung Yeh,et al.  Fast Mode Decision Algorithm Through Inter-View Rate-Distortion Prediction for Multiview Video Coding System , 2014, IEEE Transactions on Industrial Informatics.

[6]  Kai-Kuang Ma,et al.  Fast Mode Decision for Multiview Video Coding Using Mode Correlation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Wen Gao,et al.  Fast encoder decision for texture coding in 3D-HEVC , 2014, Signal Process. Image Commun..

[8]  Sergio Bampi,et al.  An adaptive early skip mode decision scheme for multiview video coding , 2010, 28th Picture Coding Symposium.

[9]  Thomas Wiegand,et al.  3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[10]  Liang-Gee Chen,et al.  Content-Aware Prediction Algorithm With Inter-View Mode Decision for Multiview Video Coding , 2008, IEEE Transactions on Multimedia.

[11]  Hans-Peter Seidel,et al.  Free-viewpoint video of human actors , 2003, ACM Trans. Graph..

[12]  Fan Zhou,et al.  Fast inter mode decision based on textural segmentation and correlations for multiview video coding , 2010, IEEE Transactions on Consumer Electronics.

[13]  Victor C. M. Leung,et al.  A content adaptive complexity reduction scheme for HEVC-based 3D video coding , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[14]  Kai-Kuang Ma,et al.  Mode-correlation-based early termination mode decision for multi-view video coding , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[16]  Oliver Schreer,et al.  3D analysis and image-based rendering for immersive TV applications , 2002, Signal Process. Image Commun..

[17]  Yong Gan,et al.  Early SKIP mode decision for three-dimensional high efficiency video coding using spatial and interview correlations , 2014, J. Electronic Imaging.

[18]  Panos Nasiopoulos,et al.  A low complexity mode decision approach for HEVC-based 3D video coding using a Bayesian method , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Zhou Wang,et al.  Multiview Coding Mode Decision With Hybrid Optimal Stopping Model , 2013, IEEE Transactions on Image Processing.