Depth modeling modes complexity control system for the 3D-HEVC video encoder

This paper presents a complexity control system for depth maps intra-frame prediction of the 3D-High Efficiency Video Coding (3D-HEVC) standard. The proposed system uses a Proportional-Integral-Derivative controller over the Simplified Edge Detector heuristic to skip the Depth Modeling Modes (DMMs) evaluation dynamically according to a defined target rate. When analyzing the proposed system under Common Test Conditions, the proposed controller stabilizes the system to the target rate (i.e., the percentage of DMMs evaluation) after encoding a few frames, with negligible encoding efficiency impacts. The BD-rate degradation varies from 0.50% to 0.20%, on average, when the target rates vary from 5% to 15%. These target rates imply in an aggressive reduction in the DMMs evaluations, skipping the DMMs from 85% to 95% of the cases.

[1]  Wei Zhou,et al.  Complexity control for HEVC by visual saliency detection , 2016, 2016 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC).

[2]  Detlev Marpe,et al.  Depth Intra Coding for 3D Video Based on Geometric Primitives , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Shengxi Li,et al.  Complexity control of HEVC based on region-of-interest attention model , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[4]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[5]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..

[6]  Yui-Lam Chan,et al.  Fast wedgelet pattern decision for DMM in 3D-HEVC , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[7]  César A. M. Marcon,et al.  3D-HEVC depth maps intra prediction complexity analysis , 2016, 2016 IEEE International Conference on Electronics, Circuits and Systems (ICECS).

[8]  Thomas Wiegand,et al.  3D video coding with depth modeling modes and view synthesis optimization , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[9]  Bruno Zatt,et al.  Complexity reduction for 3D-HEVC depth maps intra-frame prediction using simplified edge detector algorithm , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[10]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[11]  Yui-Lam Chan,et al.  Adaptive fast intra mode decision of depth map coding by Low Complexity RD-Cost in 3D-HEVC , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[12]  Ying Chen,et al.  Generic segment-wise DC for 3D-HEVC depth intra coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[13]  Jianhua Zheng,et al.  Fast Depth Modeling Mode selection for 3D HEVC depth intra coding , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[14]  Bruno Zatt,et al.  Solutions for DMM-1 complexity reduction in 3D-HEVC based on gradient calculation , 2016, 2016 IEEE 7th Latin American Symposium on Circuits & Systems (LASCAS).

[15]  Guilherme Corrêa,et al.  Complexity control of HEVC through quadtree depth estimation , 2013, Eurocon 2013.