Model-based complexity-aware coding for multiview video plus depth

This paper presents an efficient complexity-aware coding method for the popular 3-D video format, multiview video plus depth (MVD). Specifically, we propose a complexity-rate-distortion (C-R-D) model for the synthesized view. The proposed C-R-D model is then utilized to efficiently allocate the scarce computational resource for the texture and depth encoders to achieve the optimal quality of the synthesized view. Experimental results show the effectiveness of the proposed model and complexity allocation solution. Compared with the straightforward complexity allocation method with a fixed 1:1 ratio, the proposed method provided 0.2-0.9 dB gain in the peak-signal-to-noise ratio (PSNR) of the synthesized view quality.

[1]  Dong Tian,et al.  View synthesis techniques for 3D video , 2009, Optical Engineering + Applications.

[2]  Minh N. Do,et al.  Efficient video compression methods for a lightweight tele-immersive video chat system , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[3]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[4]  Xi Chen,et al.  Energy Minimization of Portable Video Communication Devices Based on Power-Rate-Distortion Optimization , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraint , 2004, IS&T/SPIE Electronic Imaging.

[6]  Hyuk-Jae Lee,et al.  A Real-Time H.264/AVC Encoder With Complexity-Aware Time Allocation , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Wen Gao,et al.  Complexity-Constrained H.264 Video Encoding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Yannick Morvan,et al.  Joint depth/texture bit-allocation for multi-view video compression , 2010 .

[9]  Minh N. Do,et al.  Efficient Techniques for Depth Video Compression Using Weighted Mode Filtering , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Antonio Ortega,et al.  Improving view rendering quality and coding efficiency by suppressing compression artifacts in depth-image coding , 2009, Electronic Imaging.

[12]  Qingming Huang,et al.  Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model , 2009, Signal Process. Image Commun..