Joint video/depth bit allocation for 3D video coding based on distortion of synthesized view

The joint coding of texture videos and depth maps plays a practical importance in three dimensional (3D) video system. Besides coding efficiency, the strategy of bit allocation between texture videos and depth maps is key issue. The paper firstly analyses the impacts on the quality of virtual views from the joint coding of texture videos and depth maps. Then the paper explores the relationship and establishes a quadratic model between texture video quantization step Qt and depth map quantization step Qd. Consequently, the paper proposes a joint bit allocation scheme based on the model to get the optimal quality of the synthesized views. Experimental results show that the proposed scheme has a better rate-distortion (RD) performance for the synthesized views, compared with fixed bits ratio between texture videos and depth maps, i. e. 5:1.

[1]  Qingming Huang,et al.  Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model , 2009, Signal Process. Image Commun..

[2]  Markus H. Gross,et al.  3D video fragments: dynamic point samples for real-time free-viewpoint video , 2004, Comput. Graph..

[3]  Zhaoyang Lu,et al.  Model-Based Joint Bit Allocation Between Texture Videos and Depth Maps for 3-D Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Wen Gao,et al.  Rate-distortion analysis for H.264/AVC video coding and its application to rate control , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Y. Wang,et al.  Video plus depth compression for mobile 3D services , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[6]  Aljoscha Smolic,et al.  Scene Representation Technologies for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  A. Gotchev,et al.  Quality assessment of 3D video in rate allocation experiments , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[8]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..

[9]  Thomas Schierl,et al.  Transport and Storage Systems for 3-D Video Using MPEG-2 Systems, RTP, and ISO File Format , 2011, Proceedings of the IEEE.

[10]  Namho Hur,et al.  Depth-image-based rendering for 3DTV service over T-DMB , 2009, Signal Process. Image Commun..

[11]  Yannick Morvan,et al.  Joint depth/texture bit-allocation for multi-view video compression , 2010 .

[12]  Hans-Peter Seidel,et al.  Model-Based Free-Viewpoint Video Acquisition, Rendering and Encoding , 2004 .

[13]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.