Compression-Induced Rendering Distortion Analysis for Texture/Depth Rate Allocation in 3D Video Compression

In 3D video applications, the virtual view is generally rendered by the compressed texture and depth. The texture and depth compression with different bit-rate overheads can lead to different virtual view rendering qualities. In this paper, we analyze the compression-induced rendering distortion for the virtual view. Based on the 3D warping principle, we first address how the texture and depth compression affects the virtual view quality, and then derive an upper bound for the compression-induced rendering distortion. The derived distortion bound depends on the compression-induced depth error and texture intensity error. Simulation results demonstrate that the theoretical upper bound is an approximate indication of the rendering quality and can be used to guide sequence-level texture/depth rate allocation for 3D video compression.

[1]  Wenxian Yang,et al.  4-D Wavelet-Based Multiview Video Coding , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Michael W. Marcellin,et al.  Lifting-Based View Compensated Compression of Volume Rendered Images for Efficient Remote Visualization , 2008, Data Compression Conference (dcc 2008).

[4]  Peter H. N. de With,et al.  Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images , 2007, 2007 IEEE International Conference on Image Processing.

[5]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[7]  Ha T. Nguyen,et al.  Error Analysis for Image-Based Rendering with Depth Information , 2009, 2006 International Conference on Image Processing.

[8]  Aljoscha Smolic,et al.  Toward a 3D video format for auto-stereoscopic displays , 2008, Optical Engineering + Applications.

[9]  T. Wiegand,et al.  The Effect of Depth Compression on Multiview Rendering Quality , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .