Compact quad-based representation for 3D video

The context of this study is 3D video. Starting from a sequence of multi-view video plus depth (MVD) data, the proposed quad-based representation takes into account, in a unified manner, different issues such as compactness, compression, and intermediate view synthesis. The representation is obtained into two steps. Firstly, a set of 3D quads is extracted by using a quadtree decomposition of the depth maps. Secondly, a selective elimination of the quads is performed in order to reduce inter-view redundancies and thus provide a compact representation. Experiments on two real sequences show good quality results at the rendering stage and a small data overload compared to mono-view video.

[1]  Reinhard Koch,et al.  Modelling and rendering of complex scenes with a multi-camera rig , 2004 .

[2]  Aljoscha Smolic,et al.  Reliability-based generation and view synthesis in layered depth video , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[3]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[4]  Aljoscha Smolic,et al.  Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems , 2008, 2008 15th IEEE International Conference on Image Processing.

[5]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[6]  T. Wiegand,et al.  The Effect of Depth Compression on Multiview Rendering Quality , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[7]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[8]  Chris Varekamp,et al.  Enabling Introduction of Stereoscopic (3D) Video: Formats and Compression Standards , 2007, 2007 IEEE International Conference on Image Processing.

[9]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[10]  Pau Gargallo,et al.  Bayesian 3D modeling from images using multiple depth maps , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Marc Pollefeys,et al.  An evolutionary and optimised approach on 3D-TV , 2002 .