A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR )

This paper will present details of a system that allows for an evolutionary introduction of depth perception into the existing 2D digital TV framework. The work is part of the European Information Society Technologies (IST) project “Advanced Three-Dimensional Television System Technologies” (ATTEST), an activity, where industries, research centers and universities have joined forces to design a backwards-compatible, flexible and modular broadcast 3D-TV system [1]. In contrast to former proposals, which often relied on the basic concept of “stereoscopic” video, this new idea is based on a more flexible joint transmission of monoscopic video and associated per-pixel depth information. From this data representation, one or more “virtual” views of the 3D scene can then be synthesized in real-time at the receiver side by means of so-called depthimage-based rendering (DIBR) techniques. This paper (a) highlights the advantages of this new approach on 3DTV and (b) develops an efficient algorithm for the generation of “virtual” 3D views that can be reproduced on any stereoscopicor autostereoscopic 3D-TV display.

[1]  Lenny Lipton,et al.  Foundations of the stereoscopic cinema : a study in depth , 1984 .

[2]  Paul Milgram,et al.  Adaptation effects in stereo due to on-line changes in camera configuration , 1992, Electronic Imaging.

[3]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[4]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[5]  S. Pastoor,et al.  Stereoscopic image representation with synthetic depth of field , 1997 .

[6]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[7]  William R. Mark,et al.  Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping , 1999 .

[8]  Marc Pollefeys.  3D Modelling from Images , 2000, ECCV 2000.

[9]  D. Runde,et al.  How to realize a natural image reproduction using stereoscopic displays with motion parallax , 2000, IEEE Trans. Circuits Syst. Video Technol..

[10]  Thomas E. Dawson,et al.  The Effects of Age upon the Perception of Depth and 3-D Shape from Differential Motion and Binocular Disparity , 2000, Perception.

[11]  Wijnand A. IJsselsteijn,et al.  Effects of stereoscopic filming parameters and display duration on the subjective assessment of eye strain , 2000, Electronic Imaging.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[14]  Eyal Ofek,et al.  Depth keying , 2003, IS&T/SPIE Electronic Imaging.