AN ASSESSMENT OF 3DTV TECHNOLOGIES

Stereoscopic 3D viewing techniques are almost as old as their 2D counterparts: experimental stereoscopic 3DTV immediately followed the invention of TV. Holography is a newer technology compared to stereoscopy, and there are indicators that satisfactory holographic 3DTV may be feasible. Another candidate technology for 3DTV is integral imaging. Holography and integral imaging provide true full parallax 3D displays in the ideal case. All these technologies have their own distinct features, advantages and problems. Interest in all forms of 3DTV has been significantly increasing both in research and commercial communities. An integrated 3DTV system naturally has different components: capturing of 3D moving scenes, their representation, compression and transport, and finally display are the main building blocks. Naturally, the consumer attitude and the related social issues will be rather centred around the display and interaction. 3D scenes can be captured by various means, for example, by using many cameras simultaneously. Furthermore, it is desirable to serve all types of 3D displays with different capabilities. Therefore, It is envisaged that scene capture and display operation will be decoupled in future 3DTV systems: captured scene information will be converted to abstract representations (and maybe stored) using computer graphics techniques, and the display (and observer) will interact with this intermediate data. It is natural to extend conventional video compression techniques to 3D video signals by exploiting the inherent redundancies. Coding of 3D video signals is attracting research interest and related standardization activities are ongoing in bodies like ISO-MPEG. Digital transmission, using adapted streaming techniques is another research area. Autostereoscopic, holographic and volumetric displays have been demonstrated and used. Signal processing techniques are employed to find the technology-dependent display driver signals to get the 3D images from abstract 3D scenes.

[1]  Peter Schröder,et al.  Interpolating Subdivision for meshes with arbitrary topology , 1996, SIGGRAPH.

[2]  Levent Onural,et al.  Signal processing issues in diffraction and holographic 3DTV , 2005, 2005 13th European Signal Processing Conference.

[3]  Richard Szeliski,et al.  The geometry-image representation tradeoff for rendering , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[4]  Öznur Özkasap,et al.  Progressive view-dependent transmission of 3D models over lossy networks , 2005, 2005 13th European Signal Processing Conference.

[5]  S. Pastoor Human factors of 3DTV: an overview of current research at Heinrich-Hertz-Institut Berlin , 1992 .

[6]  T. Motoki,et al.  Present status of three-dimensional television research , 1995, Proc. IEEE.

[7]  Chung-Hyun Ahn,et al.  An HDTV-Compatible 3DTV Broadcasting System , 2004 .

[8]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[9]  Andrew Zisserman,et al.  Robust parameterization and computation of the trifocal tensor , 1997, Image Vis. Comput..

[10]  Markus H. Gross,et al.  Unconstrained free-viewpoint video coding , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[11]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[12]  Elisabeth Rieper,et al.  FELIX 3D display: an interactive tool for volumetric imaging , 2002, IS&T/SPIE Electronic Imaging.

[13]  Tsuhan Chen,et al.  A survey on image-based rendering - representation, sampling and compression , 2004, Signal Process. Image Commun..

[14]  Markus H. Gross,et al.  3D video fragments: dynamic point samples for real-time free-viewpoint video , 2004, Comput. Graph..

[15]  Thomas Sikora,et al.  A gradient based approach for stereoscopic error concealment , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[16]  Peter Eisert,et al.  Predictive compression of dynamic 3D meshes , 2005, IEEE International Conference on Image Processing 2005.

[17]  Marc Pollefeys,et al.  An evolutionary and optimised approach on 3D-TV , 2002 .

[18]  Aljoscha Smolic,et al.  An Overview of a New European Consortium: Integrated Three-Dimensional Television - Capture, Transmission and Display (3DTV) , 2004, EWIMT.

[19]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[20]  C. N. Moller,et al.  Flat panel time multiplexed autostereoscopic display using an optical wedge waveguide , 2004 .

[21]  Jung-Young Son,et al.  Optical design and analysis for super multiview three-dimensional imaging system , 2001, IS&T/SPIE Electronic Imaging.

[22]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Yücel Altunbasak,et al.  Error-resilient transmission of 3D models , 2005, TOGS.

[24]  A. Murat Tekalp,et al.  A receiver-driven multicasting framework for 3DTV transmission , 2005, 2005 13th European Signal Processing Conference.

[25]  Aljoscha Smolic,et al.  3DAV exploration of video-based rendering technology in MPEG , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  L. Onural,et al.  Sampling of the diffraction field. , 2000, Applied optics.

[27]  Chung-Hyun Ahn,et al.  Experimental service of 3DTV broadcasting relay in Korea , 2002, SPIE ITCom.

[28]  Markus H. Gross,et al.  3D Video Recorder: a System for Recording and Playing Free‐Viewpoint Video † , 2003, Comput. Graph. Forum.

[29]  Marius Preda ISO/IEC 14496-16/PDAM1 , 2004 .

[30]  I. Sexton Parallax barrier display systems , 1992 .

[31]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[32]  Wojciech Matusik,et al.  Opacity light fields: interactive rendering of surface light fields with view-dependent opacity , 2003, I3D '03.

[33]  Christoph Fehn,et al.  3D TV Broadcasting , 2006 .

[34]  Pascal Fua,et al.  Quantitative and Qualitative Comparison of Some Area and Feature-based Stereo Algorithms , 1992 .

[35]  Marcus A. Magnor,et al.  Data compression for light-field rendering , 2000, IEEE Trans. Circuits Syst. Video Technol..

[36]  A. Rip Science for the 21st Century , 2002 .

[37]  Andrew J. Woods,et al.  PC-based stereoscopic video walkthrough , 1999, Electronic Imaging.

[38]  Andrew W. Fitzgibbon,et al.  VHS to VRML: 3D graphical models from video sequences , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[39]  T. Kreis,et al.  Hologram reconstruction using a digital micromirror device , 2001 .

[40]  Z. Zalevsky,et al.  The Fractional Fourier Transform: with Applications in Optics and Signal Processing , 2001 .

[41]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[42]  L. Falkenhagen Depth Estimation from Stereoscopic Image Pairs Assuming Piecewise Continuos Surfaces , 1995 .

[43]  Wijnand A. IJsselsteijn,et al.  A survey of perceptual evaluations and requirements of three-dimensional TV , 2004, IEEE Transactions on Circuits and Systems for Video Technology.