An Overview of 3D Video and Free Viewpoint Video

An overview of 3D video and free viewpoint video is given in this paper. Free viewpoint video allows the user to freely navigate within real world visual scenes, as known from virtual worlds in computer graphics. 3D video provides the user with a 3D depth impression of the observed scene, which is also known as stereo video. In that sense as functionalities, 3D video and free viewpoint video are not mutually exclusive but can very well be combined in a single system. Research in this area combines computer graphics, computer vision and visual communications. It spans the whole media processing chain from capture to display and the design of systems has to take all parts into account. The conclusion is that the necessary technology including standard media formats for 3D video and free viewpoint video is available or will be available in the future, and that there is a clear demand from industry and user side for such new types of visual media.

[1]  K. Mueller,et al.  Development of a new MPEG standard for advanced 3D video applications , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[2]  J. Konrad,et al.  3D displays and signal processing : an answer to 3-D ills? , 2007 .

[3]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[4]  Peter Eisert,et al.  Free viewpoint video extraction, representation, coding, and rendering , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[5]  Masayuki Tanimoto,et al.  Multiview Imaging and 3DTV , 2007, IEEE Signal Processing Magazine.

[6]  M. Halle,et al.  3-D Displays and Signal Processing , 2007, IEEE Signal Processing Magazine.

[7]  Richard Szeliski,et al.  The geometry-image representation tradeoff for rendering , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[8]  Thomas Wiegand,et al.  3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  Aljoscha Smolic,et al.  3D video objects for interactive applications , 2005, 2005 13th European Signal Processing Conference.

[10]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Masayuki Tanimoto,et al.  Multi-View Imaging and 3DTV (Special Issue Overview and Introduction) , 2007 .

[12]  Aljoscha Smolic,et al.  View Synthesis for Advanced 3D Video Systems , 2008, EURASIP J. Image Video Process..

[13]  Marc Pollefeys,et al.  An evolutionary and optimised approach on 3D-TV , 2002 .

[14]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.