Overview of free viewpoint television

We have been developing ray-based 3D information systems that consist of ray acquisition, ray processing, and ray display. Free viewpoint television (FTV) based on the ray-space method is a typical example. FTV will bring an epoch-making change in the history of television because it enables us to view a distant 3D world freely by changing our viewpoints as if we were there. We constructed a real-time FTV including the complete chain from capturing to display. A new algorithm was developed to generate free viewpoint images. In addition, a new user interface is presented for FTV to make full use of 3D information. FTV is not a pixel-based system but a ray-based system. We are creating ray-based image engineering through the development of FTV.

[1]  Toshiaki Fujii,et al.  Experimental system of free viewpoint television , 2003, IS&T/SPIE Electronic Imaging.

[2]  F. Okano,et al.  Three-dimensional video system based on integral photography , 1999 .

[3]  Masayuki Tanimoto.  Free Viewpoint Television (FTV) , 2007 .

[4]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[5]  Toshiaki Fujii,et al.  A real-time ray-space acquisition system , 2004, IS&T/SPIE Electronic Imaging.

[6]  Masayuki Tanimoto,et al.  FTV (free viewpoint television) creating ray-based image engineering , 2005, IEEE International Conference on Image Processing 2005.

[7]  Masayuki Tanimoto.  Free Viewpoint Systems , 2006 .

[8]  Toshiaki Fujii,et al.  Ray space coding for 3D visual communication , 1996 .

[9]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[10]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[11]  Tsuhan Chen,et al.  A Self-Reconfigurable Camera Array , 2004, Rendering Techniques.

[12]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[13]  Iso Iec Jtc Sc Wg.  Introduction to Multi-view Video Coding , 2005 .

[14]  Makoto Sato,et al.  Cylindrical 3-D video display observable from all directions , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[15]  GrzeszczukRadek,et al.  Light field mapping , 2002 .

[16]  Gregg E. Favalora.  Volumetric 3D displays and application infrastructure , 2005, Computer.

[17]  Masayuki Sugawara,et al.  Ultrahigh-definition video system with 4000 scanning lines , 2002 .