Virtual View Generation for 3D Digital Video

Virtual reality systems use digital models to provide interactive viewing. We present a 3D digital video system that attempts to provide the same capabilities for actual performances such as dancing. Recreating the original dynamic scene in 3D, the system allows photorealistic interactive playback from arbitrary viewpoints using video streams of a given scene from multiple perspectives.

[1]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[2]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[3]  Jin Liu,et al.  A three camera approach for calculating disparity and synthesizing intermediate pictures , 1991, Signal Process. Image Commun..

[4]  Jerome M. Shapiro.  Image coding using the embedded zerotree wavelet algorithm , 1993, Optics & Photonics.

[5]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[6]  Takeo Kanade,et al.  Virtual Space Teleconferencing Using a Sea of Cameras , 1994 .

[7]  Steven M. Seitz,et al.  Physically-valid view synthesis by image interpolation , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[8]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[9]  Ramesh C. Jain,et al.  An architecture for multiple perspective interactive video , 1995, MULTIMEDIA '95.

[10]  Takeo Kanade,et al.  Virtualized reality: concepts and early results , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[11]  Avideh Zakhor,et al.  Arbitrary view generation for three-dimensional scenes from uncalibrated video cameras , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[12]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[13]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[14]  Belle L. Tseng,et al.  Multiviewpoint video coding with MPEG-2 compatibility , 1996, IEEE Trans. Circuits Syst. Video Technol..

[15]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[16]  Ramesh C. Jain,et al.  Reality modeling and visualization from multiple video sequences , 1996, IEEE Computer Graphics and Applications.