Image-based rendering with occlusions via cubist images

We attack the problem of image based rendering with occlusions and general camera motions by using distorted multiperspective images; such images provide multiple viewpoint photometry similar to the paintings of cubist artists. We take scene geometry, in contrast, to be embodied in mappings of viewing rays from their original 3D intercepts into the warped multiperspective image space. This approach allows us to render approximations of scenes with occlusions using time dense and spatially sparse sequences of camera rays, which is a significant improvement over the storage requirements of an equivalent animation sequence. Additional data compression can be achieved using sparse time keyframes as well. Interpolating the paths of sparse time key rays correctly in image space requires singular interpolation functions with spatial discontinuities. While there are many technical questions yet to be resolved, the employment of these singular interpolation functions in the multiperspective image space appears to be of potential interest for generating general viewpoint scene renderings with minimal data storage.

[1]  Xueyin Lin,et al.  Constructing 3D natural scene from video sequences with vibrated motions , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[2]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[3]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[4]  Paul Rademacher,et al.  Multiple-center-of-projection images , 1998, SIGGRAPH.

[5]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[6]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[7]  Peter-Pike J. Sloan,et al.  Time critical lumigraph rendering , 1997, SI3D.

[8]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[9]  Eric A. Wernert,et al.  Constrained 3D navigation with 2D controllers , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[10]  Lance Williams,et al.  View interpolation for image synthesis , 1998 .

[11]  Michitaka Hirose,et al.  Generation of wide-range virtual spaces using photographic images , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[12]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[13]  Amitabh Varshney,et al.  Navigating static environments using image-space simplification and morphing , 1997, SI3D.

[14]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[15]  Michael Halle,et al.  Multiple viewpoint rendering , 1998, SIGGRAPH.

[16]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.