Video synthesis made simple with the X-slits projection

We propose novel algorithms for image based rendering (IBR) by simulating a new family of scene-to-image projections, the crossed-slits (X-slits) projections. New X-slits images can be easily generated from a sequence of images captured by a translating pinhole camera, and those images look compelling and realistic. We show how this can be used for rendering movies of virtual walkthroughs by a very fast and simple mosaicing algorithm, providing a strong 3D sensation of parallax and occlusions, as well as specularity and transparency.

[1]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[2]  Sing Bing Kang,et al.  Survey of image-based rendering techniques , 1998, Electronic Imaging.

[3]  Hiroshi Ishiguro,et al.  Omni-Directional Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Steven M. Seitz,et al.  The Space of All Stereo Images , 2004, International Journal of Computer Vision.

[5]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[6]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[7]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[10]  Daniel G. Aliaga,et al.  Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs , 2001, SIGGRAPH.

[11]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[12]  Katsushi Ikeuchi,et al.  Arbitrary view position and direction rendering for large-scale scenes , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[14]  Daphna Weinshall,et al.  New View Generation with a Bi-centric Camera , 2002, ECCV.

[15]  R. MELDOLA,et al.  The Optics of Photography , 1894, Nature.

[16]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Tomás Pajdla.  Stereo with Oblique Cameras , 2004, International Journal of Computer Vision.