Layered depth images

In this paper we present a set of efficient image based rendering methods capable of rendering multiple frames per second on a PC. The first method warps Sprites with Depth representing smooth surfaces without the gaps found in other techniques. A second method for more general scenes performs warping from an intermediate representation called a Layered Depth Image (LDI). An LDI is a view of the scene from a single input camera view, but with multiple pixels along each line of sight. The size of the representation grows only linearly with the observed depth complexity in the scene. Moreover, because the LDI data are represented in a single image coordinate system, McMillan’s warp ordering algorithm can be successfully adapted. As a result, pixels are drawn in the output image in back-to-front order. No z-buffer is required, so alphacompositing can be done efficiently without depth sorting. This makes splatting an efficient solution to the resampling problem.

[1]  Paul S. Heckbert,et al.  Survey of Texture Mapping , 1986, IEEE Computer Graphics and Applications.

[2]  George Wolberg,et al.  Digital image warping , 1990 .

[3]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[4]  Paul S. Heckbert,et al.  Interpolation for Polygon Texture Mapping and Shading , 1991 .

[5]  Mark Segal,et al.  Fast shadows and lighting effects using texture mapping , 1992, SIGGRAPH.

[6]  Edward H. Adelson,et al.  Layered representation for motion analysis , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[8]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[9]  Harpreet S. Sawhney,et al.  3D geometry from planar parallax , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[11]  P. Anandan,et al.  Direct recovery of shape from multiple views: a parallax based approach , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[12]  Leonard McMillan,et al.  A List-Priority Rendering Algorithm for Redisplaying Projected Surfaces , 1995 .

[13]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[14]  Leonard McMillan,et al.  Shape as a Perturbation to Projective Mapping , 1995 .

[15]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[16]  Stephen M. Pizer.  Computing Visibility without Depth , 1996 .

[17]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[18]  Jay Torborg,et al.  Talisman: commodity realtime 3D graphics for the PC , 1996, SIGGRAPH.

[19]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[20]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[21]  Richard E. Ladner,et al.  Caches and algorithms , 1996 .

[22]  Nelson L. Max,et al.  Hierarchical Rendering of Trees from Precomputed Multi-Layer Z-Buffers , 1996, Rendering Techniques.

[23]  Wolfgang Stuerzlinger,et al.  A Three Dimensional Image Cache for Virtual Reality , 1996, Comput. Graph. Forum.

[24]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[25]  Henry Fuchs,et al.  The Delta Tree: An Object-Centered Approach to Image-Based Rendering , 1996 .

[26]  Pat Hanrahan,et al.  Rendering complex scenes with memory-coherent ray tracing , 1997, SIGGRAPH.

[27]  John Snyder,et al.  Rendering with coherent layers , 1997, SIGGRAPH.

[28]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[29]  Photorealistic scene reconstruction by voxel coloring , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Amitabh Varshney,et al.  Navigating static environments using image-space simplification and morphing , 1997, SI3D.

[31]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[32]  Richard Szeliski,et al.  A layered approach to stereo reconstruction , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[33]  Marc Levoy,et al.  The Use of Points as a Display Primitive , 2000 .