Scam light field rendering

In this paper we present a new variant of the light field representation that supports improved image reconstruction by accommodating sparse correspondence information. This places our representation somewhere between a pure, two-plane parameterized, light field and a lumigraph representation, with its continuous geometric proxy. Our approach factorises the rays of a light field into one of two separate classes. All rays consistent with a given correspondence are implicitly represented using a new auxiliary data structure, which we call a surface camera (or scam). The remaining rays of the light field are represented using a standard two-plane parameterized light field. We present an efficient rendering algorithm that combines ray samples from scams with those from the light field. The resulting image reconstructions are noticeably improved over that of a pure light field.

[1]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[2]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[3]  O. Faugeras.  Three-Dimensional Computer Vision , 1993 .

[4]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[5]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[6]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[7]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[8]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[9]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[10]  Xianfeng Gu,et al.  Polyhedral Geometry and the Two-Plane Parameterization , 1997, Rendering Techniques.

[11]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[12]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[13]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[14]  Hans-Peter Seidel,et al.  Adaptive Acquisition of Lumigraphs from Synthetic Scenes , 1999, Comput. Graph. Forum.

[15]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[16]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[17]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[18]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[19]  Olivier Devillers,et al.  Walking in a triangulation , 2001, SCG '01.

[20]  Harry Shum,et al.  Simultaneous separation and depth recovery of specular reflections , 2002, eccv 2002.

[21]  Leonard McMillan,et al.  A Real-Time Distributed Light Field Camera , 2002, Rendering Techniques.

[22]  Richard Szeliski,et al.  Extracting View-Dependent Depth Maps from a Collection of Images , 2004, International Journal of Computer Vision.