The light field oracle

We present the light field oracle, a novel mathematical concept for the acquisition, processing and representation of light fields. We first compute a hierarchical representation from a set of sparse image samples using a combination of wavelet transform and scattered data interpolation. The light field oracle then progressively acquires image data and selectively refines this initial representation. By comparing the actual input image to the corresponding reconstruction from the wavelet pyramid, the oracle dynamically decides on whether the new sample is needed and, if necessary, inserts it into the representation. Our incremental update scheme exploits the spatial localization of wavelets and allows for highly efficient image decomposition. Likewise, image reconstruction for rendering is computed locally in the wavelet domain and does not require a global inverse transform. The wavelet hierarchy along with fast decomposition and rendering operators constitutes a powerful mathematical framework also amenable to compression.

[1]  Paul Lalonde,et al.  Interactive Rendering of Wavelet Projected Light Fields , 1999, Graphics Interface.

[2]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[3]  H SalesinDavid,et al.  Wavelets for Computer Graphics , 1995 .

[4]  Hans-Peter Seidel,et al.  Adaptive Acquisition of Lumigraphs from Synthetic Scenes , 1999, Comput. Graph. Forum.

[5]  Donald S. Fussell,et al.  Uniformly Sampled Light Fields , 1998, Rendering Techniques.

[6]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[7]  Yunnan Wu,et al.  Rendering of 3D-wavelet-compressed concentric mosaic scenery with progressive inverse wavelet synthesis (PIWS) , 2000, Visual Communications and Image Processing.

[8]  P MitchellDon.  Generating antialiased images at low sampling densities , 1987 .

[9]  Wolfgang Straßer,et al.  The Wavelet Stream: Interactive Multi Resolution Light Field Rendering , 2001, Rendering Techniques.

[10]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[11]  Marcus A. Magnor,et al.  Progressive Compression and Rendering of Light Fields , 2000, VMV.

[12]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[13]  Peter J. Burt,et al.  Moment images, polynomial fit filters. and the problem of surface interpolation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[15]  Insung Ihm,et al.  Wavelet‐Based 3D Compression Scheme for Interactive Visualization of Very Large Volume Data , 1999, Comput. Graph. Forum.

[16]  E. J. Stollnitz,et al.  Wavelets for Computer Graphics : A Primer , 1994 .

[17]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[18]  Insung Ihm,et al.  Rendering of spherical light fields , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[19]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[20]  Reinhard Koch,et al.  Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera , 1999, DAGM-Symposium.

[21]  Harry Shum,et al.  On the Compression of Image Based Rendering Scene: A Comparison among Block, Reference and Wavelet Coders , 2001, Int. J. Image Graph..

[22]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.