Full Resolution Lightfield Rendering

Lightfield photography enables many new possibilities for digital imaging because it captures both spatial and angular information, i.e., the full four-dimensional radiance, of a scene. Extremely high resolution is required in order to capture four-dimensional data with a two-dimensional sensor. However, images rendered from the lightfield as projections of the four-dimensional radiance onto two spatial dimensions are at significantly lower resolutions. To meet the resolution and image size expectations of modern digital photography, this paper presents a new technique for rendering high resolution images from the lightfield. We call our approach full resolution because it makes full use of both positional and angular information available in captured radiance data. We present a description of our approach and an analysis of the limits and tradeoffs involved. We demonstrate the effectiveness of our method experimentally by rendering images from a 542 megapixel lightfield, using the traditional approach and using our new approach. In our experiments, the traditional rendering methods produce a 0.146 megapixel image, while with the full resolution approach we are able to produce a 106 megapixel final image. CR Categories: I.3.3 [Computing Methodologies]: Image Processing and Computer Vision—Digitization and Image Capture

[1]  G. Lippmann Epreuves reversibles donnant la sensation du relief , 1908 .

[2]  A. Gerrard,et al.  Introduction to Matrix Methods in Optics , 1975 .

[3]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Bobby R. Hunt,et al.  Super‐resolution of images: Algorithms, principles, performance , 1995, Int. J. Imaging Syst. Technol..

[5]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[6]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[7]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[8]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[9]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[10]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[11]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[12]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[13]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[14]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[15]  Ren Ng Fourier slice photography , 2005, ACM Trans. Graph..

[16]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[17]  Chintan Intwala,et al.  Light Field Camera Design for Integral View Photography , 2006 .

[18]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, ACM Trans. Graph..