Spatial analysis of discrete plenoptic sampling

Plenoptic cameras are intended to fully capture the light rays in a scene. Using this information, optical elements can be applied to a scene computationally rather than physically-allowing an infinite variety of pictures to be rendered after the fact from the same plenoptic data. Practical plenoptic cameras necessarily capture discrete samples of the plenoptic function, which together with the overall camera design, can constrain the variety and quality of rendered images. In this paper we specifically analyze the nature of the discrete data that plenoptic cameras capture, in a manner that unifies the traditional and focused plenoptic camera designs. We use the optical properties of plenoptic cameras to derive the geometry of discrete plenoptic function capture. Based on this geometry, we derive expressions for expected resolution from a captured plenoptic function. Our analysis allows us to define the "focused plenoptic condition," a necessary condition in the optical design that distinguishes the traditional plenoptic camera from the focused plenoptic camera.

[1]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[2]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[3]  Kurt Bernardo Wolf,et al.  Geometric Optics on Phase Space , 2004 .

[4]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[5]  Tom E. Bishop,et al.  Light field superresolution , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[6]  A. Thetford Introduction to Matrix Methods in Optics , 1976 .

[7]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[8]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[9]  H.-S. Philip Wong,et al.  A 3MPixel Multi-Aperture Image Sensor with 0.7μm Pixels in 0.11μm CMOS , 2008, 2008 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[10]  E. Nicodemus Self-study manual on optical radiation measurements , 1976 .

[11]  S. Sternberg,et al.  Symplectic Techniques in Physics , 1984 .

[12]  Andrew Lumsdaine,et al.  Superresolution with the focused plenoptic camera , 2011, Electronic Imaging.

[13]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[14]  G. Lippmann,et al.  Epreuves reversibles. Photographies integrals , 1908 .

[15]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[16]  Leonard McMillan,et al.  A new reconstruction filter for undersampled light fields , 2003 .

[17]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[18]  P. Hanrahan,et al.  Digital light field photography , 2006 .