Reducing Plenoptic Camera Artifacts

The focused plenoptic camera differs from the traditional plenoptic camera in that its microlenses are focused on the photographed object rather than at infinity. The spatio‐angular tradeoffs available with this approach enable rendering of final images that have significantly higher resolution than those from traditional plenoptic cameras. Unfortunately, this approach can result in visible artifacts when basic rendering is used. In this paper, we present two new methods that work together to minimize these artifacts. The first method is based on careful design of the optical system. The second method is computational and based on a new lightfield rendering algorithm that extracts the depth information of a scene directly from the lightfield and then uses that depth information in the final rendering. Experimental results demonstrate the effectiveness of these approaches.

[1]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[3]  Andrew Lumsdaine,et al.  Unified Frequency Domain Analysis of Lightfield Cameras , 2008, ECCV.

[4]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[5]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[6]  G. Lippmann,et al.  Epreuves reversibles. Photographies integrals , 1908 .

[7]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[8]  Andrew Lumsdaine,et al.  Depth of Field in Plenoptic Cameras , 2009, Eurographics.

[9]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[10]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[11]  Ren Ng Fourier slice photography , 2005, ACM Trans. Graph..

[12]  H.-S. Philip Wong,et al.  A 3MPixel Multi-Aperture Image Sensor with 0.7μm Pixels in 0.11μm CMOS , 2008, 2008 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[13]  Ren Ng Fourier slice photography , 2005, ACM Trans. Graph..

[14]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[15]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[16]  P. Hanrahan,et al.  Digital light field photography , 2006 .