Superresolution with Plenoptic Camera 2 . 0

This work is based on the plenoptic 2.0 camera, which captures an array of real images focused on the object. We show that this very fact makes it possible to use the camera data with super-resolution techniques, which enables the focused plenoptic camera to achieve high spatial resolution. We derive the conditions under which the focused plenoptic camera can capture radiance data suitable for super resolution. We develop an algorithm for super resolving those images. Experimental results are presented that show a 9× increase in spatial resolution compared to the basic plenoptic 2.0 rendering approach.

[1]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[2]  A. Damry.  Épreuves Réversibles- Photographies Intégrales , 1908 .

[3]  Herbert E. Ives,et al.  A Camera for Making Parallax Panoramagrams , 1928 .

[4]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Bobby R. Hunt,et al.  Super‐resolution of images: Algorithms, principles, performance , 1995, Int. J. Imaging Syst. Technol..

[6]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[7]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[8]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[9]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Richard R. Schultz.  Super-resolution enhancement of native digital video versus digitized NTSC sequences , 2002, Proceedings Fifth IEEE Southwest Symposium on Image Analysis and Interpretation.

[11]  Nirmal K. Bose,et al.  Mathematical analysis of super-resolution methodology , 2003, IEEE Signal Process. Mag..

[12]  Zhouchen Lin,et al.  Response to the Comments on "Fundamental Limits of Reconstruction-Based Superresolution Algorithms under Local Translation' , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[14]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[15]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[16]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[17]  A. Lumsdaine.  Full Resolution Lightfield Rendering , 2008 .

[18]  Tom E. Bishop,et al.  Light field superresolution , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).