Plenoptic Sensor: Application to Extend Field-of-View

In this paper we study the light field sampling produced by ideal plenoptic sensors, an emerging technology providing new optical capabilities. In particular, we leverage its potential with a new optical design that couples a pyramid lens with an ideal plenoptic sensor. The main advantage is that it extends the field-of-view (FOV) of a main-lens without changing its focal length. To evince the utility of the proposed design we have performed different experiments. First, we demonstrate on simulated synthetic images that our optical design effectively doubles the FOV. Then, we show its feasibility with two different prototypes using plenoptic cameras on the market with very different plenoptic samplings, namely a Raytrix R5 and a Canon 5D MarkIV. Arguably, future cameras with ideal plenoptic sensors will be able to be coupled with pyramid lenses to extend its inherent FOV in a single snapshot.

[1]  Chien-Yue Chen,et al.  Optics system design applying a micro-prism array of a single lens stereo image pair. , 2008, Optics express.

[2]  ロミオ アイ メルカド.  Small form factor telephoto camera , 2014 .

[3]  Richard Szeliski,et al.  Refocusing plenoptic images using depth-adaptive splatting , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[4]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[5]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[6]  Chandra Kambhamettu,et al.  Single Camera Stereo System Using Prism and Mirrors , 2010, ISVC.

[7]  Pat Hanrahan,et al.  Digital correction of lens aberrations in light field photography , 2006, International Optical Design Conference.

[8]  Shree K. Nayar,et al.  Gigapixel Computational Imaging , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[9]  Chuen-Lin Tien,et al.  Single-lens camera based on a pyramid prism array to capture four images , 2013 .

[10]  Greg Humphreys,et al.  Physically Based Rendering, Second Edition: From Theory To Implementation , 2010 .

[11]  Valter Drazic,et al.  An Image Rendering Pipeline for Focused Plenoptic Cameras , 2017, IEEE Transactions on Computational Imaging.

[12]  Peter B. Catrysse,et al.  QE reduction due to pixel vignetting in CMOS image sensors , 2000, Electronic Imaging.

[13]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  J. Ford,et al.  Optimization of two-glass monocentric lenses for compact panoramic imagers: general aberration analysis and specific designs. , 2012, Applied optics.

[15]  Yu-Wing Tai,et al.  Modeling the Calibration Pipeline of the Lytro Camera for High Quality Light-Field Image Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Gordon Wetzstein,et al.  A Wide-Field-of-View Monocentric Light Field Camera , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[18]  Ashkan Arianpour,et al.  Panoramic monocentric imaging using fiber-coupled focal planes. , 2014, Optics express.

[19]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[20]  Jitendra Malik,et al.  Depth from shading, defocus, and correspondence using light-field angular coherence , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Martin Vetterli,et al.  Light field panorama by a plenoptic camera , 2013, Electronic Imaging.

[22]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[23]  Patrick Pérez,et al.  Accurate Disparity Estimation for Plenoptic Images , 2014, ECCV Workshops.

[24]  根岸典央.  Image sensor and image capturing system , 2013 .

[25]  Sungho Choi,et al.  An all pixel PDAF CMOS image sensor with 0.64μmx1.28μm photodiode separated by self-aligned in-pixel deep trench isolation for high AF performance , 2017, 2017 Symposium on VLSI Technology.