Light-field image acquisition from a conventional camera: design of a four minilens ring device

Abstract. In the past few years, a new type of camera has been emerging on the market: a digital camera capable of capturing both the intensity of the light emanating from a scene and the direction of the light rays. This camera technology called a light-field camera uses an array of lenses placed in front of a single image sensor, or simply, an array of cameras attached together. An optical device is proposed: a four minilens ring that is inserted between the lens and the image sensor of a digital camera. This device prototype is able to convert a regular digital camera into a light-field camera as it makes it possible to record four subaperture images of the scene. It is a compact and cost-effective solution to perform both postcapture refocusing and depth estimation. The minilens ring makes also the plenoptic camera versatile; it is possible to adjust the parameters of the ring so as to reduce or increase the size of the projected image. Together with the proof of concept of this device, we propose a method to estimate the positions of each optical component depending on the observed scene (object size and distance) and the optics parameters. Real-world results are presented to validate our device prototype.

[1]  G. Lippmann Epreuves reversibles donnant la sensation du relief , 1908 .

[2]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[3]  Vladan Velisavljevic,et al.  Light field geometry of a Standard Plenoptic Camera. , 2014, Optics express.

[4]  Todor Georgiev Georgiev,et al.  Plenoptic Camera Resolution , 2015 .

[5]  J. P. Luke,et al.  Depth From Light Fields Analyzing 4D Local Structure , 2015, Journal of Display Technology.

[6]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[7]  C. Cudel,et al.  Interest of polarimetric refocused images calibrated in depth for control by vision , 2018, Photonics Europe.

[8]  Marc Levoy,et al.  Light Fields and Computational Imaging , 2006, Computer.

[9]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Christophe Cudel,et al.  Interests of refocused images calibrated in depth with a multi-view camera for control by vision , 2017, International Conference on Quality Control by Artificial Vision.

[11]  Jitendra Malik,et al.  Depth from Combining Defocus and Correspondence Using Light-Field Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[12]  Qionghai Dai,et al.  Light Field Image Processing: An Overview , 2017, IEEE Journal of Selected Topics in Signal Processing.

[13]  Marta Puga,et al.  Design and Laboratory Results of a Plenoptic Objective: From 2D to 3D With a Standard Camera , 2015, Journal of Display Technology.

[14]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[15]  Sven Wanner,et al.  Globally consistent depth labeling of 4D light fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  In-So Kweon,et al.  Accurate depth map estimation from a lenslet light field camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Hans-Peter Seidel,et al.  Three-dimensional kaleidoscopic imaging , 2011, CVPR 2011.

[18]  Ivo Ihrke,et al.  Principles of Light Field Imaging: Briefly revisiting 25 years of research , 2016, IEEE Signal Processing Magazine.

[19]  Edmund Y Lam,et al.  Computational photography with plenoptic camera and light field capture: tutorial. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[21]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[22]  Christophe Cudel,et al.  Calibration and disparity maps for a depth camera based on a four-lens device , 2015, J. Electronic Imaging.