Depth-of-Field-Extended Plenoptic Camera Based on Tunable Multi-Focus Liquid-Crystal Microlens Array

Plenoptic cameras have received a wide range of research interest because it can record the 4D plenoptic function or radiance including the radiation power and ray direction. One of its important applications is digital refocusing, which can obtain 2D images focused at different depths. To achieve digital refocusing in a wide range, a large depth of field (DOF) is needed, but there are fundamental optical limitations to this. In this paper, we proposed a plenoptic camera with an extended DOF by integrating a main lens, a tunable multi-focus liquid-crystal microlens array (TMF-LCMLA), and a complementary metal oxide semiconductor (CMOS) sensor together. The TMF-LCMLA was fabricated by traditional photolithography and standard microelectronic techniques, and its optical characteristics including interference patterns, focal lengths, and point spread functions (PSFs) were experimentally analyzed. Experiments demonstrated that the proposed plenoptic camera has a wider range of digital refocusing compared to the plenoptic camera based on a conventional liquid-crystal microlens array (LCMLA) with only one corresponding focal length at a certain voltage, which is equivalent to the extension of DOF. In addition, it also has a 2D/3D switchable function, which is not available with conventional plenoptic cameras.

[1]  Gil Ju Lee,et al.  Large area fabrication of engineered microlens array with low sag height for light-field imaging. , 2019, Optics express.

[2]  B. Javidi,et al.  Dual layer electrode liquid crystal lens for 2D/3D tunable endoscopy imaging system. , 2016, Optics express.

[3]  Reinhard Koch,et al.  Robust Depth Estimation for Light Field Microscopy , 2019, Sensors.

[4]  J. F. Algorri,et al.  Liquid crystal spherical microlens array with high fill factor and optical power. , 2017, Optics express.

[5]  Yuan Yuan,et al.  Rectification of Images Distorted by Microlens Array Errors in Plenoptic Cameras , 2018, Sensors.

[6]  C. Xie,et al.  Dual-polarized light-field imaging micro-system via a liquid-crystal microlens array for direct three-dimensional observation. , 2018, Optics express.

[7]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[8]  Yuan Yuan,et al.  High-Accuracy Correction of a Microlens Array for Plenoptic Imaging Sensors , 2019, Sensors.

[9]  M. Levoy,et al.  Recording and controlling the 4D light field in a microscope using microlens arrays , 2009, Journal of microscopy.

[10]  Andrew Lumsdaine,et al.  The multifocus plenoptic camera , 2011, Electronic Imaging.

[11]  Paulo Lobato Correia,et al.  Light Fields for Face Analysis , 2019, Sensors.

[12]  J. F. Algorri,et al.  Tunable liquid crystal multifocal microlens array , 2017, Scientific Reports.

[13]  J. L. Zhao,et al.  Fast switching ferroelectric liquid crystal Pancharatnam-Berry lens. , 2019, Optics express.

[14]  J. F. Algorri,et al.  Low aberration and fast switching microlenses based on a novel liquid crystal mixture. , 2017, Optics express.

[15]  Andrew Lumsdaine,et al.  Depth of Field in Plenoptic Cameras , 2009, Eurographics.

[16]  Changsheng Xie,et al.  Dual-mode photosensitive arrays based on the integration of liquid crystal microlenses and CMOS sensors for obtaining the intensity images and wavefronts of objects. , 2016, Optics express.

[17]  Qiong‐Hua Wang,et al.  Large aperture liquid crystal lens array using a composited alignment layer. , 2018, Optics express.

[18]  G. Taubin,et al.  Mask-based light field capture and display , 2011 .

[19]  Shin-Tson Wu,et al.  Liquid crystal lens with large focal length tunability and low operating voltage. , 2007, Optics express.

[20]  Wu,et al.  Birefringence dispersions of liquid crystals. , 1986, Physical review. A, General physics.

[21]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[22]  J. F. Algorri,et al.  Tunable liquid crystal cylindrical micro-optical array for aberration compensation. , 2015, Optics express.

[23]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Hideyuki Funaki,et al.  A Gradient Index Liquid Crystal Microlens Array for Light-Field Camera Applications , 2015, IEEE Photonics Technology Letters.

[25]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[26]  Yi-Hsin Lin,et al.  Liquid crystal lenses with tunable focal length , 2017 .

[27]  J. F. Algorri,et al.  Integral Imaging Capture System With Tunable Field of View Based on Liquid Crystal Microlenses , 2016, IEEE Photonics Technology Letters.

[28]  Qionghai Dai,et al.  Camera array based light field microscopy. , 2015, Biomedical optics express.

[29]  N. Fraval,et al.  Low aberrations symmetrical adaptive modal liquid crystal lens with short focal lengths. , 2010, Applied optics.

[30]  Byoungho Lee,et al.  Real-time integral imaging system for light field microscopy. , 2014, Optics express.

[31]  J. F. Algorri,et al.  Cylindrical Liquid Crystal Microlens Array With Rotary Optical Power and Tunable Focal Length , 2015, IEEE Electron Device Letters.

[32]  Jianghao Xiong,et al.  Device simulation of liquid crystal polarization gratings. , 2019, Optics express.

[33]  Mislav Grgic,et al.  Blind image sharpness assessment based on local contrast map statistics , 2018, J. Vis. Commun. Image Represent..

[34]  Yuanchi Ma,et al.  A depth estimation algorithm of plenoptic camera for the measurement of particles , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[35]  Wei Hu,et al.  Liquid crystal tunable terahertz lens with spin-selected focusing property. , 2019, Optics express.

[36]  Yi-Pai Huang,et al.  Hybrid light field head-mounted display using time-multiplexed liquid crystal lens array for resolution enhancement. , 2019, Optics express.

[37]  H Wang,et al.  Depth of field extension and objective space depth measurement based on wavefront imaging. , 2018, Optics express.

[38]  Changsheng Xie,et al.  An electrically tunable plenoptic camera using a liquid crystal microlens array. , 2015, The Review of scientific instruments.

[39]  Bahram Javidi,et al.  Extended depth-of-field 3D endoscopy with synthetic aperture integral imaging using an electrically tunable focal-length liquid-crystal lens. , 2015, Optics letters.

[40]  Huan Deng,et al.  Integral imaging-based 2D/3D convertible display system by using holographic optical element and polymer dispersed liquid crystal. , 2019, Optics letters.

[41]  Shin-Tson Wu,et al.  Polarization independent adaptive microlens with a blue-phase liquid crystal. , 2011, Optics express.

[42]  U Efron,et al.  Birefringence measurements of liquid crystals. , 1984, Applied optics.

[43]  Jong-Mo Seo,et al.  Insect-Mimetic Imaging System Based on a Microlens Array Fabricated by a Patterned-Layer Integrating Soft Lithography Process , 2018, Sensors.

[44]  Xiang Peng,et al.  Structured light field 3D imaging. , 2016, Optics express.

[45]  B. Javidi,et al.  Hexagonal liquid crystal lens array for 3D endoscopy. , 2015, Optics express.

[46]  Bahram Javidi,et al.  Extended depth-of-focus 3D micro integral imaging display using a bifocal liquid crystal lens. , 2015, Optics letters.

[47]  Shin-Tson Wu,et al.  Tunable-focus liquid microlens array using dielectrophoretic effect. , 2008, Optics express.